2024-03-08T20:14:23.412 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-08T20:14:23.412 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} --owner scheduled_rishabh@teuthology --name rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112 -- /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/orig.config.yaml 2024-03-08T20:14:23.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T20:14:23.543 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112 branch: rishabh-2024mar8 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} email: null first_in_suite: false job_id: '7588112' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - kernel_untar_build.sh kernel: client: branch: testing flavor: default kdb: true sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2024mar8 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 7d63482aa89628d733e298984a762389b625c761 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 7d63482aa89628d733e298984a762389b625c761 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2024mar8 sha1: 7d63482aa89628d733e298984a762389b625c761 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 1249 sha1: 7d63482aa89628d733e298984a762389b625c761 sleep_before_teardown: 0 subset: 481/512 suite: fs suite_branch: rishabh-2024mar8 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7d63482aa89628d733e298984a762389b625c761 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9BkScvZt4QDYtBk4Pxn2Qt5ZzYrp+9+woEegzZUhrKrFz2RwuwpgNpdol3vAP/wlmLbN61128BVAsxldMv+aM= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNCdkh3ky50nCQmJAhjVxMzf3hsTQ68dRqYNoZojzitxCVzkVQiVu5zaAzqRJF/iZsitXWtI6nNv7HDZMgChsY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-08_19:54:47 tube: smithi user: rishabh user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/blogbench.sh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-08T20:14:23.543 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa; will attempt to use it 2024-03-08T20:14:23.544 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks 2024-03-08T20:14:23.544 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-08T20:14:23.545 INFO:teuthology.task.internal:Checking packages... 2024-03-08T20:14:23.571 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7d63482aa89628d733e298984a762389b625c761' 2024-03-08T20:14:23.571 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-08T20:14:23.571 INFO:teuthology.packaging:ref: None 2024-03-08T20:14:23.571 INFO:teuthology.packaging:tag: None 2024-03-08T20:14:23.571 INFO:teuthology.packaging:branch: rishabh-2024mar8 2024-03-08T20:14:23.571 INFO:teuthology.packaging:sha1: 7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:14:23.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2024mar8 2024-03-08T20:14:23.829 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1965.g7d63482a 2024-03-08T20:14:23.832 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-08T20:14:23.838 INFO:teuthology.task.internal:no buildpackages task found 2024-03-08T20:14:23.838 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-08T20:14:23.853 INFO:teuthology.task.internal:Saving configuration 2024-03-08T20:14:23.886 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-08T20:14:23.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T20:14:23.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 20:08:51.460644', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9BkScvZt4QDYtBk4Pxn2Qt5ZzYrp+9+woEegzZUhrKrFz2RwuwpgNpdol3vAP/wlmLbN61128BVAsxldMv+aM='} 2024-03-08T20:14:23.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 20:08:51.462083', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNCdkh3ky50nCQmJAhjVxMzf3hsTQ68dRqYNoZojzitxCVzkVQiVu5zaAzqRJF/iZsitXWtI6nNv7HDZMgChsY='} 2024-03-08T20:14:23.942 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-08T20:14:23.950 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-08T20:14:23.950 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-03-08T20:14:23.950 INFO:teuthology.run_tasks:Running task console_log... 2024-03-08T20:14:24.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb42c9840d0>, signals=[15]) 2024-03-08T20:14:24.023 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-08T20:14:24.031 INFO:teuthology.task.internal:Opening connections... 2024-03-08T20:14:24.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:14:24.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:14:24.126 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:14:24.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:14:24.214 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-08T20:14:24.222 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-03-08T20:14:24.239 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-03-08T20:14:24.240 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-03-08T20:14:24.296 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T20:14:24.297 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T20:14:24.298 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-03-08T20:14:24.315 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-03-08T20:14:24.333 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-03-08T20:14:24.333 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-03-08T20:14:24.390 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-03-08T20:14:24.390 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-03-08T20:14:24.390 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-03-08T20:14:24.390 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-03-08T20:14:24.391 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T20:14:24.392 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-03-08T20:14:24.392 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T20:14:24.392 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T20:14:24.392 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T20:14:24.392 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-03-08T20:14:24.415 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-08T20:14:24.429 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-08T20:14:24.464 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-08T20:14:24.465 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-03-08T20:14:24.468 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-03-08T20:14:24.484 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-08T20:14:24.491 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-08T20:14:24.491 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-03-08T20:14:24.524 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-03-08T20:14:24.617 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-08T20:14:24.673 INFO:teuthology.run_tasks:Running task kernel... 2024-03-08T20:14:24.687 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'} 2024-03-08T20:14:24.687 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-03-08T20:14:24.687 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-08T20:14:24.687 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T20:14:24.688 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T20:14:24.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:14:24.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-08T20:14:24.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:14:24.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-08T20:14:24.931 DEBUG:teuthology.task.kernel:sha1 for client.1 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:14:24.931 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T20:14:24.931 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-03-08T20:14:24.949 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-361.el9.x86_64 2024-03-08T20:14:24.949 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:14:24.950 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T20:14:24.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2024-03-08T20:14:25.116 DEBUG:teuthology.task.kernel:sha1 for client.0 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:14:25.116 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T20:14:25.116 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-03-08T20:14:25.133 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-361.el9.x86_64 2024-03-08T20:14:25.133 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:14:25.133 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T20:14:25.134 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum upgrade -y linux-firmware 2024-03-08T20:14:27.206 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-08T20:14:28.494 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - AppStream 8.5 MB/s | 6.7 MB 00:00 2024-03-08T20:14:28.957 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2024-03-08T20:14:30.353 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - BaseOS 2.5 MB/s | 2.0 MB 00:00 2024-03-08T20:14:31.868 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.0 MB 00:01 2024-03-08T20:14:32.306 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.0 MB 00:03 2024-03-08T20:14:57.495 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 799 kB/s | 19 MB 00:24 2024-03-08T20:15:02.395 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.1 MB 00:01 2024-03-08T20:15:03.721 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 15 kB 00:00 2024-03-08T20:15:04.024 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 621 kB/s | 19 MB 00:31 2024-03-08T20:15:05.900 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-08T20:15:10.805 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-03-08T20:15:13.049 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 1 Package 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:15:13.057 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 375 M 2024-03-08T20:15:13.058 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-03-08T20:15:18.039 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 603 kB/s | 6.1 MB 00:10 2024-03-08T20:15:19.890 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-03-08T20:15:27.302 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 21 MB 00:07 2024-03-08T20:15:32.407 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 4.9 kB/s | 1.7 kB 00:00 2024-03-08T20:15:32.412 INFO:teuthology.orchestra.run.smithi144.stdout:linux-firmware-20240219-143.el9.noarch.rpm 19 MB/s | 375 MB 00:19 2024-03-08T20:15:32.413 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-03-08T20:15:32.414 INFO:teuthology.orchestra.run.smithi144.stdout:Total 19 MB/s | 375 MB 00:19 2024-03-08T20:15:32.414 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-03-08T20:15:32.518 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-03-08T20:15:32.518 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-03-08T20:15:34.708 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-03-08T20:15:34.720 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-08T20:15:34.720 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 1 Package 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 375 M 2024-03-08T20:15:34.721 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-03-08T20:15:34.974 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-03-08T20:15:34.974 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-03-08T20:15:41.235 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-03-08T20:15:41.489 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T20:15:41.580 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:42.693 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:42.694 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:15:43.068 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-03-08T20:15:43.359 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-08T20:15:43.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:15:43.510 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-08T20:15:43.511 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-08T20:15:43.513 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-03-08T20:15:45.657 INFO:teuthology.orchestra.run.smithi118.stdout:linux-firmware-20240219-143.el9.noarch.rpm 34 MB/s | 375 MB 00:10 2024-03-08T20:15:45.658 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-03-08T20:15:45.659 INFO:teuthology.orchestra.run.smithi118.stdout:Total 34 MB/s | 375 MB 00:10 2024-03-08T20:15:45.659 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-03-08T20:15:45.748 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-03-08T20:15:45.748 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-03-08T20:15:48.199 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-03-08T20:15:48.199 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-03-08T20:15:54.560 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-03-08T20:15:54.808 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T20:15:54.897 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:56.139 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:56.139 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:15:56.510 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-03-08T20:15:56.839 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-08T20:15:56.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T20:15:56.986 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-08T20:15:56.986 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-08T20:15:56.989 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2024-03-08T20:16:05.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08 20:16:05 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-08T20:16:05.651 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2024-03-08 20:16:05-- 2024-03-08T20:16:05.651 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 22s 2024-03-08T20:16:05.651 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 321M in 22s (14.8 MB/s) 2024-03-08T20:16:05.654 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-08T20:16:05.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-08T20:16:07.586 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2024-03-08T20:16:07.722 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2024-03-08T20:16:07.801 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2024-03-08T20:16:11.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08 20:16:11 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-08T20:16:11.390 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2024-03-08 20:16:11-- 2024-03-08T20:16:11.390 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 14s 2024-03-08T20:16:11.390 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 321M in 14s (22.7 MB/s) 2024-03-08T20:16:11.393 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-08T20:16:11.394 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-08T20:16:13.324 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying... ######################################## 2024-03-08T20:16:13.381 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing... ######################################## 2024-03-08T20:16:13.461 INFO:teuthology.orchestra.run.smithi118.stdout:Updating / installing... 2024-03-08T20:16:15.320 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-08T20:16:20.942 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-08T20:16:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-08T20:16:38.835 INFO:teuthology.orchestra.run.smithi118.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-08T20:16:54.183 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-08T20:16:54.184 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-08T20:16:54.259 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T20:16:54.260 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T20:16:54.261 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T20:16:54.262 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T20:16:54.263 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T20:16:54.264 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T20:16:54.265 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T20:16:54.266 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T20:16:54.267 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T20:16:54.268 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T20:16:54.269 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T20:16:54.270 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T20:16:54.271 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T20:16:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T20:16:54.273 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T20:16:54.274 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-08T20:16:54.275 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T20:16:54.276 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-08T20:16:54.277 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T20:16:54.278 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T20:16:54.279 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-08T20:16:54.280 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-08T20:16:54.281 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-08T20:16:54.282 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T20:16:54.283 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T20:16:54.284 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T20:16:54.285 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T20:16:54.286 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T20:16:54.287 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T20:16:54.288 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T20:16:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T20:16:54.290 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T20:16:54.291 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T20:16:54.292 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T20:16:54.293 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T20:16:54.294 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T20:16:54.295 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T20:16:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T20:16:54.297 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T20:16:54.298 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T20:16:54.299 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-08T20:16:54.300 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T20:16:54.301 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-08T20:16:54.302 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T20:16:54.303 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-08T20:16:54.304 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T20:16:54.305 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-08T20:16:54.306 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T20:16:54.307 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-08T20:16:54.308 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-08T20:16:54.309 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T20:16:54.310 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-08T20:16:54.311 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-08T20:16:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T20:16:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T20:16:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-08T20:16:54.315 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T20:16:54.316 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T20:16:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T20:16:54.318 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-08T20:16:54.319 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T20:16:54.320 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T20:16:54.321 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T20:16:54.322 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T20:16:54.323 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T20:16:54.324 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T20:16:54.325 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T20:16:54.326 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T20:16:54.327 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T20:16:54.328 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-08T20:16:54.329 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T20:16:54.330 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T20:16:54.331 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T20:16:54.332 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-08T20:16:54.333 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T20:16:54.334 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T20:16:54.335 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T20:16:54.336 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T20:16:54.337 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T20:16:54.338 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T20:16:54.339 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T20:16:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-08T20:16:54.341 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T20:16:54.342 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T20:16:54.343 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T20:16:54.344 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T20:16:54.345 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T20:16:54.346 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T20:16:54.347 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-08T20:16:54.348 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T20:16:54.349 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-08T20:16:54.350 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T20:16:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T20:16:54.352 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T20:16:54.353 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T20:16:54.354 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T20:16:54.355 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T20:16:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T20:16:54.357 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T20:16:54.358 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T20:16:54.359 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T20:16:54.360 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T20:16:54.361 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-08T20:16:54.362 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T20:16:54.363 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T20:16:54.364 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T20:16:54.365 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T20:16:54.366 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T20:16:54.367 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-08T20:16:54.368 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-08T20:16:54.369 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-08T20:16:54.370 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T20:16:54.371 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T20:16:54.372 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T20:16:54.373 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T20:16:54.374 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T20:16:54.375 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-08T20:16:54.376 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T20:16:54.377 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-08T20:16:54.378 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T20:16:54.379 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-08T20:16:54.380 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T20:16:54.381 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T20:16:54.382 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T20:16:54.383 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T20:16:54.384 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-08T20:16:54.385 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T20:16:54.386 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T20:16:54.387 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T20:16:54.388 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T20:16:54.389 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T20:16:54.390 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T20:16:54.391 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T20:16:54.392 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T20:16:54.393 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T20:16:54.394 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T20:16:54.395 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T20:16:54.396 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T20:16:54.397 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-08T20:16:54.398 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T20:16:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T20:16:54.400 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T20:16:54.401 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T20:16:54.402 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T20:16:54.403 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T20:16:54.404 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T20:16:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T20:16:54.406 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T20:16:54.407 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T20:16:54.408 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T20:16:54.409 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T20:16:54.410 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T20:16:54.411 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T20:16:54.412 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T20:16:54.413 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T20:16:54.414 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T20:16:54.415 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-08T20:16:54.416 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T20:16:54.417 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T20:16:54.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T20:16:54.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T20:16:54.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T20:16:54.418 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T20:16:54.422 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:54.422 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-08T20:16:54.445 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2024-03-08T20:16:54.445 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:for file in vmlinuz System.map config; do 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout: fi 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-03-08T20:16:54.446 INFO:teuthology.orchestra.run.smithi144.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-08T20:16:54.447 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-08T20:16:54.447 INFO:teuthology.orchestra.run.smithi144.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:54.447 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-03-08T20:16:54.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-03-08T20:16:54.520 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-03-08T20:16:54.520 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 68.el9 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8264254 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-03-08T20:16:54.521 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:16:54.522 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-03-08T20:16:54.523 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-08T20:16:54.523 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:54.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-08T20:16:55.090 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-03-08T20:16:56.442 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-08T20:16:56.469 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-03-08T20:16:56.472 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-03-08T20:16:56.486 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.el0UASEdUC 2024-03-08T20:16:56.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.el0UASEdUC 2024-03-08T20:16:56.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.el0UASEdUC 2024-03-08T20:16:56.699 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.el0UASEdUC is 6KB 2024-03-08T20:16:56.747 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.el0UASEdUC 2024-03-08T20:16:56.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-03-08T20:16:56.826 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-08T20:16:56.826 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-08T20:16:56.826 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-08T20:16:56.826 INFO:teuthology.orchestra.run.smithi144.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-08T20:16:56.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:16:57.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-03-08T20:17:01.771 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-08T20:17:01.772 DEBUG:teuthology.orchestra.run.smithi118:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T20:17:01.845 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T20:17:01.846 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T20:17:01.847 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T20:17:01.848 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T20:17:01.849 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T20:17:01.850 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T20:17:01.851 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T20:17:01.851 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T20:17:01.851 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T20:17:01.853 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T20:17:01.853 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-08T20:17:01.853 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-08T20:17:01.853 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T20:17:01.854 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T20:17:01.855 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T20:17:01.856 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T20:17:01.857 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-08T20:17:01.858 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-08T20:17:01.859 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T20:17:01.860 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T20:17:01.861 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-08T20:17:01.862 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-08T20:17:01.863 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T20:17:01.864 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-08T20:17:01.865 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T20:17:01.866 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T20:17:01.867 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T20:17:01.868 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T20:17:01.869 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T20:17:01.870 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T20:17:01.871 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T20:17:01.872 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T20:17:01.873 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T20:17:01.874 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T20:17:01.875 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T20:17:01.876 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T20:17:01.877 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T20:17:01.878 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T20:17:01.879 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T20:17:01.880 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T20:17:01.881 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T20:17:01.882 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T20:17:01.883 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-08T20:17:01.884 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-08T20:17:01.885 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T20:17:01.886 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T20:17:01.887 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T20:17:01.888 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T20:17:01.889 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T20:17:01.890 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T20:17:01.891 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-08T20:17:01.892 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T20:17:01.893 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T20:17:01.894 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-08T20:17:01.895 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-08T20:17:01.896 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-08T20:17:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T20:17:01.898 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-08T20:17:01.899 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-08T20:17:01.900 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-08T20:17:01.901 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T20:17:01.902 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T20:17:01.903 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T20:17:01.904 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-08T20:17:01.905 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T20:17:01.906 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T20:17:01.907 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-08T20:17:01.908 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T20:17:01.909 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T20:17:01.910 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-08T20:17:01.911 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T20:17:01.912 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T20:17:01.913 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T20:17:01.914 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T20:17:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T20:17:01.916 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T20:17:01.917 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T20:17:01.918 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T20:17:01.919 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-08T20:17:01.920 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T20:17:01.921 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T20:17:01.922 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T20:17:01.923 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T20:17:01.924 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T20:17:01.925 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T20:17:01.926 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T20:17:01.927 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T20:17:01.928 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-08T20:17:01.929 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T20:17:01.930 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T20:17:01.931 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-08T20:17:01.932 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T20:17:01.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T20:17:01.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T20:17:01.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T20:17:01.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T20:17:01.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-08T20:17:01.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T20:17:01.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T20:17:01.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T20:17:01.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-08T20:17:01.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-08T20:17:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-08T20:17:01.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T20:17:01.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-08T20:17:01.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T20:17:01.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T20:17:01.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T20:17:01.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T20:17:01.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T20:17:01.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T20:17:01.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T20:17:01.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T20:17:01.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-08T20:17:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T20:17:01.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T20:17:01.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T20:17:01.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-08T20:17:01.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-08T20:17:01.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-08T20:17:01.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T20:17:01.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T20:17:01.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T20:17:01.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T20:17:01.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T20:17:01.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-08T20:17:01.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T20:17:01.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T20:17:01.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T20:17:01.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T20:17:01.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T20:17:01.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T20:17:01.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T20:17:01.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T20:17:01.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T20:17:01.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T20:17:01.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T20:17:01.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T20:17:01.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T20:17:01.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T20:17:01.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T20:17:01.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T20:17:01.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-08T20:17:01.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T20:17:01.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T20:17:01.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T20:17:01.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T20:17:01.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T20:17:01.989 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:01.990 DEBUG:teuthology.orchestra.run.smithi118:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout:postinstall scriptlet (using /bin/sh): 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout:for file in vmlinuz System.map config; do 2024-03-08T20:17:02.011 INFO:teuthology.orchestra.run.smithi118.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout: fi 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:done 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:02.012 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-08T20:17:02.013 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-03-08T20:17:02.086 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 68.el9 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8264254 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-08T20:17:02.087 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:17:02.088 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-03-08T20:17:02.089 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-08T20:17:02.089 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:02.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-08T20:17:02.677 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-03-08T20:17:04.146 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-08T20:17:04.178 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-03-08T20:17:04.180 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-03-08T20:17:04.194 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.Qzwbx5FWgQ 2024-03-08T20:17:04.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Qzwbx5FWgQ 2024-03-08T20:17:04.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.Qzwbx5FWgQ 2024-03-08T20:17:04.402 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.Qzwbx5FWgQ is 6KB 2024-03-08T20:17:04.450 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.Qzwbx5FWgQ 2024-03-08T20:17:04.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-03-08T20:17:04.528 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-08T20:17:04.529 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-08T20:17:04.529 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-08T20:17:04.529 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-08T20:17:04.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:17:04.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-03-08T20:17:27.036 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-08T20:17:27.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-08T20:17:27.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:17:34.688 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-08T20:17:34.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:17:34.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:18:09.311 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-03-08T20:18:18.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:18:18.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:18:27.048 DEBUG:teuthology.orchestra.remote:timed out 2024-03-08T20:18:36.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-08T20:18:36.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:18:38.564 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-03-08T20:18:39.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-08T20:18:39.162 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T20:18:39.162 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-03-08T20:18:39.203 INFO:teuthology.orchestra.run.smithi144.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:18:39.203 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:18:39.203 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T20:18:39.203 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-08T20:18:40.206 DEBUG:teuthology.parallel:result is None 2024-03-08T20:19:18.319 DEBUG:teuthology.orchestra.remote:timed out 2024-03-08T20:19:30.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:19:30.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:19:30.994 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-03-08T20:19:31.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:19:31.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T20:19:31.607 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-03-08T20:19:31.657 INFO:teuthology.orchestra.run.smithi118.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:19:31.657 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T20:19:31.658 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T20:19:31.658 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-08T20:19:32.659 DEBUG:teuthology.parallel:result is None 2024-03-08T20:19:32.659 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-08T20:19:32.667 INFO:teuthology.task.internal:Creating test directory... 2024-03-08T20:19:32.667 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T20:19:32.674 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T20:19:32.734 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-08T20:19:32.741 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-08T20:19:32.747 INFO:teuthology.task.internal:Creating archive directory... 2024-03-08T20:19:32.747 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T20:19:32.752 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T20:19:32.823 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-08T20:19:32.829 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-08T20:19:32.830 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T20:19:32.835 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T20:19:32.979 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T20:19:33.007 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T20:19:33.041 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T20:19:33.075 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T20:19:33.080 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-08T20:19:33.087 INFO:teuthology.task.internal:Configuring sudo... 2024-03-08T20:19:33.088 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T20:19:33.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T20:19:33.184 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-08T20:19:33.194 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-08T20:19:33.194 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T20:19:33.201 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T20:19:33.256 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T20:19:33.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T20:19:33.473 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T20:19:33.555 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T20:19:33.646 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:19:33.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T20:19:33.735 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T20:19:33.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T20:19:33.929 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T20:19:34.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T20:19:34.111 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:19:34.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T20:19:34.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-03-08T20:19:34.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-03-08T20:19:34.329 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T20:19:34.369 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T20:19:34.765 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-08T20:19:34.774 INFO:teuthology.task.internal:Starting timer... 2024-03-08T20:19:34.774 INFO:teuthology.run_tasks:Running task pcp... 2024-03-08T20:19:34.792 INFO:teuthology.run_tasks:Running task selinux... 2024-03-08T20:19:34.805 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-08T20:19:34.806 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-03-08T20:19:34.921 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-03-08T20:19:34.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-03-08T20:19:35.051 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-03-08T20:19:35.056 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-08T20:19:35.056 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-03-08T20:19:35.108 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-03-08T20:19:35.109 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-03-08T20:19:35.167 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-03-08T20:19:35.167 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi118.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2024-03-08T20:19:35.168 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-08T20:19:35.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:19:35.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-08T20:19:35.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:19:35.339 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-08T20:19:35.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-03-08T20:19:35.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-03-08T20:19:35.537 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-08T20:19:35.551 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-08T20:19:35.571 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-08T20:19:35.572 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-08T20:25:34.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-03-08T20:25:34.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:25:34.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:25:35.131 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-03-08T20:25:35.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-08T20:25:35.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-08T20:25:35.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T20:25:35.430 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-03-08T20:25:35.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-03-08T20:25:35.585 INFO:teuthology.run_tasks:Running task clock... 2024-03-08T20:25:35.597 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-08T20:25:35.597 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T20:25:35.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T20:25:35.605 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T20:25:35.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T20:25:35.701 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-08T20:25:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-08T20:25:35.752 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-08T20:25:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-08T20:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-03-08T20:25:35.847 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-03-08T20:25:35.884 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-03-08T20:25:35.889 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-03-08T20:25:35.935 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-08T20:25:35.942 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-08T20:25:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-08T20:25:35.994 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-08T20:25:36.109 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-03-08T20:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.118 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:25:36.123 INFO:teuthology.run_tasks:Running task install... 2024-03-08T20:25:36.132 DEBUG:teuthology.task.install:project ceph 2024-03-08T20:25:36.132 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}} 2024-03-08T20:25:36.132 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'} 2024-03-08T20:25:36.132 INFO:teuthology.task.install:Using flavor: default 2024-03-08T20:25:36.138 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-08T20:25:36.138 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-08T20:25:36.138 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'tag': None, 'wait_for_package': False} 2024-03-08T20:25:36.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:25:36.141 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'tag': None, 'wait_for_package': False} 2024-03-08T20:25:36.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:25:36.291 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/ 2024-03-08T20:25:36.291 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1965.g7d63482a 2024-03-08T20:25:36.293 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/ 2024-03-08T20:25:36.293 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1965.g7d63482a 2024-03-08T20:25:36.418 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-08T20:25:36.419 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:25:36.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-08T20:25:36.422 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-08T20:25:36.423 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:25:36.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-08T20:25:36.518 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-08T20:25:36.518 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7d63482aa89628d733e298984a762389b625c761/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-08T20:25:36.521 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-08T20:25:36.521 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7d63482aa89628d733e298984a762389b625c761/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-08T20:25:36.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-08T20:25:36.661 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-08T20:25:36.784 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-08T20:25:36.792 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-08T20:25:36.871 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-03-08T20:25:36.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-03-08T20:25:36.884 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-03-08T20:25:36.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-03-08T20:25:37.220 INFO:teuthology.orchestra.run.smithi144.stdout:74 files removed 2024-03-08T20:25:37.241 INFO:teuthology.orchestra.run.smithi118.stdout:74 files removed 2024-03-08T20:25:37.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-08T20:25:37.284 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-08T20:25:38.285 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 157 kB/s | 82 kB 00:00 2024-03-08T20:25:38.330 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 149 kB/s | 82 kB 00:00 2024-03-08T20:25:38.810 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-03-08T20:25:38.839 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-08T20:25:39.356 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-03-08T20:25:39.361 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-03-08T20:25:40.015 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-08T20:25:40.081 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-03-08T20:25:41.748 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-08T20:25:41.802 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-03-08T20:25:43.777 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.0 MB 00:01 2024-03-08T20:25:44.198 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.0 MB 00:01 2024-03-08T20:25:47.149 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-08T20:25:52.658 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.1 MB 00:01 2024-03-08T20:25:53.219 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-03-08T20:25:55.450 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2024-03-08T20:25:56.860 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-08T20:25:57.561 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-08T20:25:59.070 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 15 kB 00:00 2024-03-08T20:26:01.180 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-08T20:26:02.602 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-08T20:26:05.319 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T20:26:05.320 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T20:26:05.343 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-08T20:26:05.345 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-08T20:26:05.346 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-08T20:26:05.348 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-08T20:26:05.350 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-08T20:26:05.354 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-08T20:26:05.356 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-08T20:26:05.445 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-03-08T20:26:05.473 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 6.6 k 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 5.4 M 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 889 k 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 145 k 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 1.5 M 2024-03-08T20:26:05.474 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 139 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 1.8 M 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 7.4 M 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 49 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 9.8 M 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 47 M 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 264 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 748 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 220 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 27 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 18 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-08T20:26:05.475 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 31 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 745 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 127 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 162 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 320 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 298 k 2024-03-08T20:26:05.476 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 99 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 85 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.1 M 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 171 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-08T20:26:05.477 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.4 M 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.1 M 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-08T20:26:05.478 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 20 M 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 34 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 2.1 M 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 248 k 2024-03-08T20:26:05.479 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 4.7 M 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 17 M 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 16 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 25 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 163 k 2024-03-08T20:26:05.480 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 501 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 5.1 M 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-08T20:26:05.481 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-08T20:26:05.482 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 45 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 131 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-08T20:26:05.483 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-08T20:26:05.484 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-08T20:26:05.485 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-08T20:26:05.486 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-03-08T20:26:05.487 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:Install 150 Packages 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 24 Packages 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 223 M 2024-03-08T20:26:05.488 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-03-08T20:26:06.662 INFO:teuthology.orchestra.run.smithi118.stdout:(1/174): ceph-19.0.0-1965.g7d63482a.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-03-08T20:26:06.897 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-08T20:26:06.970 INFO:teuthology.orchestra.run.smithi118.stdout:(2/174): ceph-fuse-19.0.0-1965.g7d63482a.el9.x8 2.8 MB/s | 889 kB 00:00 2024-03-08T20:26:07.012 INFO:teuthology.orchestra.run.smithi118.stdout:(3/174): ceph-immutable-object-cache-19.0.0-196 3.5 MB/s | 145 kB 00:00 2024-03-08T20:26:07.313 INFO:teuthology.orchestra.run.smithi118.stdout:(4/174): ceph-mds-19.0.0-1965.g7d63482a.el9.x86 7.1 MB/s | 2.1 MB 00:00 2024-03-08T20:26:07.496 INFO:teuthology.orchestra.run.smithi118.stdout:(5/174): ceph-mgr-19.0.0-1965.g7d63482a.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-03-08T20:26:07.863 INFO:teuthology.orchestra.run.smithi118.stdout:(6/174): ceph-mon-19.0.0-1965.g7d63482a.el9.x86 13 MB/s | 4.7 MB 00:00 2024-03-08T20:26:08.322 INFO:teuthology.orchestra.run.smithi118.stdout:(7/174): ceph-base-19.0.0-1965.g7d63482a.el9.x8 2.7 MB/s | 5.4 MB 00:01 2024-03-08T20:26:09.089 INFO:teuthology.orchestra.run.smithi118.stdout:(8/174): ceph-osd-19.0.0-1965.g7d63482a.el9.x86 14 MB/s | 17 MB 00:01 2024-03-08T20:26:09.181 INFO:teuthology.orchestra.run.smithi118.stdout:(9/174): ceph-selinux-19.0.0-1965.g7d63482a.el9 278 kB/s | 25 kB 00:00 2024-03-08T20:26:09.621 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T20:26:09.623 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T20:26:09.646 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-08T20:26:09.647 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-08T20:26:09.649 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-08T20:26:09.650 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-08T20:26:09.653 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-08T20:26:09.656 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-08T20:26:09.658 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-08T20:26:09.745 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 6.6 k 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 5.4 M 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 889 k 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 145 k 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 1.5 M 2024-03-08T20:26:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 139 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 1.8 M 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 7.4 M 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 49 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 9.8 M 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 47 M 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 264 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 748 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 220 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 27 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 18 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-08T20:26:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 31 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 745 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 127 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 162 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 320 k 2024-03-08T20:26:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 298 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 99 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 85 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.1 M 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 171 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-08T20:26:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.4 M 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 3.1 M 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-08T20:26:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-08T20:26:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 20 M 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 34 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 2.1 M 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 248 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 4.7 M 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 17 M 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1965.g7d63482a.el9 ceph-noarch 16 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 25 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-08T20:26:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 163 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-08T20:26:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 501 k 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 5.1 M 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-08T20:26:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-08T20:26:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 45 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.0.0-1965.g7d63482a.el9 ceph 131 k 2024-03-08T20:26:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-08T20:26:09.773 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-08T20:26:09.774 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-08T20:26:09.775 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-08T20:26:09.776 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-08T20:26:09.777 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================ 2024-03-08T20:26:09.778 INFO:teuthology.orchestra.run.smithi144.stdout:Install 150 Packages 2024-03-08T20:26:09.779 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 24 Packages 2024-03-08T20:26:09.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:26:09.779 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 223 M 2024-03-08T20:26:09.779 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-03-08T20:26:09.881 INFO:teuthology.orchestra.run.smithi118.stdout:(10/174): ceph-common-19.0.0-1965.g7d63482a.el9 5.7 MB/s | 20 MB 00:03 2024-03-08T20:26:10.065 INFO:teuthology.orchestra.run.smithi118.stdout:(11/174): ceph-radosgw-19.0.0-1965.g7d63482a.el 5.6 MB/s | 9.8 MB 00:01 2024-03-08T20:26:10.098 INFO:teuthology.orchestra.run.smithi118.stdout:(12/174): cephfs-mirror-19.0.0-1965.g7d63482a.e 1.0 MB/s | 220 kB 00:00 2024-03-08T20:26:10.140 INFO:teuthology.orchestra.run.smithi118.stdout:(13/174): cephfs-shell-19.0.0-1965.g7d63482a.el 364 kB/s | 27 kB 00:00 2024-03-08T20:26:10.165 INFO:teuthology.orchestra.run.smithi118.stdout:(14/174): libcephfs-devel-19.0.0-1965.g7d63482a 470 kB/s | 31 kB 00:00 2024-03-08T20:26:10.274 INFO:teuthology.orchestra.run.smithi118.stdout:(15/174): libcephsqlite-19.0.0-1965.g7d63482a.e 1.5 MB/s | 163 kB 00:00 2024-03-08T20:26:10.316 INFO:teuthology.orchestra.run.smithi118.stdout:(16/174): libcephfs2-19.0.0-1965.g7d63482a.el9. 4.2 MB/s | 745 kB 00:00 2024-03-08T20:26:10.341 INFO:teuthology.orchestra.run.smithi118.stdout:(17/174): librados-devel-19.0.0-1965.g7d63482a. 1.9 MB/s | 127 kB 00:00 2024-03-08T20:26:10.450 INFO:teuthology.orchestra.run.smithi118.stdout:(18/174): libradosstriper1-19.0.0-1965.g7d63482 3.7 MB/s | 501 kB 00:00 2024-03-08T20:26:10.550 INFO:teuthology.orchestra.run.smithi118.stdout:(19/174): python3-ceph-argparse-19.0.0-1965.g7d 455 kB/s | 45 kB 00:00 2024-03-08T20:26:10.756 INFO:teuthology.orchestra.run.smithi144.stdout:(1/174): ceph-19.0.0-1965.g7d63482a.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-03-08T20:26:10.817 INFO:teuthology.orchestra.run.smithi118.stdout:(20/174): python3-ceph-common-19.0.0-1965.g7d63 493 kB/s | 131 kB 00:00 2024-03-08T20:26:10.951 INFO:teuthology.orchestra.run.smithi118.stdout:(21/174): python3-cephfs-19.0.0-1965.g7d63482a. 1.2 MB/s | 162 kB 00:00 2024-03-08T20:26:11.109 INFO:teuthology.orchestra.run.smithi118.stdout:(22/174): librgw2-19.0.0-1965.g7d63482a.el9.x86 6.7 MB/s | 5.1 MB 00:00 2024-03-08T20:26:11.143 INFO:teuthology.orchestra.run.smithi118.stdout:(23/174): python3-rados-19.0.0-1965.g7d63482a.e 1.6 MB/s | 320 kB 00:00 2024-03-08T20:26:11.243 INFO:teuthology.orchestra.run.smithi118.stdout:(24/174): python3-rbd-19.0.0-1965.g7d63482a.el9 2.2 MB/s | 298 kB 00:00 2024-03-08T20:26:11.268 INFO:teuthology.orchestra.run.smithi118.stdout:(25/174): python3-rgw-19.0.0-1965.g7d63482a.el9 796 kB/s | 99 kB 00:00 2024-03-08T20:26:11.335 INFO:teuthology.orchestra.run.smithi118.stdout:(26/174): rbd-fuse-19.0.0-1965.g7d63482a.el9.x8 937 kB/s | 85 kB 00:00 2024-03-08T20:26:11.348 INFO:teuthology.orchestra.run.smithi144.stdout:(2/174): ceph-base-19.0.0-1965.g7d63482a.el9.x8 5.0 MB/s | 5.4 MB 00:01 2024-03-08T20:26:11.423 INFO:teuthology.orchestra.run.smithi144.stdout:(3/174): ceph-immutable-object-cache-19.0.0-196 1.9 MB/s | 145 kB 00:00 2024-03-08T20:26:11.469 INFO:teuthology.orchestra.run.smithi118.stdout:(27/174): rbd-nbd-19.0.0-1965.g7d63482a.el9.x86 1.3 MB/s | 171 kB 00:00 2024-03-08T20:26:11.611 INFO:teuthology.orchestra.run.smithi118.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1965.g 240 kB/s | 34 kB 00:00 2024-03-08T20:26:11.691 INFO:teuthology.orchestra.run.smithi144.stdout:(4/174): ceph-mds-19.0.0-1965.g7d63482a.el9.x86 8.0 MB/s | 2.1 MB 00:00 2024-03-08T20:26:11.712 INFO:teuthology.orchestra.run.smithi118.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1965.g7d63482 1.4 MB/s | 139 kB 00:00 2024-03-08T20:26:11.899 INFO:teuthology.orchestra.run.smithi144.stdout:(5/174): ceph-fuse-19.0.0-1965.g7d63482a.el9.x8 779 kB/s | 889 kB 00:01 2024-03-08T20:26:11.957 INFO:teuthology.orchestra.run.smithi144.stdout:(6/174): ceph-mgr-19.0.0-1965.g7d63482a.el9.x86 5.6 MB/s | 1.5 MB 00:00 2024-03-08T20:26:12.145 INFO:teuthology.orchestra.run.smithi118.stdout:(30/174): rbd-mirror-19.0.0-1965.g7d63482a.el9. 3.5 MB/s | 3.1 MB 00:00 2024-03-08T20:26:12.712 INFO:teuthology.orchestra.run.smithi118.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1965.g7d634 1.8 MB/s | 1.8 MB 00:00 2024-03-08T20:26:13.004 INFO:teuthology.orchestra.run.smithi118.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1965.g7d 853 kB/s | 248 kB 00:00 2024-03-08T20:26:13.113 INFO:teuthology.orchestra.run.smithi118.stdout:(33/174): ceph-mgr-rook-19.0.0-1965.g7d63482a.e 459 kB/s | 49 kB 00:00 2024-03-08T20:26:13.230 INFO:teuthology.orchestra.run.smithi118.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1965.g7 142 kB/s | 16 kB 00:00 2024-03-08T20:26:13.447 INFO:teuthology.orchestra.run.smithi118.stdout:(35/174): ceph-volume-19.0.0-1965.g7d63482a.el9 1.2 MB/s | 264 kB 00:00 2024-03-08T20:26:13.947 INFO:teuthology.orchestra.run.smithi118.stdout:(36/174): cephadm-19.0.0-1965.g7d63482a.el9.noa 1.5 MB/s | 748 kB 00:00 2024-03-08T20:26:14.056 INFO:teuthology.orchestra.run.smithi118.stdout:(37/174): cephfs-top-19.0.0-1965.g7d63482a.el9. 170 kB/s | 18 kB 00:00 2024-03-08T20:26:14.099 INFO:teuthology.orchestra.run.smithi144.stdout:(7/174): ceph-osd-19.0.0-1965.g7d63482a.el9.x86 7.9 MB/s | 17 MB 00:02 2024-03-08T20:26:14.248 INFO:teuthology.orchestra.run.smithi118.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-03-08T20:26:14.899 INFO:teuthology.orchestra.run.smithi144.stdout:(8/174): ceph-common-19.0.0-1965.g7d63482a.el9. 4.3 MB/s | 20 MB 00:04 2024-03-08T20:26:14.949 INFO:teuthology.orchestra.run.smithi144.stdout:(9/174): ceph-selinux-19.0.0-1965.g7d63482a.el9 516 kB/s | 25 kB 00:00 2024-03-08T20:26:15.258 INFO:teuthology.orchestra.run.smithi144.stdout:(10/174): ceph-radosgw-19.0.0-1965.g7d63482a.el 8.5 MB/s | 9.8 MB 00:01 2024-03-08T20:26:15.333 INFO:teuthology.orchestra.run.smithi144.stdout:(11/174): cephfs-mirror-19.0.0-1965.g7d63482a.e 2.9 MB/s | 220 kB 00:00 2024-03-08T20:26:15.400 INFO:teuthology.orchestra.run.smithi144.stdout:(12/174): cephfs-shell-19.0.0-1965.g7d63482a.el 411 kB/s | 27 kB 00:00 2024-03-08T20:26:15.484 INFO:teuthology.orchestra.run.smithi144.stdout:(13/174): libcephfs-devel-19.0.0-1965.g7d63482a 378 kB/s | 31 kB 00:00 2024-03-08T20:26:15.598 INFO:teuthology.orchestra.run.smithi118.stdout:(39/174): ceph-test-19.0.0-1965.g7d63482a.el9.x 7.4 MB/s | 47 MB 00:06 2024-03-08T20:26:15.648 INFO:teuthology.orchestra.run.smithi118.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 658 kB/s | 920 kB 00:01 2024-03-08T20:26:15.674 INFO:teuthology.orchestra.run.smithi118.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-08T20:26:15.684 INFO:teuthology.orchestra.run.smithi144.stdout:(14/174): libcephfs2-19.0.0-1965.g7d63482a.el9. 3.7 MB/s | 745 kB 00:00 2024-03-08T20:26:15.707 INFO:teuthology.orchestra.run.smithi118.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-08T20:26:15.732 INFO:teuthology.orchestra.run.smithi118.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 572 kB/s | 32 kB 00:00 2024-03-08T20:26:15.768 INFO:teuthology.orchestra.run.smithi144.stdout:(15/174): libcephsqlite-19.0.0-1965.g7d63482a.e 1.9 MB/s | 163 kB 00:00 2024-03-08T20:26:15.833 INFO:teuthology.orchestra.run.smithi118.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-08T20:26:15.843 INFO:teuthology.orchestra.run.smithi144.stdout:(16/174): librados-devel-19.0.0-1965.g7d63482a. 1.7 MB/s | 127 kB 00:00 2024-03-08T20:26:15.858 INFO:teuthology.orchestra.run.smithi118.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 152 kB/s | 17 kB 00:00 2024-03-08T20:26:15.875 INFO:teuthology.orchestra.run.smithi118.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 245 kB/s | 10 kB 00:00 2024-03-08T20:26:15.892 INFO:teuthology.orchestra.run.smithi118.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.8 MB/s | 159 kB 00:00 2024-03-08T20:26:15.909 INFO:teuthology.orchestra.run.smithi118.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.4 MB/s | 44 kB 00:00 2024-03-08T20:26:15.935 INFO:teuthology.orchestra.run.smithi144.stdout:(17/174): libradosstriper1-19.0.0-1965.g7d63482 5.4 MB/s | 501 kB 00:00 2024-03-08T20:26:15.951 INFO:teuthology.orchestra.run.smithi118.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-08T20:26:15.993 INFO:teuthology.orchestra.run.smithi118.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-08T20:26:16.010 INFO:teuthology.orchestra.run.smithi118.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 872 kB/s | 46 kB 00:00 2024-03-08T20:26:16.043 INFO:teuthology.orchestra.run.smithi118.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-03-08T20:26:16.068 INFO:teuthology.orchestra.run.smithi144.stdout:(18/174): ceph-mon-19.0.0-1965.g7d63482a.el9.x8 1.1 MB/s | 4.7 MB 00:04 2024-03-08T20:26:16.085 INFO:teuthology.orchestra.run.smithi118.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2024-03-08T20:26:16.119 INFO:teuthology.orchestra.run.smithi118.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-03-08T20:26:16.144 INFO:teuthology.orchestra.run.smithi118.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 34 kB 00:00 2024-03-08T20:26:16.186 INFO:teuthology.orchestra.run.smithi144.stdout:(19/174): python3-ceph-argparse-19.0.0-1965.g7d 390 kB/s | 45 kB 00:00 2024-03-08T20:26:16.369 INFO:teuthology.orchestra.run.smithi144.stdout:(20/174): python3-ceph-common-19.0.0-1965.g7d63 719 kB/s | 131 kB 00:00 2024-03-08T20:26:16.370 INFO:teuthology.orchestra.run.smithi118.stdout:(56/174): ceph-mgr-diskprediction-local-19.0.0- 1.8 MB/s | 7.4 MB 00:04 2024-03-08T20:26:16.495 INFO:teuthology.orchestra.run.smithi118.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-03-08T20:26:16.545 INFO:teuthology.orchestra.run.smithi118.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 3.9 MB/s | 1.5 MB 00:00 2024-03-08T20:26:16.579 INFO:teuthology.orchestra.run.smithi118.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 4.1 MB/s | 811 kB 00:00 2024-03-08T20:26:16.604 INFO:teuthology.orchestra.run.smithi118.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-03-08T20:26:16.644 INFO:teuthology.orchestra.run.smithi144.stdout:(21/174): librgw2-19.0.0-1965.g7d63482a.el9.x86 7.2 MB/s | 5.1 MB 00:00 2024-03-08T20:26:16.680 INFO:teuthology.orchestra.run.smithi118.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-03-08T20:26:16.686 INFO:teuthology.orchestra.run.smithi144.stdout:(22/174): python3-cephfs-19.0.0-1965.g7d63482a. 512 kB/s | 162 kB 00:00 2024-03-08T20:26:16.758 INFO:teuthology.orchestra.run.smithi144.stdout:(23/174): python3-rados-19.0.0-1965.g7d63482a.e 2.8 MB/s | 320 kB 00:00 2024-03-08T20:26:16.814 INFO:teuthology.orchestra.run.smithi144.stdout:(24/174): python3-rgw-19.0.0-1965.g7d63482a.el9 1.8 MB/s | 99 kB 00:00 2024-03-08T20:26:16.838 INFO:teuthology.orchestra.run.smithi118.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-03-08T20:26:16.862 INFO:teuthology.orchestra.run.smithi144.stdout:(25/174): rbd-fuse-19.0.0-1965.g7d63482a.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-08T20:26:16.880 INFO:teuthology.orchestra.run.smithi118.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 283 kB/s | 78 kB 00:00 2024-03-08T20:26:17.004 INFO:teuthology.orchestra.run.smithi144.stdout:(26/174): python3-rbd-19.0.0-1965.g7d63482a.el9 942 kB/s | 298 kB 00:00 2024-03-08T20:26:17.005 INFO:teuthology.orchestra.run.smithi118.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-03-08T20:26:17.030 INFO:teuthology.orchestra.run.smithi118.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 137 kB/s | 24 kB 00:00 2024-03-08T20:26:17.055 INFO:teuthology.orchestra.run.smithi118.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 112 kB/s | 18 kB 00:00 2024-03-08T20:26:17.106 INFO:teuthology.orchestra.run.smithi118.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 652 kB/s | 32 kB 00:00 2024-03-08T20:26:17.148 INFO:teuthology.orchestra.run.smithi118.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2024-03-08T20:26:17.254 INFO:teuthology.orchestra.run.smithi144.stdout:(27/174): rbd-nbd-19.0.0-1965.g7d63482a.el9.x86 685 kB/s | 171 kB 00:00 2024-03-08T20:26:17.338 INFO:teuthology.orchestra.run.smithi144.stdout:(28/174): rbd-mirror-19.0.0-1965.g7d63482a.el9. 6.5 MB/s | 3.1 MB 00:00 2024-03-08T20:26:17.340 INFO:teuthology.orchestra.run.smithi118.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-03-08T20:26:17.356 INFO:teuthology.orchestra.run.smithi118.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 894 kB/s | 174 kB 00:00 2024-03-08T20:26:17.363 INFO:teuthology.orchestra.run.smithi144.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1965.g 315 kB/s | 34 kB 00:00 2024-03-08T20:26:17.390 INFO:teuthology.orchestra.run.smithi118.stdout:(71/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 813 kB/s | 217 kB 00:00 2024-03-08T20:26:17.413 INFO:teuthology.orchestra.run.smithi144.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1965.g7d63482 1.8 MB/s | 139 kB 00:00 2024-03-08T20:26:17.499 INFO:teuthology.orchestra.run.smithi118.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 493 kB/s | 69 kB 00:00 2024-03-08T20:26:17.524 INFO:teuthology.orchestra.run.smithi118.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 250 kB/s | 41 kB 00:00 2024-03-08T20:26:17.549 INFO:teuthology.orchestra.run.smithi118.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 238 kB 00:00 2024-03-08T20:26:17.575 INFO:teuthology.orchestra.run.smithi118.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2024-03-08T20:26:17.634 INFO:teuthology.orchestra.run.smithi118.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 583 kB/s | 47 kB 00:00 2024-03-08T20:26:17.667 INFO:teuthology.orchestra.run.smithi118.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 211 kB 00:00 2024-03-08T20:26:17.692 INFO:teuthology.orchestra.run.smithi118.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 366 kB/s | 43 kB 00:00 2024-03-08T20:26:18.081 INFO:teuthology.orchestra.run.smithi144.stdout:(31/174): ceph-test-19.0.0-1965.g7d63482a.el9.x 15 MB/s | 47 MB 00:03 2024-03-08T20:26:18.109 INFO:teuthology.orchestra.run.smithi118.stdout:(79/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 101 kB/s | 41 kB 00:00 2024-03-08T20:26:18.134 INFO:teuthology.orchestra.run.smithi118.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 89 kB/s | 39 kB 00:00 2024-03-08T20:26:18.139 INFO:teuthology.orchestra.run.smithi144.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1965.g7d 4.2 MB/s | 248 kB 00:00 2024-03-08T20:26:18.198 INFO:teuthology.orchestra.run.smithi144.stdout:(33/174): ceph-mgr-rook-19.0.0-1965.g7d63482a.e 861 kB/s | 49 kB 00:00 2024-03-08T20:26:18.250 INFO:teuthology.orchestra.run.smithi144.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1965.g7 335 kB/s | 16 kB 00:00 2024-03-08T20:26:18.390 INFO:teuthology.orchestra.run.smithi144.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-03-08T20:26:18.393 INFO:teuthology.orchestra.run.smithi118.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-08T20:26:18.418 INFO:teuthology.orchestra.run.smithi118.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 974 kB/s | 300 kB 00:00 2024-03-08T20:26:18.423 INFO:teuthology.orchestra.run.smithi144.stdout:(36/174): ceph-volume-19.0.0-1965.g7d63482a.el9 1.5 MB/s | 264 kB 00:00 2024-03-08T20:26:18.444 INFO:teuthology.orchestra.run.smithi118.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 188 kB/s | 56 kB 00:00 2024-03-08T20:26:18.469 INFO:teuthology.orchestra.run.smithi118.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 911 kB/s | 44 kB 00:00 2024-03-08T20:26:18.473 INFO:teuthology.orchestra.run.smithi144.stdout:(37/174): cephfs-top-19.0.0-1965.g7d63482a.el9. 373 kB/s | 18 kB 00:00 2024-03-08T20:26:18.486 INFO:teuthology.orchestra.run.smithi118.stdout:(85/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 63 kB 00:00 2024-03-08T20:26:18.507 INFO:teuthology.orchestra.run.smithi144.stdout:(38/174): cephadm-19.0.0-1965.g7d63482a.el9.noa 6.3 MB/s | 748 kB 00:00 2024-03-08T20:26:18.511 INFO:teuthology.orchestra.run.smithi118.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2024-03-08T20:26:18.536 INFO:teuthology.orchestra.run.smithi118.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-08T20:26:18.587 INFO:teuthology.orchestra.run.smithi118.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-08T20:26:18.679 INFO:teuthology.orchestra.run.smithi118.stdout:(89/174): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.1 MB 00:00 2024-03-08T20:26:18.704 INFO:teuthology.orchestra.run.smithi118.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 744 kB/s | 124 kB 00:00 2024-03-08T20:26:18.729 INFO:teuthology.orchestra.run.smithi118.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 187 kB 00:00 2024-03-08T20:26:18.883 INFO:teuthology.orchestra.run.smithi144.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2024-03-08T20:26:18.913 INFO:teuthology.orchestra.run.smithi118.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-03-08T20:26:18.933 INFO:teuthology.orchestra.run.smithi144.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 920 kB 00:00 2024-03-08T20:26:18.946 INFO:teuthology.orchestra.run.smithi118.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 908 kB/s | 195 kB 00:00 2024-03-08T20:26:18.950 INFO:teuthology.orchestra.run.smithi144.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-08T20:26:18.980 INFO:teuthology.orchestra.run.smithi118.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-08T20:26:18.983 INFO:teuthology.orchestra.run.smithi144.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.2 MB/s | 307 kB 00:00 2024-03-08T20:26:19.000 INFO:teuthology.orchestra.run.smithi144.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 673 kB/s | 32 kB 00:00 2024-03-08T20:26:19.022 INFO:teuthology.orchestra.run.smithi118.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-03-08T20:26:19.126 INFO:teuthology.orchestra.run.smithi144.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-03-08T20:26:19.142 INFO:teuthology.orchestra.run.smithi144.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 123 kB/s | 17 kB 00:00 2024-03-08T20:26:19.159 INFO:teuthology.orchestra.run.smithi144.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 309 kB/s | 10 kB 00:00 2024-03-08T20:26:19.193 INFO:teuthology.orchestra.run.smithi144.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-03-08T20:26:19.219 INFO:teuthology.orchestra.run.smithi144.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 790 kB/s | 44 kB 00:00 2024-03-08T20:26:19.277 INFO:teuthology.orchestra.run.smithi144.stdout:(49/174): ceph-mgr-dashboard-19.0.0-1965.g7d634 960 kB/s | 1.8 MB 00:01 2024-03-08T20:26:19.310 INFO:teuthology.orchestra.run.smithi144.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 661 kB 00:00 2024-03-08T20:26:19.352 INFO:teuthology.orchestra.run.smithi144.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 4.4 MB/s | 578 kB 00:00 2024-03-08T20:26:19.378 INFO:teuthology.orchestra.run.smithi144.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 758 kB/s | 46 kB 00:00 2024-03-08T20:26:19.403 INFO:teuthology.orchestra.run.smithi144.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 282 kB 00:00 2024-03-08T20:26:19.445 INFO:teuthology.orchestra.run.smithi144.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-03-08T20:26:19.470 INFO:teuthology.orchestra.run.smithi144.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 530 kB/s | 34 kB 00:00 2024-03-08T20:26:19.512 INFO:teuthology.orchestra.run.smithi144.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2024-03-08T20:26:19.630 INFO:teuthology.orchestra.run.smithi118.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 31 kB/s | 21 kB 00:00 2024-03-08T20:26:19.637 INFO:teuthology.orchestra.run.smithi144.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-03-08T20:26:19.688 INFO:teuthology.orchestra.run.smithi144.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2024-03-08T20:26:19.697 INFO:teuthology.orchestra.run.smithi118.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 35 kB/s | 25 kB 00:00 2024-03-08T20:26:19.721 INFO:teuthology.orchestra.run.smithi144.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 4.1 MB/s | 811 kB 00:00 2024-03-08T20:26:19.738 INFO:teuthology.orchestra.run.smithi144.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2024-03-08T20:26:19.872 INFO:teuthology.orchestra.run.smithi144.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-08T20:26:19.980 INFO:teuthology.orchestra.run.smithi144.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2024-03-08T20:26:20.005 INFO:teuthology.orchestra.run.smithi144.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 297 kB/s | 78 kB 00:00 2024-03-08T20:26:20.180 INFO:teuthology.orchestra.run.smithi144.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-03-08T20:26:20.206 INFO:teuthology.orchestra.run.smithi144.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 131 kB/s | 24 kB 00:00 2024-03-08T20:26:20.230 INFO:teuthology.orchestra.run.smithi144.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 86 kB/s | 18 kB 00:00 2024-03-08T20:26:20.273 INFO:teuthology.orchestra.run.smithi144.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 787 kB/s | 32 kB 00:00 2024-03-08T20:26:20.315 INFO:teuthology.orchestra.run.smithi144.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2024-03-08T20:26:20.440 INFO:teuthology.orchestra.run.smithi144.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-03-08T20:26:20.465 INFO:teuthology.orchestra.run.smithi144.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-08T20:26:20.490 INFO:teuthology.orchestra.run.smithi144.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-08T20:26:20.532 INFO:teuthology.orchestra.run.smithi144.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.7 MB/s | 69 kB 00:00 2024-03-08T20:26:20.557 INFO:teuthology.orchestra.run.smithi144.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 629 kB/s | 41 kB 00:00 2024-03-08T20:26:20.648 INFO:teuthology.orchestra.run.smithi118.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 242 kB/s | 245 kB 00:01 2024-03-08T20:26:20.683 INFO:teuthology.orchestra.run.smithi144.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 1.2 MB/s | 238 kB 00:00 2024-03-08T20:26:20.708 INFO:teuthology.orchestra.run.smithi144.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 767 kB/s | 132 kB 00:00 2024-03-08T20:26:20.733 INFO:teuthology.orchestra.run.smithi144.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 991 kB/s | 47 kB 00:00 2024-03-08T20:26:20.765 INFO:teuthology.orchestra.run.smithi118.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 233 kB/s | 248 kB 00:01 2024-03-08T20:26:20.767 INFO:teuthology.orchestra.run.smithi144.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-03-08T20:26:20.792 INFO:teuthology.orchestra.run.smithi144.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 520 kB/s | 43 kB 00:00 2024-03-08T20:26:21.228 INFO:teuthology.orchestra.run.smithi144.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-08T20:26:21.251 INFO:teuthology.orchestra.run.smithi144.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 87 kB/s | 39 kB 00:00 2024-03-08T20:26:21.276 INFO:teuthology.orchestra.run.smithi144.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 87 kB/s | 41 kB 00:00 2024-03-08T20:26:21.310 INFO:teuthology.orchestra.run.smithi144.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.7 MB/s | 300 kB 00:00 2024-03-08T20:26:21.335 INFO:teuthology.orchestra.run.smithi144.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-08T20:26:21.360 INFO:teuthology.orchestra.run.smithi144.stdout:(84/174): uuid-1.6.2-55.el9.x86_64.rpm 702 kB/s | 56 kB 00:00 2024-03-08T20:26:21.385 INFO:teuthology.orchestra.run.smithi144.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 592 kB/s | 44 kB 00:00 2024-03-08T20:26:21.411 INFO:teuthology.orchestra.run.smithi144.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-08T20:26:21.444 INFO:teuthology.orchestra.run.smithi144.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-08T20:26:21.495 INFO:teuthology.orchestra.run.smithi144.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-08T20:26:21.524 INFO:teuthology.orchestra.run.smithi144.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 953 kB/s | 103 kB 00:00 2024-03-08T20:26:21.540 INFO:teuthology.orchestra.run.smithi118.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 45 kB/s | 35 kB 00:00 2024-03-08T20:26:21.545 INFO:teuthology.orchestra.run.smithi144.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-08T20:26:21.579 INFO:teuthology.orchestra.run.smithi144.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-08T20:26:21.790 INFO:teuthology.orchestra.run.smithi118.stdout:(101/174): qatlib-23.11.0-1.el9.x86_64.rpm 190 kB/s | 216 kB 00:01 2024-03-08T20:26:22.349 INFO:teuthology.orchestra.run.smithi118.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 55 kB/s | 44 kB 00:00 2024-03-08T20:26:22.440 INFO:teuthology.orchestra.run.smithi118.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 247 kB/s | 22 kB 00:00 2024-03-08T20:26:22.654 INFO:teuthology.orchestra.run.smithi144.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 165 kB/s | 187 kB 00:01 2024-03-08T20:26:22.699 INFO:teuthology.orchestra.run.smithi118.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-03-08T20:26:22.854 INFO:teuthology.orchestra.run.smithi144.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 153 kB/s | 195 kB 00:01 2024-03-08T20:26:22.883 INFO:teuthology.orchestra.run.smithi118.stdout:(105/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 86 kB/s | 94 kB 00:01 2024-03-08T20:26:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 263 kB/s | 21 kB 00:00 2024-03-08T20:26:23.046 INFO:teuthology.orchestra.run.smithi144.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 661 kB/s | 25 kB 00:00 2024-03-08T20:26:23.200 INFO:teuthology.orchestra.run.smithi118.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 986 kB/s | 309 kB 00:00 2024-03-08T20:26:23.233 INFO:teuthology.orchestra.run.smithi118.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-03-08T20:26:23.259 INFO:teuthology.orchestra.run.smithi118.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 337 kB/s | 19 kB 00:00 2024-03-08T20:26:23.309 INFO:teuthology.orchestra.run.smithi118.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 527 kB/s | 26 kB 00:00 2024-03-08T20:26:23.359 INFO:teuthology.orchestra.run.smithi118.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-03-08T20:26:23.401 INFO:teuthology.orchestra.run.smithi118.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-08T20:26:23.451 INFO:teuthology.orchestra.run.smithi118.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-03-08T20:26:23.563 INFO:teuthology.orchestra.run.smithi144.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 8.0 MB/s | 4.1 MB 00:00 2024-03-08T20:26:23.597 INFO:teuthology.orchestra.run.smithi144.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 133 kB/s | 125 kB 00:00 2024-03-08T20:26:23.647 INFO:teuthology.orchestra.run.smithi144.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 382 kB/s | 803 kB 00:02 2024-03-08T20:26:23.681 INFO:teuthology.orchestra.run.smithi144.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-03-08T20:26:23.685 INFO:teuthology.orchestra.run.smithi118.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-03-08T20:26:23.723 INFO:teuthology.orchestra.run.smithi144.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 855 kB/s | 35 kB 00:00 2024-03-08T20:26:23.764 INFO:teuthology.orchestra.run.smithi144.stdout:(101/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-08T20:26:23.798 INFO:teuthology.orchestra.run.smithi144.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.2 MB/s | 248 kB 00:00 2024-03-08T20:26:23.823 INFO:teuthology.orchestra.run.smithi144.stdout:(103/174): qatlib-23.11.0-1.el9.x86_64.rpm 1.2 MB/s | 216 kB 00:00 2024-03-08T20:26:23.849 INFO:teuthology.orchestra.run.smithi144.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-03-08T20:26:23.861 INFO:teuthology.orchestra.run.smithi118.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-03-08T20:26:23.903 INFO:teuthology.orchestra.run.smithi118.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-03-08T20:26:23.945 INFO:teuthology.orchestra.run.smithi118.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 785 kB/s | 32 kB 00:00 2024-03-08T20:26:23.987 INFO:teuthology.orchestra.run.smithi118.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 367 kB/s | 15 kB 00:00 2024-03-08T20:26:24.053 INFO:teuthology.orchestra.run.smithi118.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.6 MB/s | 172 kB 00:00 2024-03-08T20:26:24.171 INFO:teuthology.orchestra.run.smithi118.stdout:(119/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-08T20:26:24.288 INFO:teuthology.orchestra.run.smithi118.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.6 MB/s | 303 kB 00:00 2024-03-08T20:26:24.338 INFO:teuthology.orchestra.run.smithi118.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 719 kB/s | 35 kB 00:00 2024-03-08T20:26:24.463 INFO:teuthology.orchestra.run.smithi118.stdout:(122/174): python3-google-auth-2.28.0-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-03-08T20:26:24.499 INFO:teuthology.orchestra.run.smithi144.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-03-08T20:26:24.722 INFO:teuthology.orchestra.run.smithi118.stdout:(123/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-03-08T20:26:24.789 INFO:teuthology.orchestra.run.smithi118.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-03-08T20:26:24.831 INFO:teuthology.orchestra.run.smithi118.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 261 kB/s | 11 kB 00:00 2024-03-08T20:26:24.881 INFO:teuthology.orchestra.run.smithi118.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 364 kB/s | 18 kB 00:00 2024-03-08T20:26:24.923 INFO:teuthology.orchestra.run.smithi118.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 566 kB/s | 23 kB 00:00 2024-03-08T20:26:24.990 INFO:teuthology.orchestra.run.smithi118.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 295 kB/s | 19 kB 00:00 2024-03-08T20:26:25.032 INFO:teuthology.orchestra.run.smithi118.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 480 kB/s | 20 kB 00:00 2024-03-08T20:26:25.116 INFO:teuthology.orchestra.run.smithi118.stdout:(130/174): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-03-08T20:26:25.174 INFO:teuthology.orchestra.run.smithi118.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 803 kB/s | 46 kB 00:00 2024-03-08T20:26:25.233 INFO:teuthology.orchestra.run.smithi118.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-03-08T20:26:25.283 INFO:teuthology.orchestra.run.smithi118.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-08T20:26:25.425 INFO:teuthology.orchestra.run.smithi118.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-08T20:26:25.467 INFO:teuthology.orchestra.run.smithi118.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 400 kB/s | 16 kB 00:00 2024-03-08T20:26:25.517 INFO:teuthology.orchestra.run.smithi118.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-08T20:26:25.568 INFO:teuthology.orchestra.run.smithi118.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 572 kB/s | 28 kB 00:00 2024-03-08T20:26:25.610 INFO:teuthology.orchestra.run.smithi118.stdout:(138/174): python3-kubernetes-26.1.0-2.el9.noar 1.8 MB/s | 1.0 MB 00:00 2024-03-08T20:26:25.635 INFO:teuthology.orchestra.run.smithi118.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 463 kB/s | 31 kB 00:00 2024-03-08T20:26:25.657 INFO:teuthology.orchestra.run.smithi144.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 267 kB/s | 309 kB 00:01 2024-03-08T20:26:25.716 INFO:teuthology.orchestra.run.smithi144.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 338 kB/s | 19 kB 00:00 2024-03-08T20:26:25.758 INFO:teuthology.orchestra.run.smithi144.stdout:(108/174): protobuf-compiler-3.14.0-13.el9.x86_ 446 kB/s | 863 kB 00:01 2024-03-08T20:26:25.769 INFO:teuthology.orchestra.run.smithi118.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 446 kB/s | 59 kB 00:00 2024-03-08T20:26:25.794 INFO:teuthology.orchestra.run.smithi118.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-03-08T20:26:25.892 INFO:teuthology.orchestra.run.smithi144.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 196 kB/s | 26 kB 00:00 2024-03-08T20:26:25.920 INFO:teuthology.orchestra.run.smithi118.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 239 kB/s | 36 kB 00:00 2024-03-08T20:26:25.984 INFO:teuthology.orchestra.run.smithi144.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 534 kB/s | 49 kB 00:00 2024-03-08T20:26:26.028 INFO:teuthology.orchestra.run.smithi118.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 219 kB/s | 51 kB 00:00 2024-03-08T20:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 908 kB/s | 67 kB 00:00 2024-03-08T20:26:26.079 INFO:teuthology.orchestra.run.smithi118.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-03-08T20:26:26.196 INFO:teuthology.orchestra.run.smithi118.stdout:(145/174): openssl-devel-3.0.7-27.el9.x86_64.rp 590 kB/s | 4.1 MB 00:07 2024-03-08T20:26:26.238 INFO:teuthology.orchestra.run.smithi118.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 431 kB/s | 90 kB 00:00 2024-03-08T20:26:26.403 INFO:teuthology.orchestra.run.smithi118.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-03-08T20:26:26.455 INFO:teuthology.orchestra.run.smithi118.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-03-08T20:26:26.514 INFO:teuthology.orchestra.run.smithi118.stdout:(149/174): python3-zc-lockfile-2.0-10.el9.noarc 63 kB/s | 20 kB 00:00 2024-03-08T20:26:26.864 INFO:teuthology.orchestra.run.smithi118.stdout:(150/174): librados2-19.0.0-1965.g7d63482a.el9. 8.3 MB/s | 3.4 MB 00:00 2024-03-08T20:26:26.931 INFO:teuthology.orchestra.run.smithi118.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-03-08T20:26:26.956 INFO:teuthology.orchestra.run.smithi118.stdout:(152/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.5 MB/s | 321 kB 00:00 2024-03-08T20:26:27.250 INFO:teuthology.orchestra.run.smithi144.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 127 kB/s | 151 kB 00:01 2024-03-08T20:26:27.340 INFO:teuthology.orchestra.run.smithi118.stdout:(153/174): librbd1-19.0.0-1965.g7d63482a.el9.x8 3.8 MB/s | 3.1 MB 00:00 2024-03-08T20:26:27.415 INFO:teuthology.orchestra.run.smithi118.stdout:(154/174): NetworkManager-libnm-1.46.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-03-08T20:26:27.482 INFO:teuthology.orchestra.run.smithi118.stdout:(155/174): NetworkManager-1.46.0-1.el9.x86_64.r 4.4 MB/s | 2.3 MB 00:00 2024-03-08T20:26:27.509 INFO:teuthology.orchestra.run.smithi144.stdout:(113/174): abseil-cpp-20211102.0-3.el9.x86_64.r 150 kB/s | 548 kB 00:03 2024-03-08T20:26:27.514 INFO:teuthology.orchestra.run.smithi118.stdout:(156/174): NetworkManager-team-1.46.0-1.el9.x86 244 kB/s | 42 kB 00:00 2024-03-08T20:26:27.540 INFO:teuthology.orchestra.run.smithi118.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-03-08T20:26:27.565 INFO:teuthology.orchestra.run.smithi118.stdout:(158/174): NetworkManager-tui-1.46.0-1.el9.x86_ 1.6 MB/s | 248 kB 00:00 2024-03-08T20:26:27.590 INFO:teuthology.orchestra.run.smithi118.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 487 kB/s | 36 kB 00:00 2024-03-08T20:26:27.624 INFO:teuthology.orchestra.run.smithi118.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-08T20:26:28.156 INFO:teuthology.orchestra.run.smithi118.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-03-08T20:26:28.458 INFO:teuthology.orchestra.run.smithi118.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 287 kB/s | 256 kB 00:00 2024-03-08T20:26:28.517 INFO:teuthology.orchestra.run.smithi118.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 122 kB/s | 108 kB 00:00 2024-03-08T20:26:28.542 INFO:teuthology.orchestra.run.smithi118.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 402 kB/s | 155 kB 00:00 2024-03-08T20:26:28.584 INFO:teuthology.orchestra.run.smithi118.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-08T20:26:28.634 INFO:teuthology.orchestra.run.smithi118.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 313 kB/s | 29 kB 00:00 2024-03-08T20:26:28.668 INFO:teuthology.orchestra.run.smithi118.stdout:(167/174): libsmartcols-2.37.4-18.el9.x86_64.rp 425 kB/s | 64 kB 00:00 2024-03-08T20:26:28.818 INFO:teuthology.orchestra.run.smithi118.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 5.2 MB/s | 1.2 MB 00:00 2024-03-08T20:26:28.927 INFO:teuthology.orchestra.run.smithi118.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-03-08T20:26:28.993 INFO:teuthology.orchestra.run.smithi118.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.0 MB/s | 2.3 MB 00:00 2024-03-08T20:26:29.019 INFO:teuthology.orchestra.run.smithi118.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 342 kB/s | 31 kB 00:00 2024-03-08T20:26:29.094 INFO:teuthology.orchestra.run.smithi118.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-03-08T20:26:29.445 INFO:teuthology.orchestra.run.smithi118.stdout:(173/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 2.7 MB/s | 2.2 MB 00:00 2024-03-08T20:26:29.828 INFO:teuthology.orchestra.run.smithi118.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 92 kB/s | 74 kB 00:00 2024-03-08T20:26:29.842 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-03-08T20:26:29.843 INFO:teuthology.orchestra.run.smithi118.stdout:Total 9.2 MB/s | 223 MB 00:24 2024-03-08T20:26:31.280 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-03-08T20:26:31.300 INFO:teuthology.orchestra.run.smithi144.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 144 kB/s | 548 kB 00:03 2024-03-08T20:26:31.634 INFO:teuthology.orchestra.run.smithi144.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 131 kB/s | 43 kB 00:00 2024-03-08T20:26:31.653 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-03-08T20:26:31.654 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-03-08T20:26:31.959 INFO:teuthology.orchestra.run.smithi144.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 99 kB/s | 32 kB 00:00 2024-03-08T20:26:32.118 INFO:teuthology.orchestra.run.smithi144.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 95 kB/s | 15 kB 00:00 2024-03-08T20:26:33.010 INFO:teuthology.orchestra.run.smithi144.stdout:(118/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 146 kB/s | 838 kB 00:05 2024-03-08T20:26:33.435 INFO:teuthology.orchestra.run.smithi144.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 130 kB/s | 172 kB 00:01 2024-03-08T20:26:34.028 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-03-08T20:26:34.029 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-03-08T20:26:35.610 INFO:teuthology.orchestra.run.smithi144.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 138 kB/s | 358 kB 00:02 2024-03-08T20:26:35.686 INFO:teuthology.orchestra.run.smithi144.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 135 kB/s | 303 kB 00:02 2024-03-08T20:26:36.028 INFO:teuthology.orchestra.run.smithi144.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 85 kB/s | 35 kB 00:00 2024-03-08T20:26:36.661 INFO:teuthology.orchestra.run.smithi144.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 208 kB/s | 203 kB 00:00 2024-03-08T20:26:37.820 INFO:teuthology.orchestra.run.smithi144.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 125 kB/s | 144 kB 00:01 2024-03-08T20:26:37.945 INFO:teuthology.orchestra.run.smithi144.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-03-08T20:26:38.179 INFO:teuthology.orchestra.run.smithi144.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 76 kB/s | 18 kB 00:00 2024-03-08T20:26:38.387 INFO:teuthology.orchestra.run.smithi144.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 111 kB/s | 23 kB 00:00 2024-03-08T20:26:38.587 INFO:teuthology.orchestra.run.smithi144.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 97 kB/s | 19 kB 00:00 2024-03-08T20:26:38.829 INFO:teuthology.orchestra.run.smithi144.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 82 kB/s | 20 kB 00:00 2024-03-08T20:26:41.282 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-03-08T20:26:41.412 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-08T20:26:41.487 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-08T20:26:41.614 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T20:26:41.658 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T20:26:41.746 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-08T20:26:41.845 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-08T20:26:41.905 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-08T20:26:41.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-08T20:26:42.026 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-08T20:26:42.456 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-08T20:26:42.511 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:26:42.655 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:26:42.684 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:26:42.804 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:26:42.847 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 12/198 2024-03-08T20:26:42.954 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-08T20:26:43.282 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-08T20:26:43.375 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-08T20:26:43.400 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:26:43.554 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:26:43.593 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 17/198 2024-03-08T20:26:43.684 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 17/198 2024-03-08T20:26:43.763 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-08T20:26:43.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T20:26:43.868 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T20:26:44.199 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T20:26:44.266 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T20:26:44.337 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-08T20:26:44.680 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-08T20:26:45.102 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T20:26:45.191 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T20:26:45.456 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:26:45.530 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:26:45.858 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:26:45.921 INFO:teuthology.orchestra.run.smithi144.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 147 kB/s | 1.0 MB 00:07 2024-03-08T20:26:46.042 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-08T20:26:46.199 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-08T20:26:46.245 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-08T20:26:46.282 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-08T20:26:46.295 INFO:teuthology.orchestra.run.smithi144.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 124 kB/s | 46 kB 00:00 2024-03-08T20:26:46.343 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-08T20:26:46.451 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-08T20:26:46.518 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-08T20:26:46.562 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-08T20:26:46.651 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-08T20:26:46.692 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-08T20:26:46.751 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-08T20:26:46.771 INFO:teuthology.orchestra.run.smithi144.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 166 kB/s | 79 kB 00:00 2024-03-08T20:26:46.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-08T20:26:46.829 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-08T20:26:46.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-08T20:26:46.975 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.0.0-1965.g7d63482a.el9. 39/198 2024-03-08T20:26:46.996 INFO:teuthology.orchestra.run.smithi144.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 257 kB/s | 58 kB 00:00 2024-03-08T20:26:47.057 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el 40/198 2024-03-08T20:26:47.091 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_6 41/198 2024-03-08T20:26:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-08T20:26:47.271 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-08T20:26:47.379 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-08T20:26:47.554 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-08T20:26:47.637 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-08T20:26:47.655 INFO:teuthology.orchestra.run.smithi144.stdout:(134/174): libarrow-9.0.0-10.el9.x86_64.rpm 206 kB/s | 4.4 MB 00:21 2024-03-08T20:26:47.797 INFO:teuthology.orchestra.run.smithi144.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 117 kB/s | 16 kB 00:00 2024-03-08T20:26:48.164 INFO:teuthology.orchestra.run.smithi144.stdout:(136/174): python3-grpcio-1.46.7-10.el9.x86_64. 172 kB/s | 2.0 MB 00:12 2024-03-08T20:26:48.189 INFO:teuthology.orchestra.run.smithi144.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 228 kB/s | 272 kB 00:01 2024-03-08T20:26:48.324 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-08T20:26:48.364 INFO:teuthology.orchestra.run.smithi144.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 159 kB/s | 90 kB 00:00 2024-03-08T20:26:48.389 INFO:teuthology.orchestra.run.smithi144.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 126 kB/s | 28 kB 00:00 2024-03-08T20:26:48.418 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-08T20:26:48.431 INFO:teuthology.orchestra.run.smithi144.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 127 kB/s | 31 kB 00:00 2024-03-08T20:26:48.540 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-08T20:26:48.604 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T20:26:48.628 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T20:26:48.671 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-08T20:26:48.715 INFO:teuthology.orchestra.run.smithi144.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 126 kB/s | 36 kB 00:00 2024-03-08T20:26:48.750 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-08T20:26:48.807 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_6 53/198 2024-03-08T20:26:48.840 INFO:teuthology.orchestra.run.smithi144.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 131 kB/s | 59 kB 00:00 2024-03-08T20:26:48.853 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-08T20:26:49.107 INFO:teuthology.orchestra.run.smithi144.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 130 kB/s | 51 kB 00:00 2024-03-08T20:26:49.248 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-08T20:26:49.449 INFO:teuthology.orchestra.run.smithi144.stdout:(144/174): python3-routes-2.5.1-5.el9.noarch.rp 174 kB/s | 188 kB 00:01 2024-03-08T20:26:49.512 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-08T20:26:49.578 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-08T20:26:49.656 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-08T20:26:49.758 INFO:teuthology.orchestra.run.smithi144.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 138 kB/s | 90 kB 00:00 2024-03-08T20:26:49.887 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-08T20:26:49.939 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-08T20:26:49.941 INFO:teuthology.orchestra.run.smithi144.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 109 kB/s | 20 kB 00:00 2024-03-08T20:26:50.005 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-08T20:26:50.100 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-08T20:26:50.173 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-08T20:26:50.221 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-08T20:26:50.290 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-08T20:26:50.329 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-08T20:26:50.391 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-08T20:26:50.400 INFO:teuthology.orchestra.run.smithi144.stdout:(147/174): python3-webob-1.8.7-6.el9.noarch.rpm 147 kB/s | 230 kB 00:01 2024-03-08T20:26:50.458 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-08T20:26:50.648 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-08T20:26:50.703 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-08T20:26:50.747 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-08T20:26:50.806 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-08T20:26:50.948 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-08T20:26:51.005 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-08T20:26:51.068 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-08T20:26:51.105 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-08T20:26:51.138 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-08T20:26:51.183 INFO:teuthology.orchestra.run.smithi144.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 154 kB/s | 192 kB 00:01 2024-03-08T20:26:51.315 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-08T20:26:51.488 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-08T20:26:51.627 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-08T20:26:51.681 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-08T20:26:51.745 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-08T20:26:51.758 INFO:teuthology.orchestra.run.smithi144.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 185 kB/s | 427 kB 00:02 2024-03-08T20:26:51.830 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-08T20:26:52.059 INFO:teuthology.orchestra.run.smithi144.stdout:(150/174): librbd1-19.0.0-1965.g7d63482a.el9.x8 11 MB/s | 3.1 MB 00:00 2024-03-08T20:26:52.073 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-08T20:26:52.117 INFO:teuthology.orchestra.run.smithi144.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2024-03-08T20:26:52.145 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-08T20:26:52.315 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-08T20:26:52.385 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-08T20:26:52.425 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-08T20:26:52.471 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-08T20:26:52.522 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-08T20:26:52.568 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-08T20:26:52.637 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-08T20:26:52.693 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-08T20:26:52.741 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-08T20:26:52.868 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-08T20:26:52.935 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-08T20:26:52.978 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-08T20:26:53.052 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-08T20:26:53.090 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-08T20:26:53.234 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-08T20:26:53.542 INFO:teuthology.orchestra.run.smithi144.stdout:(152/174): librados2-19.0.0-1965.g7d63482a.el9. 1.4 MB/s | 3.4 MB 00:02 2024-03-08T20:26:53.765 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-08T20:26:53.833 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-08T20:26:53.875 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-08T20:26:53.945 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-08T20:26:54.099 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-08T20:26:54.172 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-08T20:26:55.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-08T20:26:55.188 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-08T20:26:55.221 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-08T20:26:55.287 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-08T20:26:55.408 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-08T20:26:55.447 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-08T20:26:55.678 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-08T20:26:55.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-08T20:26:55.801 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-08T20:26:55.951 INFO:teuthology.orchestra.run.smithi144.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 612 kB/s | 2.3 MB 00:03 2024-03-08T20:26:56.588 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-08T20:26:56.659 INFO:teuthology.orchestra.run.smithi144.stdout:(154/174): NetworkManager-libnm-1.46.0-1.el9.x8 597 kB/s | 1.8 MB 00:03 2024-03-08T20:26:56.685 INFO:teuthology.orchestra.run.smithi144.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 58 kB/s | 42 kB 00:00 2024-03-08T20:26:56.714 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-08T20:26:57.568 INFO:teuthology.orchestra.run.smithi144.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 81 kB/s | 71 kB 00:00 2024-03-08T20:26:57.801 INFO:teuthology.orchestra.run.smithi144.stdout:(157/174): NetworkManager-tui-1.46.0-1.el9.x86_ 218 kB/s | 248 kB 00:01 2024-03-08T20:26:58.240 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-08T20:26:58.277 INFO:teuthology.orchestra.run.smithi144.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 51 kB/s | 36 kB 00:00 2024-03-08T20:26:58.342 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-08T20:26:58.380 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-08T20:26:58.411 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-08T20:26:58.451 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-08T20:26:58.793 INFO:teuthology.orchestra.run.smithi144.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 194 kB/s | 192 kB 00:00 2024-03-08T20:26:58.835 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-08T20:26:59.072 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 124/198 2024-03-08T20:26:59.369 INFO:teuthology.orchestra.run.smithi144.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 234 kB/s | 256 kB 00:01 2024-03-08T20:26:59.397 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 124/198 2024-03-08T20:26:59.441 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 125/198 2024-03-08T20:26:59.460 INFO:teuthology.orchestra.run.smithi144.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 35 kB/s | 23 kB 00:00 2024-03-08T20:26:59.503 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-08T20:27:00.066 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-08T20:27:00.120 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 128/198 2024-03-08T20:27:00.203 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 128/198 2024-03-08T20:27:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:(162/174): thrift-0.15.0-2.el9.x86_64.rpm 165 kB/s | 1.6 MB 00:09 2024-03-08T20:27:00.230 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 129/198 2024-03-08T20:27:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 124 kB/s | 108 kB 00:00 2024-03-08T20:27:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 155 kB/s | 155 kB 00:00 2024-03-08T20:27:01.036 INFO:teuthology.orchestra.run.smithi144.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 81 kB/s | 64 kB 00:00 2024-03-08T20:27:01.087 INFO:teuthology.orchestra.run.smithi144.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 155 kB/s | 136 kB 00:00 2024-03-08T20:27:01.262 INFO:teuthology.orchestra.run.smithi144.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 42 kB/s | 29 kB 00:00 2024-03-08T20:27:02.792 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:02.852 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:03.478 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:03.547 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 131/198 2024-03-08T20:27:03.724 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 131/198 2024-03-08T20:27:03.724 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-08T20:27:03.725 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-08T20:27:03.725 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:03.765 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 132/198 2024-03-08T20:27:03.903 INFO:teuthology.orchestra.run.smithi144.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 432 kB/s | 1.2 MB 00:02 2024-03-08T20:27:05.453 INFO:teuthology.orchestra.run.smithi144.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 506 kB/s | 2.2 MB 00:04 2024-03-08T20:27:05.487 INFO:teuthology.orchestra.run.smithi144.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 294 kB/s | 465 kB 00:01 2024-03-08T20:27:05.925 INFO:teuthology.orchestra.run.smithi144.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 502 kB/s | 2.3 MB 00:04 2024-03-08T20:27:06.167 INFO:teuthology.orchestra.run.smithi144.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 311 kB/s | 74 kB 00:00 2024-03-08T20:27:06.317 INFO:teuthology.orchestra.run.smithi144.stdout:(173/174): util-linux-user-2.37.4-18.el9.x86_64 36 kB/s | 31 kB 00:00 2024-03-08T20:27:07.825 INFO:teuthology.orchestra.run.smithi144.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 470 kB/s | 1.1 MB 00:02 2024-03-08T20:27:07.838 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-03-08T20:27:07.838 INFO:teuthology.orchestra.run.smithi144.stdout:Total 3.8 MB/s | 223 MB 00:58 2024-03-08T20:27:09.290 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-03-08T20:27:09.665 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-03-08T20:27:09.665 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-03-08T20:27:12.059 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-03-08T20:27:12.059 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-03-08T20:27:16.839 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 132/198 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-03-08T20:27:16.840 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:17.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 133/198 2024-03-08T20:27:17.137 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 133/198 2024-03-08T20:27:17.137 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:17.137 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-08T20:27:17.137 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:18.819 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 134/198 2024-03-08T20:27:18.919 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 134/198 2024-03-08T20:27:18.919 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:18.920 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-08T20:27:18.920 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T20:27:18.920 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T20:27:18.920 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:19.160 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 135/198 2024-03-08T20:27:19.238 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-03-08T20:27:19.238 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 135/198 2024-03-08T20:27:19.238 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:19.239 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-08T20:27:19.239 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T20:27:19.239 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T20:27:19.239 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:19.340 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-08T20:27:19.380 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-08T20:27:19.427 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T20:27:19.472 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T20:27:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-08T20:27:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-08T20:27:19.710 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-08T20:27:19.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 136/198 2024-03-08T20:27:19.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 136/198 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T20:27:19.781 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:19.833 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-08T20:27:19.896 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-08T20:27:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-08T20:27:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:27:20.466 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:27:20.491 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:27:20.521 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 138/198 2024-03-08T20:27:20.555 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 138/198 2024-03-08T20:27:20.594 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:27:20.606 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.e 139/198 2024-03-08T20:27:20.635 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 12/198 2024-03-08T20:27:20.700 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-08T20:27:20.706 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a. 140/198 2024-03-08T20:27:20.735 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 141/198 2024-03-08T20:27:20.976 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-08T20:27:21.050 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-08T20:27:21.065 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 141/198 2024-03-08T20:27:21.081 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:27:21.103 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 142/198 2024-03-08T20:27:21.255 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:27:21.284 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 17/198 2024-03-08T20:27:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 17/198 2024-03-08T20:27:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-08T20:27:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T20:27:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T20:27:21.820 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T20:27:21.870 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T20:27:21.949 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-08T20:27:22.221 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 142/198 2024-03-08T20:27:22.261 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 143/198 2024-03-08T20:27:22.272 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-08T20:27:22.402 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 143/198 2024-03-08T20:27:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T20:27:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T20:27:22.615 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el 144/198 2024-03-08T20:27:22.647 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 145/198 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 145/198 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T20:27:22.743 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:22.744 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:27:22.805 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:27:22.806 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 146/198 2024-03-08T20:27:22.846 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 146/198 2024-03-08T20:27:22.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 147/198 2024-03-08T20:27:23.119 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T20:27:23.309 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-08T20:27:23.427 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-08T20:27:23.469 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-08T20:27:23.506 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-08T20:27:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-08T20:27:23.674 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-08T20:27:23.750 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-08T20:27:23.794 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-08T20:27:23.884 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-08T20:27:23.925 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-08T20:27:23.938 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-08T20:27:23.983 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-08T20:27:23.991 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 149/198 2024-03-08T20:27:24.036 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-08T20:27:24.069 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 149/198 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T20:27:24.086 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:24.134 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1965.g7d634 150/198 2024-03-08T20:27:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-08T20:27:24.223 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.0.0-1965.g7d63482a.el9. 39/198 2024-03-08T20:27:24.230 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1965.g7d634 150/198 2024-03-08T20:27:24.230 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:24.230 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-08T20:27:24.230 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:24.275 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el 40/198 2024-03-08T20:27:24.306 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_6 41/198 2024-03-08T20:27:24.326 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T20:27:24.432 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:24.452 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-08T20:27:24.507 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-08T20:27:24.620 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-08T20:27:24.835 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 152/198 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 152/198 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T20:27:24.926 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:25.038 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-08T20:27:25.101 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-08T20:27:25.784 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-08T20:27:25.878 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-08T20:27:26.018 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-08T20:27:26.076 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T20:27:26.104 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T20:27:26.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-08T20:27:26.233 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-08T20:27:26.289 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_6 53/198 2024-03-08T20:27:26.333 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-08T20:27:26.768 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-08T20:27:26.989 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-08T20:27:27.107 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-08T20:27:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-08T20:27:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-08T20:27:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-08T20:27:27.528 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-08T20:27:27.621 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-08T20:27:27.668 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-08T20:27:27.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-08T20:27:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-08T20:27:27.816 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-08T20:27:27.879 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-08T20:27:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-08T20:27:28.125 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-08T20:27:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-08T20:27:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-08T20:27:28.256 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-08T20:27:28.384 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-08T20:27:28.434 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-08T20:27:28.480 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-08T20:27:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-08T20:27:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-08T20:27:28.712 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-08T20:27:28.892 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-08T20:27:29.024 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-08T20:27:29.077 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-08T20:27:29.138 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-08T20:27:29.213 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-08T20:27:29.456 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-08T20:27:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-08T20:27:29.685 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-08T20:27:29.725 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 153/198 2024-03-08T20:27:29.736 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-08T20:27:29.777 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 154/198 2024-03-08T20:27:29.801 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-08T20:27:29.825 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 155/198 2024-03-08T20:27:29.840 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-08T20:27:29.864 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-08T20:27:29.890 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-08T20:27:29.938 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-08T20:27:30.007 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-08T20:27:30.062 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-08T20:27:30.112 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-08T20:27:30.159 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 157/198 2024-03-08T20:27:30.237 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-08T20:27:30.281 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-08T20:27:30.304 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-08T20:27:30.317 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-08T20:27:30.352 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 159/198 2024-03-08T20:27:30.379 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-08T20:27:30.400 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-08T20:27:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-08T20:27:30.460 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-08T20:27:30.505 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-08T20:27:30.540 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_ 163/198 2024-03-08T20:27:30.563 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-08T20:27:30.576 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-08T20:27:30.637 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-08T20:27:30.674 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-08T20:27:30.732 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-08T20:27:30.732 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-08T20:27:30.777 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-08T20:27:30.835 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-08T20:27:30.845 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-08T20:27:30.895 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-08T20:27:30.994 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-08T20:27:31.060 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-08T20:27:31.793 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:27:31.850 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:27:31.918 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:27:32.031 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-08T20:27:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-08T20:27:32.128 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-08T20:27:32.186 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-08T20:27:32.294 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-08T20:27:32.336 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-08T20:27:32.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-08T20:27:32.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-08T20:27:32.701 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-08T20:27:33.248 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 170/198 2024-03-08T20:27:33.357 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-08T20:27:33.405 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-08T20:27:33.506 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-08T20:27:33.540 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-08T20:27:33.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-08T20:27:33.626 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-08T20:27:33.661 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-08T20:27:33.661 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-08T20:27:33.703 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-08T20:27:33.703 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T20:27:33.848 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T20:27:33.890 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-08T20:27:33.890 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T20:27:34.062 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T20:27:34.117 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-08T20:27:34.168 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-08T20:27:34.202 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-08T20:27:34.242 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-08T20:27:34.309 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-08T20:27:34.393 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-08T20:27:34.456 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-08T20:27:34.490 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-08T20:27:34.523 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-08T20:27:34.557 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-08T20:27:34.590 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-08T20:27:34.626 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:27:34.626 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:27:34.982 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:27:34.982 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T20:27:35.113 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T20:27:35.143 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-08T20:27:35.177 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-08T20:27:35.182 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-08T20:27:35.234 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-08T20:27:35.270 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-08T20:27:35.279 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-08T20:27:35.317 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-08T20:27:35.348 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-08T20:27:35.389 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-08T20:27:35.420 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T20:27:35.677 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T20:27:35.677 INFO:teuthology.orchestra.run.smithi118.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-08T20:27:35.677 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:35.768 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-08T20:27:35.795 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 124/198 2024-03-08T20:27:35.926 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 124/198 2024-03-08T20:27:35.960 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 125/198 2024-03-08T20:27:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-08T20:27:36.552 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-08T20:27:36.581 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 128/198 2024-03-08T20:27:36.681 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 128/198 2024-03-08T20:27:36.717 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 129/198 2024-03-08T20:27:39.247 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:39.288 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 130/198 2024-03-08T20:27:39.966 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 131/198 2024-03-08T20:27:40.115 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 131/198 2024-03-08T20:27:40.115 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-08T20:27:40.116 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-08T20:27:40.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:40.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 132/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 1/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 2/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 3/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 4/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1965.g7d634 5/198 2024-03-08T20:27:40.850 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 6/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 7/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 8/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 9/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 12/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 13/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 14/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_ 15/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 17/198 2024-03-08T20:27:40.851 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_6 18/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 19/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 20/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el 21/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.0.0-1965.g7d63482a.el9. 22/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_6 23/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 24/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 25/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 26/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 27/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 28/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 29/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a. 30/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 31/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 32/198 2024-03-08T20:27:40.852 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 33/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el 34/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 35/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.e 36/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 37/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 38/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 39/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-08T20:27:40.853 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-08T20:27:40.854 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-08T20:27:40.855 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-08T20:27:40.856 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-08T20:27:40.857 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-08T20:27:40.858 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-08T20:27:40.859 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-08T20:27:40.860 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-08T20:27:40.861 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 153/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-08T20:27:40.862 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-08T20:27:40.863 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-08T20:27:40.864 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-08T20:27:40.865 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-08T20:27:43.400 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-08T20:27:43.400 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:43.400 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-03-08T20:27:43.400 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: acl-2.3.1-4.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.401 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-08T20:27:43.402 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.2-8.el9.noarch 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.7.4-5.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.403 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.404 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.4-9.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-16.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-08T20:27:43.405 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.406 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-13.11-1.el9.x86_64 2024-03-08T20:27:43.407 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-08T20:27:43.408 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-08T20:27:43.409 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-08T20:27:43.410 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-08T20:27:43.411 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-08T20:27:43.412 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-08T20:27:43.413 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.414 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-3.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-08T20:27:43.415 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-08T20:27:43.416 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:27:43.416 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-03-08T20:27:44.042 DEBUG:teuthology.parallel:result is None 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 132/198 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-03-08T20:27:53.145 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-03-08T20:27:53.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:53.372 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 133/198 2024-03-08T20:27:53.418 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 133/198 2024-03-08T20:27:53.419 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:53.419 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-08T20:27:53.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:55.060 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 134/198 2024-03-08T20:27:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 134/198 2024-03-08T20:27:55.135 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:55.135 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-08T20:27:55.136 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T20:27:55.136 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T20:27:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:55.360 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 135/198 2024-03-08T20:27:55.454 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 135/198 2024-03-08T20:27:55.454 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:55.454 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-08T20:27:55.454 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T20:27:55.455 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T20:27:55.455 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:55.927 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 136/198 2024-03-08T20:27:55.995 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 136/198 2024-03-08T20:27:55.995 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:55.995 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-08T20:27:55.996 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T20:27:55.996 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T20:27:55.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:56.113 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-08T20:27:56.692 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 138/198 2024-03-08T20:27:56.722 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 138/198 2024-03-08T20:27:56.772 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.e 139/198 2024-03-08T20:27:56.872 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a. 140/198 2024-03-08T20:27:56.901 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 141/198 2024-03-08T20:27:57.228 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 141/198 2024-03-08T20:27:57.260 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 142/198 2024-03-08T20:27:58.373 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 142/198 2024-03-08T20:27:58.402 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 143/198 2024-03-08T20:27:58.543 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 143/198 2024-03-08T20:27:58.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el 144/198 2024-03-08T20:27:58.737 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 145/198 2024-03-08T20:27:58.809 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 145/198 2024-03-08T20:27:58.810 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:27:58.810 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-08T20:27:58.810 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T20:27:58.810 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T20:27:58.810 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:27:58.871 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 146/198 2024-03-08T20:27:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 146/198 2024-03-08T20:27:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 147/198 2024-03-08T20:27:59.940 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-08T20:27:59.973 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 149/198 2024-03-08T20:28:00.045 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 149/198 2024-03-08T20:28:00.045 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:28:00.045 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-08T20:28:00.046 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T20:28:00.046 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T20:28:00.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:00.091 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1965.g7d634 150/198 2024-03-08T20:28:00.158 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1965.g7d634 150/198 2024-03-08T20:28:00.158 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:28:00.158 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-08T20:28:00.158 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:00.225 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:28:00.300 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:28:00.300 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:28:00.300 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-08T20:28:00.301 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T20:28:00.301 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T20:28:00.301 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:00.650 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 152/198 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 152/198 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T20:28:00.720 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:05.482 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 153/198 2024-03-08T20:28:05.535 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 154/198 2024-03-08T20:28:05.571 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 155/198 2024-03-08T20:28:05.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-08T20:28:05.879 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 157/198 2024-03-08T20:28:06.002 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-08T20:28:06.071 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 159/198 2024-03-08T20:28:06.127 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-08T20:28:06.199 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-08T20:28:06.245 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-08T20:28:06.288 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_ 163/198 2024-03-08T20:28:06.324 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-08T20:28:06.384 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-08T20:28:06.479 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-08T20:28:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-08T20:28:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-08T20:28:07.489 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:28:07.538 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:28:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T20:28:08.925 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 170/198 2024-03-08T20:28:09.019 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-08T20:28:09.074 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-08T20:28:09.207 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-08T20:28:09.246 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-08T20:28:09.288 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-08T20:28:09.347 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-08T20:28:09.389 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-08T20:28:09.390 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T20:28:09.535 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T20:28:09.576 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-08T20:28:09.577 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T20:28:09.724 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T20:28:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-08T20:28:09.821 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-08T20:28:09.855 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-08T20:28:09.887 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-08T20:28:09.957 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-08T20:28:10.034 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-08T20:28:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-08T20:28:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-08T20:28:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-08T20:28:10.184 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-08T20:28:10.217 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-08T20:28:10.253 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:28:10.254 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:28:10.585 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T20:28:10.585 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T20:28:10.740 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T20:28:10.770 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-08T20:28:10.804 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-08T20:28:10.862 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-08T20:28:10.897 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-08T20:28:11.016 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T20:28:11.269 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T20:28:11.269 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-08T20:28:11.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 1/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 2/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 3/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 4/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1965.g7d634 5/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 6/198 2024-03-08T20:28:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 7/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 8/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 9/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 10/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 11/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 12/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 13/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 14/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_ 15/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 16/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 17/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_6 18/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86 19/198 2024-03-08T20:28:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 20/198 2024-03-08T20:28:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el 21/198 2024-03-08T20:28:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.0.0-1965.g7d63482a.el9. 22/198 2024-03-08T20:28:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_6 23/198 2024-03-08T20:28:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 24/198 2024-03-08T20:28:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 25/198 2024-03-08T20:28:16.096 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 26/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 27/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 28/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 29/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a. 30/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noa 31/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.n 32/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d6 33/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el 34/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 35/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.e 36/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 37/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 38/198 2024-03-08T20:28:16.097 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 39/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-08T20:28:16.098 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-08T20:28:16.099 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-08T20:28:16.100 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-08T20:28:16.101 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-08T20:28:16.102 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-08T20:28:16.103 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-08T20:28:16.104 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-08T20:28:16.105 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 151/198 2024-03-08T20:28:16.106 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 153/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-08T20:28:16.107 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-08T20:28:16.108 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-08T20:28:16.109 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-08T20:28:16.110 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: acl-2.3.1-4.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-08T20:28:18.537 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.538 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.539 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.540 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.0.0-1965.g7d63482a.el9.noarch 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-08T20:28:18.541 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-16.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-08T20:28:18.542 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-08T20:28:18.543 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.11-1.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-08T20:28:18.544 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-08T20:28:18.545 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-08T20:28:18.546 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-08T20:28:18.547 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-08T20:28:18.548 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.0.0-1965.g7d63482a.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-3.el9.x86_64 2024-03-08T20:28:18.549 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:18.550 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-03-08T20:28:19.154 DEBUG:teuthology.parallel:result is None 2024-03-08T20:28:19.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:28:19.301 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-08T20:28:19.373 INFO:teuthology.orchestra.run.smithi118.stdout:19.0.0-1965.g7d63482a.el9 2024-03-08T20:28:19.373 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1965.g7d63482a.el9 2024-03-08T20:28:19.374 INFO:teuthology.task.install:The correct ceph version 19.0.0-1965.g7d63482a is installed. 2024-03-08T20:28:19.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:28:19.519 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-08T20:28:19.578 INFO:teuthology.orchestra.run.smithi144.stdout:19.0.0-1965.g7d63482a.el9 2024-03-08T20:28:19.578 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1965.g7d63482a.el9 2024-03-08T20:28:19.578 INFO:teuthology.task.install:The correct ceph version 19.0.0-1965.g7d63482a is installed. 2024-03-08T20:28:19.580 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-08T20:28:19.580 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:19.580 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T20:28:19.681 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:19.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T20:28:19.762 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-08T20:28:19.762 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:19.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T20:28:19.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T20:28:19.949 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:19.949 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T20:28:20.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T20:28:20.155 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-08T20:28:20.155 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:20.155 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T20:28:20.256 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T20:28:20.386 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:20.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T20:28:20.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T20:28:20.573 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-08T20:28:20.573 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:20.573 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T20:28:20.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T20:28:20.749 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:20.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T20:28:20.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T20:28:20.930 INFO:teuthology.run_tasks:Running task ceph... 2024-03-08T20:28:21.015 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-08T20:28:21.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-03-08T20:28:21.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-03-08T20:28:21.103 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-08T20:28:21.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T20:28:21.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T20:28:21.182 INFO:tasks.ceph:Creating extra log directories... 2024-03-08T20:28:21.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T20:28:21.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T20:28:21.266 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-08T20:28:21.266 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-08T20:28:21.266 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-08T20:28:21.267 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:21.267 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T20:28:21.308 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:21.544 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:21.633 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:21.633 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T20:28:21.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:21.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:21.961 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-08T20:28:21.961 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-08T20:28:21.961 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112', 'branch': 'rishabh-2024mar8', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench}', 'email': None, 'first_in_suite': False, 'job_id': '7588112', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['kernel_untar_build.sh']}}}]}, 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2024mar8'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7d63482aa89628d733e298984a762389b625c761'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2024mar8', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 1249, 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'sleep_before_teardown': 0, 'subset': '481/512', 'suite': 'fs', 'suite_branch': 'rishabh-2024mar8', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7d63482aa89628d733e298984a762389b625c761', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9BkScvZt4QDYtBk4Pxn2Qt5ZzYrp+9+woEegzZUhrKrFz2RwuwpgNpdol3vAP/wlmLbN61128BVAsxldMv+aM=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNCdkh3ky50nCQmJAhjVxMzf3hsTQ68dRqYNoZojzitxCVzkVQiVu5zaAzqRJF/iZsitXWtI6nNv7HDZMgChsY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'cluster': 'ceph'}}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-08_19:54:47', 'tube': 'smithi', 'user': 'rishabh', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/blogbench.sh']}}}]}, 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-08T20:28:21.961 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T20:28:21.969 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T20:28:22.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T20:28:22.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T20:28:22.131 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:22.131 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T20:28:22.189 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T20:28:22.189 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-03-08T20:28:22.241 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-08 20:27:36.118276359 +0000 2024-03-08T20:28:22.242 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-08 20:25:02.333127502 +0000 2024-03-08T20:28:22.243 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-08 20:25:02.333127502 +0000 2024-03-08T20:28:22.243 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-08 20:25:02.333127502 +0000 2024-03-08T20:28:22.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T20:28:22.328 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-08T20:28:22.329 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-08T20:28:22.329 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000228583 s, 2.2 MB/s 2024-03-08T20:28:22.333 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T20:28:22.391 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-08 20:27:36.118276359 +0000 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-08 20:25:02.884114683 +0000 2024-03-08T20:28:22.438 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-08 20:25:02.884114683 +0000 2024-03-08T20:28:22.439 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-08 20:25:02.884114683 +0000 2024-03-08T20:28:22.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T20:28:22.520 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-08T20:28:22.521 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-08T20:28:22.521 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000221039 s, 2.3 MB/s 2024-03-08T20:28:22.525 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T20:28:22.579 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-03-08T20:28:22.628 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-08 20:27:36.120276312 +0000 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-08 20:25:03.480100818 +0000 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-08 20:25:03.480100818 +0000 2024-03-08T20:28:22.629 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-08 20:25:03.480100818 +0000 2024-03-08T20:28:22.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T20:28:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-08T20:28:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-08T20:28:22.718 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.0002167 s, 2.4 MB/s 2024-03-08T20:28:22.721 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T20:28:22.776 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-03-08T20:28:22.825 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T20:28:22.825 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-08 20:27:36.120276312 +0000 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-08 20:25:04.023088185 +0000 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-08 20:25:04.023088185 +0000 2024-03-08T20:28:22.826 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-08 20:25:04.023088185 +0000 2024-03-08T20:28:22.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T20:28:22.910 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-08T20:28:22.911 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-08T20:28:22.911 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000209791 s, 2.4 MB/s 2024-03-08T20:28:22.915 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T20:28:22.971 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:22.971 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:22.971 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T20:28:23.022 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T20:28:23.022 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-03-08 20:28:11.736170796 +0000 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-03-08 20:25:02.353682346 +0000 2024-03-08T20:28:23.102 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-03-08 20:25:02.353682346 +0000 2024-03-08T20:28:23.103 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-03-08 20:25:02.353682346 +0000 2024-03-08T20:28:23.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T20:28:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-03-08T20:28:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-03-08T20:28:23.224 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00035902 s, 1.4 MB/s 2024-03-08T20:28:23.228 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T20:28:23.275 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-03-08 20:28:11.736170796 +0000 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-03-08 20:25:02.879674161 +0000 2024-03-08T20:28:23.364 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-03-08 20:25:02.879674161 +0000 2024-03-08T20:28:23.365 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-03-08 20:25:02.879674161 +0000 2024-03-08T20:28:23.365 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T20:28:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-03-08T20:28:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-03-08T20:28:23.486 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000299442 s, 1.7 MB/s 2024-03-08T20:28:23.489 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T20:28:23.540 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-03-08T20:28:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T20:28:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:23.580 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-08T20:28:23.580 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:23.581 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:23.581 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-03-08 20:28:11.737170779 +0000 2024-03-08T20:28:23.581 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-03-08 20:25:03.425665665 +0000 2024-03-08T20:28:23.581 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-03-08 20:25:03.425665665 +0000 2024-03-08T20:28:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-03-08 20:25:03.425665665 +0000 2024-03-08T20:28:23.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T20:28:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-03-08T20:28:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-03-08T20:28:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000312305 s, 1.6 MB/s 2024-03-08T20:28:23.693 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T20:28:23.738 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-03-08T20:28:23.833 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-03-08 20:28:11.738170763 +0000 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-03-08 20:25:03.962657308 +0000 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-03-08 20:25:03.962657308 +0000 2024-03-08T20:28:23.834 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-03-08 20:25:03.962657308 +0000 2024-03-08T20:28:23.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T20:28:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-03-08T20:28:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-03-08T20:28:23.920 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000342216 s, 1.5 MB/s 2024-03-08T20:28:23.924 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T20:28:23.978 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:23.979 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T20:28:23.979 INFO:tasks.ceph:Generating config... 2024-03-08T20:28:23.980 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-08T20:28:23.980 INFO:tasks.ceph:[client] debug client = 20 2024-03-08T20:28:23.980 INFO:tasks.ceph:[client] debug ms = 1 2024-03-08T20:28:23.980 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-08T20:28:23.981 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-08T20:28:23.981 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-08T20:28:23.981 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-08T20:28:23.982 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-08T20:28:23.982 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-08T20:28:23.982 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-08T20:28:23.983 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-08T20:28:23.983 INFO:tasks.ceph:Setting up mon.a... 2024-03-08T20:28:23.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-08T20:28:24.153 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2024-03-08T20:28:24.162 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-08T20:28:24.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T20:28:24.372 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118'), ('mon.b', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]')] 2024-03-08T20:28:24.372 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-08T20:28:24.373 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:24.373 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T20:28:24.425 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --add b 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:24.575 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:24.575 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid ac17b673-6e59-4db3-9519-ba644ea1ee5b 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = quincy 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:fsid ac17b673-6e59-4db3-9519-ba644ea1ee5b 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2024-03-08T20:28:24.577023+0000 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:created 2024-03-08T20:28:24.577023+0000 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 17 (quincy) 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2024-03-08T20:28:24.576 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-08T20:28:24.579 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T20:28:24.631 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac17b673-6e59-4db3-9519-ba644ea1ee5b... 2024-03-08T20:28:24.632 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T20:28:24.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-03-08T20:28:24.799 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-03-08T20:28:24.800 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-03-08T20:28:24.801 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.118,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on skipped message = False 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = ac17b673-6e59-4db3-9519-ba644ea1ee5b 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-03-08T20:28:24.802 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.803 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore compression mode = aggressive 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2024-03-08T20:28:24.804 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: osd shutdown pgref assert = True 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.805 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-03-08T20:28:24.806 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T20:28:24.807 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-08T20:28:24.808 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2024-03-08T20:28:24.809 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-03-08T20:28:24.810 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.811 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-03-08T20:28:24.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.118,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = ac17b673-6e59-4db3-9519-ba644ea1ee5b 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-03-08T20:28:24.813 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.814 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-03-08T20:28:24.815 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore compression mode = aggressive 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-03-08T20:28:24.816 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: osd shutdown pgref assert = True 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-03-08T20:28:24.817 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.818 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-03-08T20:28:24.819 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-03-08T20:28:24.820 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-03-08T20:28:24.821 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-03-08T20:28:24.850 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-08T20:28:24.851 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-08T20:28:24.996 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-08T20:28:24.997 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:24.997 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-08T20:28:25.043 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:25.043 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-08T20:28:25.136 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:28:25.137 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:25.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T20:28:25.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T20:28:25.271 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:25.271 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:25.367 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:28:25.367 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:25.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T20:28:25.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T20:28:25.524 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:25.524 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:25.621 INFO:tasks.ceph:Setting up mon nodes... 2024-03-08T20:28:25.622 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-08T20:28:25.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T20:28:25.800 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T20:28:25.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T20:28:26.016 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T20:28:26.027 INFO:tasks.ceph:Setting up mds nodes... 2024-03-08T20:28:26.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T20:28:26.212 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T20:28:26.222 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-08T20:28:26.312 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-08T20:28:26.484 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-08T20:28:26.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-08T20:28:26.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T20:28:26.766 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T20:28:26.776 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-08T20:28:26.873 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-08T20:28:27.038 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-08T20:28:27.047 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-08T20:28:27.133 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-08T20:28:27.134 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-08T20:28:27.263 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-08T20:28:27.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-08T20:28:27.451 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-08T20:28:27.506 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-08T20:28:27.506 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T20:28:27.506 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-08T20:28:27.600 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:27.601 INFO:tasks.ceph:role: osd.0 2024-03-08T20:28:27.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:28:27.601 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:27.688 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:27.722 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-08T20:28:27.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-08T20:28:27.729 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-08T20:28:27.841 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-08T20:28:27.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-08T20:28:28.004 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:28.004 INFO:tasks.ceph:role: osd.1 2024-03-08T20:28:28.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:28:28.004 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T20:28:28.091 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:28.092 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:28.125 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-08T20:28:28.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-08T20:28:28.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-08T20:28:28.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-08T20:28:28.324 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-08T20:28:28.412 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:28.412 INFO:tasks.ceph:role: osd.2 2024-03-08T20:28:28.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:28:28.413 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T20:28:28.502 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:28.503 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:28.537 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-08T20:28:28.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-08T20:28:28.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-08T20:28:28.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-08T20:28:28.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-08T20:28:28.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:28.820 INFO:tasks.ceph:role: osd.3 2024-03-08T20:28:28.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:28:28.820 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T20:28:28.905 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:28.906 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:28.939 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-08T20:28:28.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-08T20:28:28.945 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-08T20:28:29.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-08T20:28:29.136 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.314+0000 7fe7f8c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-08T20:28:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.315+0000 7fe7f8c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-08T20:28:29.314 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.315+0000 7fe7f8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T20:28:29.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.315+0000 7fe7f8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T20:28:29.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.315+0000 7fe7f8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T20:28:29.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:29.318+0000 7fe7f8c11640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-08T20:28:32.492 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-08T20:28:32.588 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:32.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.727+0000 7f35cc9fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-08T20:28:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.728+0000 7f35cc9fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-08T20:28:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.728+0000 7f35cc9fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T20:28:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.728+0000 7f35cc9fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T20:28:32.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.728+0000 7f35cc9fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T20:28:32.731 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:32.730+0000 7f35cc9fa640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-08T20:28:35.653 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-08T20:28:35.747 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:35.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.882+0000 7fa2acd73640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-08T20:28:35.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.883+0000 7fa2acd73640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-08T20:28:35.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.883+0000 7fa2acd73640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T20:28:35.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.883+0000 7fa2acd73640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T20:28:35.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.883+0000 7fa2acd73640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T20:28:35.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:35.885+0000 7fa2acd73640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-08T20:28:38.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-08T20:28:38.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:39.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.050+0000 7f8627c68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-08T20:28:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.051+0000 7f8627c68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-08T20:28:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.051+0000 7f8627c68640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T20:28:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.051+0000 7f8627c68640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T20:28:39.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.051+0000 7f8627c68640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T20:28:39.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:28:39.053+0000 7f8627c68640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-08T20:28:41.988 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-08T20:28:42.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-08T20:28:42.186 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:42.186 INFO:tasks.ceph:role: osd.4 2024-03-08T20:28:42.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:28:42.186 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T20:28:42.281 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:42.281 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:42.282 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:42.798 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-03-08T20:28:42.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-03-08T20:28:42.807 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-08T20:28:42.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-08T20:28:43.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-08T20:28:43.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:43.190 INFO:tasks.ceph:role: osd.5 2024-03-08T20:28:43.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:28:43.191 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:43.273 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:43.273 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:43.273 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:43.745 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-03-08T20:28:43.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-03-08T20:28:43.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-08T20:28:43.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-08T20:28:43.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-08T20:28:44.044 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:44.045 INFO:tasks.ceph:role: osd.6 2024-03-08T20:28:44.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:28:44.045 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T20:28:44.130 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:44.131 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:44.645 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-03-08T20:28:44.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-03-08T20:28:44.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-08T20:28:44.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-08T20:28:44.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-08T20:28:45.029 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T20:28:45.029 INFO:tasks.ceph:role: osd.7 2024-03-08T20:28:45.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:28:45.029 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T20:28:45.127 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T20:28:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T20:28:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T20:28:45.128 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T20:28:45.579 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-03-08T20:28:45.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-03-08T20:28:45.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-08T20:28:45.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-08T20:28:45.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:45.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.962+0000 7f9f00d49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-08T20:28:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.965+0000 7f9f00d49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-08T20:28:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.966+0000 7f9f00d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T20:28:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.966+0000 7f9f00d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T20:28:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.966+0000 7f9f00d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T20:28:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:45.969+0000 7f9f00d49640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-08T20:28:49.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-08T20:28:49.251 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.387+0000 7f00eb41d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-08T20:28:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.387+0000 7f00eb41d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-08T20:28:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.387+0000 7f00eb41d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T20:28:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.387+0000 7f00eb41d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T20:28:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.387+0000 7f00eb41d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T20:28:49.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:49.390+0000 7f00eb41d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-08T20:28:51.963 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:51.971 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:28:52.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-08T20:28:52.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.555+0000 7f99d6024640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-08T20:28:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.556+0000 7f99d6024640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-08T20:28:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.556+0000 7f99d6024640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T20:28:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.556+0000 7f99d6024640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T20:28:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.556+0000 7f99d6024640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T20:28:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:52.558+0000 7f99d6024640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-08T20:28:55.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-08T20:28:55.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:28:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.961+0000 7fbefed14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-08T20:28:55.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.962+0000 7fbefed14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-08T20:28:55.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.962+0000 7fbefed14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T20:28:55.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.962+0000 7fbefed14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T20:28:55.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.962+0000 7fbefed14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T20:28:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:28:55.964+0000 7fbefed14640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-08T20:28:58.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-08T20:28:58.988 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-08T20:28:58.988 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:58.988 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-08T20:28:59.087 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.087 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-08T20:28:59.181 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-08T20:28:59.276 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-08T20:28:59.367 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-08T20:28:59.501 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-08T20:28:59.591 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:28:59.591 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-08T20:28:59.726 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:59.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-08T20:28:59.829 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:59.829 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-08T20:28:59.926 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:28:59.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-08T20:29:00.020 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:00.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-08T20:29:00.114 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:00.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-08T20:29:00.210 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:00.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-08T20:29:00.301 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:00.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-08T20:29:00.396 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:00.396 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-08T20:29:00.453 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:00.453 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-08T20:29:00.508 INFO:tasks.ceph:Adding keys to all mons... 2024-03-08T20:29:00.508 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T20:29:00.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T20:29:00.599 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2024-03-08T20:29:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDpdOtlUonOLxAAHcEoyZ/bRkA4fzuIDYBhrQ== 2024-03-08T20:29:00.599 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-03-08T20:29:00.599 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDqdOtlkn/GDBAA7ATEUZ8wTaRBrhNcGZseVA== 2024-03-08T20:29:00.599 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDqdOtlsN/tHBAA+6J/4XhQ4bMKcrdTN54mVg== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDtdOtlfQnNEhAAsn/ZFq/ct9+o1oAvx196Og== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDwdOtlMuR/KxAA1kIs+b51tIdjgEif+rMTmA== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDzdOtlIuW8NBAA3qUjG02OMj8PVHUQOocppw== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQD3dOtliWASAxAAILUSB1/95IUs52Y64fSqyg== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDqdOtlhBoJARAAqK66Ilvdm5GjHLl/HXVW2g== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDqdOtlz0zFLRAAVwNkZTYb4ZzGn/6tp039Ig== 2024-03-08T20:29:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDrdOtl+A1jAhAAuoSCtXcia16gUVl+36RK0Q== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQD9dOtlGeFqORAAMhTstYFJHnuH4oyIXcTG8g== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQABdetlrkcnFxAAap2jScuZQ8VHQROaVZIk2g== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAEdetl14QxIRAA5Aq9xTWg8bkADJT+1Iz8TQ== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAHdetlQ+1fORAAkgtiuCZdEFji9GKsMy/z4A== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDrdOtlBgPQDxAATrPqLtUzSN6ULvlXbqlxwA== 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2024-03-08T20:29:00.601 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDrdOtlApX4GhAA5/5SWYMNr2tEspVj8ASQsw== 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDpdOtlUonOLxAAHcEoyZ/bRkA4fzuIDYBhrQ== 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDqdOtlkn/GDBAA7ATEUZ8wTaRBrhNcGZseVA== 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDqdOtlsN/tHBAA+6J/4XhQ4bMKcrdTN54mVg== 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-03-08T20:29:00.602 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDtdOtlfQnNEhAAsn/ZFq/ct9+o1oAvx196Og== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDwdOtlMuR/KxAA1kIs+b51tIdjgEif+rMTmA== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDzdOtlIuW8NBAA3qUjG02OMj8PVHUQOocppw== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQD3dOtliWASAxAAILUSB1/95IUs52Y64fSqyg== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDqdOtlhBoJARAAqK66Ilvdm5GjHLl/HXVW2g== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDqdOtlz0zFLRAAVwNkZTYb4ZzGn/6tp039Ig== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDrdOtl+A1jAhAAuoSCtXcia16gUVl+36RK0Q== 2024-03-08T20:29:00.603 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQD9dOtlGeFqORAAMhTstYFJHnuH4oyIXcTG8g== 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQABdetlrkcnFxAAap2jScuZQ8VHQROaVZIk2g== 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAEdetl14QxIRAA5Aq9xTWg8bkADJT+1Iz8TQ== 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQAHdetlQ+1fORAAkgtiuCZdEFji9GKsMy/z4A== 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDrdOtlBgPQDxAATrPqLtUzSN6ULvlXbqlxwA== 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-03-08T20:29:00.604 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDrdOtlApX4GhAA5/5SWYMNr2tEspVj8ASQsw== 2024-03-08T20:29:00.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T20:29:00.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T20:29:00.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:00.806 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:00.947 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:00.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:01.099 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:01.679 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T20:29:01.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T20:29:01.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:01.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:01.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:01.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T20:29:02.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.274 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T20:29:02.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T20:29:02.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T20:29:02.868 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T20:29:02.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T20:29:03.018 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-08T20:29:03.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-08T20:29:03.113 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T20:29:03.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-08T20:29:03.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-08T20:29:03.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T20:29:03.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-08T20:29:03.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-08T20:29:03.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T20:29:03.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-08T20:29:04.008 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:29:04.016 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T20:29:04.069 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-08T20:29:04.070 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-08T20:29:04.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-08T20:29:04.077 INFO:tasks.ceph.mon.a:Started 2024-03-08T20:29:04.077 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-08T20:29:04.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-08T20:29:04.084 INFO:tasks.ceph.mon.b:Started 2024-03-08T20:29:04.084 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-08T20:29:04.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-08T20:29:04.091 INFO:tasks.ceph.mon.c:Started 2024-03-08T20:29:04.091 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-08T20:29:04.091 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-08T20:29:04.091 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-08T20:29:04.098 INFO:tasks.ceph.mgr.y:Started 2024-03-08T20:29:04.098 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-08T20:29:04.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-08T20:29:04.103 INFO:tasks.ceph.mgr.x:Started 2024-03-08T20:29:04.103 INFO:tasks.ceph:Setting crush tunables to default 2024-03-08T20:29:04.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2024-03-08T20:29:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.288+0000 7f71b4200640 1 Processor -- start 2024-03-08T20:29:04.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.288+0000 7f71b4200640 1 -- start start 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.289+0000 7f71b4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 0x7f71ac152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.289+0000 7f71b4200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0c4980 con 0x7f71ac06e4b0 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.289+0000 7f71b4200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0c4c60 con 0x7f71ac0c5a20 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.289+0000 7f71b4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0c5590 con 0x7f71ac0c4480 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b1800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f71ac06e4b0 0x7f71ac1541d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38914/0 (socket says 172.21.15.118:38914) 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b1800640 1 -- 172.21.15.118:0/462675475 learned_addr learned my addr 172.21.15.118:0/462675475 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 0x7f71ac152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b0e00640 1 -- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 msgr2=0x7f71ac152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-08T20:29:04.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b0e00640 1 -- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 msgr2=0x7f71ac152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-08T20:29:04.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 0x7f71ac152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-08T20:29:04.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.290+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 0x7f71ac152ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-08T20:29:04.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.291+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982428756 0 0) 0x7f71ac0c4980 con 0x7f71ac06e4b0 2024-03-08T20:29:04.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.291+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7194003520 con 0x7f71ac06e4b0 2024-03-08T20:29:04.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707174151 0 0) 0x7f7194003520 con 0x7f71ac06e4b0 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 msgr2=0x7f71ac152ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 --2- 172.21.15.118:0/462675475 >> v2:172.21.15.144:3300/0 conn(0x7f71ac0c4480 0x7f71ac152ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 >> v1:172.21.15.144:6789/0 conn(0x7f71ac0c5a20 legacy=0x7f71ac06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0c4f40 con 0x7f71ac06e4b0 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f71a0001670 con 0x7f71ac06e4b0 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 >> v1:172.21.15.118:6789/0 conn(0x7f71ac06e4b0 legacy=0x7f71ac1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71940039b0 0x7f7194003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f7194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71940052e0 0x7f719400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c5590 con 0x7f7194004800 2024-03-08T20:29:04.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719400c1e0 con 0x7f71940052e0 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719400c3e0 con 0x7f71940039b0 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71b1800640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71940039b0 0x7f7194003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f7194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.292+0000 7f71b2200640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71940052e0 0x7f719400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b0e00640 1 -- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71940039b0 msgr2=0x7f7194003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71940039b0 0x7f7194003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b0e00640 1 -- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71940052e0 msgr2=0x7f719400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71940052e0 0x7f719400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b0e00640 1 -- 172.21.15.118:0/462675475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194003520 con 0x7f7194004800 2024-03-08T20:29:04.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.293+0000 7f71b2200640 1 -- 172.21.15.118:0/462675475 reap_dead start 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.294+0000 7f71b0e00640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f7194004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7198006fd0 tx=0x7f7194005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdc56ecce2fd985 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.294+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800b5e0 con 0x7f7194004800 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.294+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7198038070 con 0x7f7194004800 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.294+0000 7f71abe00640 1 -- 172.21.15.118:0/462675475 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980338c0 con 0x7f7194004800 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 -- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 msgr2=0x7f7194004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f7194004c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7198006fd0 tx=0x7f7194005830 comp rx=0 tx=0).stop 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 -- 172.21.15.118:0/462675475 shutdown_connections 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 --2- 172.21.15.118:0/462675475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f7194004c80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 -- 172.21.15.118:0/462675475 >> 172.21.15.118:0/462675475 conn(0x7f71ac06b720 msgr2=0x7f71ac0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:04.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 -- 172.21.15.118:0/462675475 shutdown_connections 2024-03-08T20:29:04.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.295+0000 7f71b4200640 1 -- 172.21.15.118:0/462675475 wait complete. 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.297+0000 7f71b4200640 1 Processor -- start 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.297+0000 7f71b4200640 1 -- start start 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 0x7f71ac14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71ac1de410 0x7f71ac1de890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c5e40 con 0x7f7194004800 2024-03-08T20:29:04.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac1505f0 con 0x7f71ac14dad0 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b4200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0a9420 con 0x7f71ac1de410 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53098/0 (socket says 172.21.15.118:53098) 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 -- 172.21.15.118:0/1151579213 learned_addr learned my addr 172.21.15.118:0/1151579213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b0e00640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 0x7f71ac14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b2200640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71ac1de410 0x7f71ac1de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 -- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71ac1de410 msgr2=0x7f71ac1de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71ac1de410 0x7f71ac1de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 -- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 msgr2=0x7f71ac14df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 0x7f71ac14df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b1800640 1 -- 172.21.15.118:0/1151579213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac14e490 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.298+0000 7f71b0e00640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 0x7f71ac14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71b1800640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f71a00072f0 tx=0x7f71a00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f9c0 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0018070 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000fda0 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac072e80 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac1ee670 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f71a001d460 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.299+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f71a0013740 con 0x7f7194004800 2024-03-08T20:29:04.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.300+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac1ee8b0 con 0x7f7194004800 2024-03-08T20:29:04.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.303+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f71ac1ee8b0 con 0x7f7194004800 2024-03-08T20:29:04.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.374+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f71ac074a40 con 0x7f7194004800 2024-03-08T20:29:04.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.377+0000 7f71a9600640 1 -- 172.21.15.118:0/1151579213 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f71a0013940 con 0x7f7194004800 2024-03-08T20:29:04.377 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2024-03-08T20:29:04.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 msgr2=0x7f71ac072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:04.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f71a00072f0 tx=0x7f71a00077b0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 shutdown_connections 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71ac1de410 0x7f71ac1de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac14dad0 0x7f71ac14df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 --2- 172.21.15.118:0/1151579213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7194004800 0x7f71ac072000 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 >> 172.21.15.118:0/1151579213 conn(0x7f71ac06b720 msgr2=0x7f71ac0c0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 shutdown_connections 2024-03-08T20:29:04.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:04.379+0000 7f71b4200640 1 -- 172.21.15.118:0/1151579213 wait complete. 2024-03-08T20:29:04.396 INFO:tasks.ceph:check_enable_crimson: False 2024-03-08T20:29:04.396 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-08T20:29:04.396 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:04.397 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-08T20:29:04.472 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:04.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-08T20:29:04.586 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:04.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-08T20:29:04.708 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:04.708 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-08T20:29:04.831 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:04.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-08T20:29:04.920 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:04.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-08T20:29:05.048 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:05.049 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-08T20:29:05.064 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.064+0000 7f64a2c73040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T20:29:05.085 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.085+0000 7f288bc47040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T20:29:05.132 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.133+0000 7f64a2c73040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T20:29:05.151 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:29:05.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-08T20:29:05.153 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.153+0000 7f288bc47040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T20:29:05.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 01b1df51-561c-4bdc-9173-1adf1ca8360f 0 2024-03-08T20:29:05.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.511+0000 7f0ccb200640 1 Processor -- start 2024-03-08T20:29:05.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.511+0000 7f0ccb200640 1 -- start start 2024-03-08T20:29:05.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0ccb200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0ccb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 0x7f0ccc0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0ccb200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc06c360 con 0x7f0ccc158e40 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0ccb200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc0c3730 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0ccb200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0c3170 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0cc9e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0cca800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 0x7f0ccc0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.512+0000 7f0cc9e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50500/0 (socket says 172.21.15.144:50500) 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cc9e00640 1 -- 172.21.15.144:0/479588570 learned_addr learned my addr 172.21.15.144:0/479588570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cc9e00640 1 -- 172.21.15.144:0/479588570 >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 msgr2=0x7f0ccc0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cc9e00640 1 --2- 172.21.15.144:0/479588570 >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 0x7f0ccc0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cc9e00640 1 -- 172.21.15.144:0/479588570 >> v1:172.21.15.118:6789/0 conn(0x7f0ccc158e40 legacy=0x7f0ccc155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cc9e00640 1 -- 172.21.15.144:0/479588570 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0c3450 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.513+0000 7f0cca800640 1 --2- 172.21.15.144:0/479588570 >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 0x7f0ccc0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.514+0000 7f0cc9e00640 1 --2- 172.21.15.144:0/479588570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0098a0 tx=0x7f0cbc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f87c13c35385e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.514+0000 7f0cc9400640 1 -- 172.21.15.144:0/479588570 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0317c0 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.514+0000 7f0cc9400640 1 -- 172.21.15.144:0/479588570 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc037070 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.514+0000 7f0cc9400640 1 -- 172.21.15.144:0/479588570 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc031b80 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 -- 172.21.15.144:0/479588570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 msgr2=0x7f0ccc06be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 --2- 172.21.15.144:0/479588570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0098a0 tx=0x7f0cbc02b860 comp rx=0 tx=0).stop 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 -- 172.21.15.144:0/479588570 shutdown_connections 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 --2- 172.21.15.144:0/479588570 >> v2:172.21.15.144:3300/0 conn(0x7f0ccc0c51d0 0x7f0ccc0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 --2- 172.21.15.144:0/479588570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc14b8c0 0x7f0ccc06be20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 -- 172.21.15.144:0/479588570 >> 172.21.15.144:0/479588570 conn(0x7f0ccc066c30 msgr2=0x7f0ccc067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:05.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 -- 172.21.15.144:0/479588570 shutdown_connections 2024-03-08T20:29:05.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.515+0000 7f0ccb200640 1 -- 172.21.15.144:0/479588570 wait complete. 2024-03-08T20:29:05.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.517+0000 7f0ccb200640 1 Processor -- start 2024-03-08T20:29:05.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.517+0000 7f0ccb200640 1 -- start start 2024-03-08T20:29:05.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 0x7f0ccc14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ccc158e40 0x7f0ccc14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0c29f0 con 0x7f0ccc14b8c0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc155310 con 0x7f0ccc158e40 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0ccb200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc14bca0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0cc9e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0cc9e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50502/0 (socket says 172.21.15.144:50502) 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0cc9e00640 1 -- 172.21.15.144:0/2529475123 learned_addr learned my addr 172.21.15.144:0/2529475123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0cc3e00640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 0x7f0ccc14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.518+0000 7f0cc9e00640 1 -- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ccc158e40 msgr2=0x7f0ccc14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cca800640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ccc158e40 0x7f0ccc14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc9e00640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ccc158e40 0x7f0ccc14ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc9e00640 1 -- 172.21.15.144:0/2529475123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 msgr2=0x7f0ccc14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc9e00640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 0x7f0ccc14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc9e00640 1 -- 172.21.15.144:0/2529475123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc14cd00 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc3e00640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 0x7f0ccc14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:05.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc9e00640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000c00 tx=0x7f0cbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc032650 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0327f0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc032be0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc14c5d0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc14f170 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.519+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0cbc04c060 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.520+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0cbc0453f0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.520+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc153a30 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.523+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0ccc153a30 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.602+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "01b1df51-561c-4bdc-9173-1adf1ca8360f", "id": 0} v 0) v1 -- 0x7f0ccc06e0e0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.608+0000 7f0cc2000640 1 -- 172.21.15.144:0/2529475123 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01b1df51-561c-4bdc-9173-1adf1ca8360f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ccc06e0e0 con 0x7f0ccc0c51d0 2024-03-08T20:29:05.608 INFO:teuthology.orchestra.run.smithi144.stdout:0 2024-03-08T20:29:05.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.610+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 msgr2=0x7f0ccc1e1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.610+0000 7f0ccb200640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000c00 tx=0x7f0cbc0046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 shutdown_connections 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ccc158e40 0x7f0ccc14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0ccc14b8c0 0x7f0ccc14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 --2- 172.21.15.144:0/2529475123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ccc0c51d0 0x7f0ccc1e1df0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 >> 172.21.15.144:0/2529475123 conn(0x7f0ccc066c30 msgr2=0x7f0ccc153200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 shutdown_connections 2024-03-08T20:29:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.611+0000 7f0ccb200640 1 -- 172.21.15.144:0/2529475123 wait complete. 2024-03-08T20:29:05.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new e1bfca47-c959-416d-b763-27bcdaef4719 1 2024-03-08T20:29:05.778 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.778+0000 7f64a2c73040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T20:29:05.799 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.799+0000 7f288bc47040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T20:29:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.832+0000 7f03ff000640 1 Processor -- start 2024-03-08T20:29:05.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.832+0000 7f03ff000640 1 -- start start 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03ff000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03f81526e0 0x7f03f80c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03ff000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03f80c05d0 0x7f03f8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03ff000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f80c4b60 con 0x7f03f8072860 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03ff000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80c6640 con 0x7f03f81526e0 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03ff000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80c4e40 con 0x7f03f80c05d0 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03fd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03f80c05d0 0x7f03f8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03efe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f03f8072860 0x7f03f81585d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60274/0 (socket says 172.21.15.144:60274) 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03efe00640 1 -- 172.21.15.144:0/3355536176 learned_addr learned my addr 172.21.15.144:0/3355536176 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-03-08T20:29:05.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03f7e00640 1 --2- 172.21.15.144:0/3355536176 >> v2:172.21.15.118:3300/0 conn(0x7f03f81526e0 0x7f03f80c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.834+0000 7f03f7400640 1 -- 172.21.15.144:0/3355536176 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070240366 0 0) 0x7f03f80c4b60 con 0x7f03f8072860 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.835+0000 7f03fd000640 1 -- 172.21.15.144:0/3355536176 >> v2:172.21.15.118:3300/0 conn(0x7f03f81526e0 msgr2=0x7f03f80c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.835+0000 7f03fd000640 1 --2- 172.21.15.144:0/3355536176 >> v2:172.21.15.118:3300/0 conn(0x7f03f81526e0 0x7f03f80c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.835+0000 7f03fd000640 1 -- 172.21.15.144:0/3355536176 >> v1:172.21.15.144:6789/0 conn(0x7f03f8072860 legacy=0x7f03f81585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.835+0000 7f03fd000640 1 -- 172.21.15.144:0/3355536176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80c0df0 con 0x7f03f80c05d0 2024-03-08T20:29:05.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.836+0000 7f03fd000640 1 --2- 172.21.15.144:0/3355536176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8158ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03f806d100 tx=0x7f03f002be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b5f28649b2db9ed server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:05.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.836+0000 7f03f7400640 1 -- 172.21.15.144:0/3355536176 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0039070 con 0x7f03f80c05d0 2024-03-08T20:29:05.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.836+0000 7f03f7400640 1 -- 172.21.15.144:0/3355536176 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f002cbf0 con 0x7f03f80c05d0 2024-03-08T20:29:05.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.836+0000 7f03f7400640 1 -- 172.21.15.144:0/3355536176 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0034440 con 0x7f03f80c05d0 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 -- 172.21.15.144:0/3355536176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 msgr2=0x7f03f8158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 --2- 172.21.15.144:0/3355536176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8158ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03f806d100 tx=0x7f03f002be40 comp rx=0 tx=0).stop 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 -- 172.21.15.144:0/3355536176 shutdown_connections 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 --2- 172.21.15.144:0/3355536176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8158ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 --2- 172.21.15.144:0/3355536176 >> v2:172.21.15.118:3300/0 conn(0x7f03f81526e0 0x7f03f80c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 -- 172.21.15.144:0/3355536176 >> 172.21.15.144:0/3355536176 conn(0x7f03f80c3b80 msgr2=0x7f03f80c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 -- 172.21.15.144:0/3355536176 shutdown_connections 2024-03-08T20:29:05.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.837+0000 7f03ff000640 1 -- 172.21.15.144:0/3355536176 wait complete. 2024-03-08T20:29:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.839+0000 7f03ff000640 1 Processor -- start 2024-03-08T20:29:05.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.839+0000 7f03ff000640 1 -- start start 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03f81526e0 0x7f03f8150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f806ff30 con 0x7f03f81526e0 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8159220 con 0x7f03f80c05d0 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03ff000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80700b0 con 0x7f03f8072860 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50506/0 (socket says 172.21.15.144:50506) 2024-03-08T20:29:05.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 -- 172.21.15.144:0/4015660823 learned_addr learned my addr 172.21.15.144:0/4015660823 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03fd000640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03f81526e0 0x7f03f8150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 -- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 msgr2=0x7f03f8150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 -- 172.21.15.144:0/4015660823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03f81526e0 msgr2=0x7f03f8150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03f81526e0 0x7f03f8150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03f7e00640 1 -- 172.21.15.144:0/4015660823 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f814a880 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.840+0000 7f03efe00640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f7e00640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03e800e870 tx=0x7f03e800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8017070 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800c940 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800cd30 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f814ca50 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f814be00 con 0x7f03f8072860 2024-03-08T20:29:05.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f03e801a070 con 0x7f03f8072860 2024-03-08T20:29:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.841+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f03e8013470 con 0x7f03f8072860 2024-03-08T20:29:05.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.842+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f8074a40 con 0x7f03f8072860 2024-03-08T20:29:05.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.845+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f03f814a880 con 0x7f03f8072860 2024-03-08T20:29:05.850 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.851+0000 7f64a2c73040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T20:29:05.866 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.865+0000 7f288bc47040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T20:29:05.906 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.907+0000 7f64a2c73040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T20:29:05.915 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.916+0000 7f288bc47040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T20:29:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.920+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1bfca47-c959-416d-b763-27bcdaef4719", "id": 1} v 0) v1 -- 0x7f03f80c2530 con 0x7f03f8072860 2024-03-08T20:29:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.926+0000 7f03f4c00640 1 -- 172.21.15.144:0/4015660823 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1bfca47-c959-416d-b763-27bcdaef4719", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f03e8006020 con 0x7f03f8072860 2024-03-08T20:29:05.925 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-03-08T20:29:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 msgr2=0x7f03f814a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03e800e870 tx=0x7f03e800ed30 comp rx=0 tx=0).stop 2024-03-08T20:29:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 shutdown_connections 2024-03-08T20:29:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03f81526e0 0x7f03f8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f80c05d0 0x7f03f8150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 --2- 172.21.15.144:0/4015660823 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03f8072860 0x7f03f814a340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 >> 172.21.15.144:0/4015660823 conn(0x7f03f80c3b80 msgr2=0x7f03f80c59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 shutdown_connections 2024-03-08T20:29:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:05.927+0000 7f03ff000640 1 -- 172.21.15.144:0/4015660823 wait complete. 2024-03-08T20:29:05.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 299b53d1-d7cb-41e9-85e2-c85a2cd18c63 2 2024-03-08T20:29:05.974 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:05.975+0000 7f64a2c73040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T20:29:05.979 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:05.979+0000 7f288bc47040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T20:29:06.028 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.028+0000 7f64a2c73040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T20:29:06.028 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.029+0000 7f288bc47040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T20:29:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.128+0000 7fd224c00640 1 Processor -- start 2024-03-08T20:29:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.128+0000 7fd224c00640 1 -- start start 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd224c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 0x7fd220155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd224c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd220158440 0x7fd2201588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd224c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd220154ed0 con 0x7fd220152540 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd224c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200c8dc0 con 0x7fd220152920 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd224c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd220158e90 con 0x7fd220158440 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd21fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd220158440 0x7fd2201588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd21fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd220158440 0x7fd2201588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43200/0 (socket says 172.21.15.144:43200) 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd21fe00640 1 -- 172.21.15.144:0/2134516786 learned_addr learned my addr 172.21.15.144:0/2134516786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.130+0000 7fd21ea00640 1 --2- 172.21.15.144:0/2134516786 >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 0x7fd220155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.131+0000 7fd21fe00640 1 -- 172.21.15.144:0/2134516786 >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 msgr2=0x7fd220155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.131+0000 7fd21fe00640 1 --2- 172.21.15.144:0/2134516786 >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 0x7fd220155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.131+0000 7fd21fe00640 1 -- 172.21.15.144:0/2134516786 >> v1:172.21.15.118:6789/0 conn(0x7fd220152540 legacy=0x7fd2200c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.131+0000 7fd21fe00640 1 -- 172.21.15.144:0/2134516786 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220159170 con 0x7fd220158440 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.131+0000 7fd21ea00640 1 --2- 172.21.15.144:0/2134516786 >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 0x7fd220155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.132+0000 7fd21fe00640 1 --2- 172.21.15.144:0/2134516786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220158440 0x7fd2201588a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2200c7de0 tx=0x7fd21802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a2a6bc7c56ce97e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.132+0000 7fd21e000640 1 -- 172.21.15.144:0/2134516786 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21802c9f0 con 0x7fd220158440 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.132+0000 7fd21e000640 1 -- 172.21.15.144:0/2134516786 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21802cb90 con 0x7fd220158440 2024-03-08T20:29:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.132+0000 7fd21e000640 1 -- 172.21.15.144:0/2134516786 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180343f0 con 0x7fd220158440 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 -- 172.21.15.144:0/2134516786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220158440 msgr2=0x7fd2201588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 --2- 172.21.15.144:0/2134516786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220158440 0x7fd2201588a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2200c7de0 tx=0x7fd21802be50 comp rx=0 tx=0).stop 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 -- 172.21.15.144:0/2134516786 shutdown_connections 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 --2- 172.21.15.144:0/2134516786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220158440 0x7fd2201588a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 --2- 172.21.15.144:0/2134516786 >> v2:172.21.15.118:3300/0 conn(0x7fd220152920 0x7fd220155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 -- 172.21.15.144:0/2134516786 >> 172.21.15.144:0/2134516786 conn(0x7fd2200ac290 msgr2=0x7fd2200ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 -- 172.21.15.144:0/2134516786 shutdown_connections 2024-03-08T20:29:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.133+0000 7fd224c00640 1 -- 172.21.15.144:0/2134516786 wait complete. 2024-03-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.134+0000 7fd224c00640 1 Processor -- start 2024-03-08T20:29:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.135+0000 7fd224c00640 1 -- start start 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.135+0000 7fd224c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 0x7fd2200c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.135+0000 7fd224c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd224c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220158440 0x7fd2200aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd224c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22006d900 con 0x7fd220152540 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd224c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220155470 con 0x7fd220152920 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd224c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22006da80 con 0x7fd220158440 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43214/0 (socket says 172.21.15.144:43214) 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 -- 172.21.15.144:0/3279206532 learned_addr learned my addr 172.21.15.144:0/3279206532 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21fe00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220158440 0x7fd2200aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21f400640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 0x7fd2200c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 -- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220158440 msgr2=0x7fd2200aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220158440 0x7fd2200aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 -- 172.21.15.144:0/3279206532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 msgr2=0x7fd2200c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 0x7fd2200c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21ea00640 1 -- 172.21.15.144:0/3279206532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2201eb830 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.136+0000 7fd21f400640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 0x7fd2200c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd21ea00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00d7d0 tx=0x7fd20c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004030 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0041d0 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0096a0 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2201eb550 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200aa430 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd20c009840 con 0x7fd220152920 2024-03-08T20:29:06.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.137+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd20c003de0 con 0x7fd220152920 2024-03-08T20:29:06.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.138+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220074a40 con 0x7fd220152920 2024-03-08T20:29:06.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.141+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd20c009b30 con 0x7fd220152920 2024-03-08T20:29:06.159 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.160+0000 7f288bc47040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-08T20:29:06.164 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.165+0000 7f64a2c73040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-08T20:29:06.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.216+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "299b53d1-d7cb-41e9-85e2-c85a2cd18c63", "id": 2} v 0) v1 -- 0x7fd2200c5b50 con 0x7fd220152920 2024-03-08T20:29:06.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.222+0000 7fd217400640 1 -- 172.21.15.144:0/3279206532 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "299b53d1-d7cb-41e9-85e2-c85a2cd18c63", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd20c003610 con 0x7fd220152920 2024-03-08T20:29:06.221 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 msgr2=0x7fd2200aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00d7d0 tx=0x7fd20c00dc90 comp rx=0 tx=0).stop 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 shutdown_connections 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220158440 0x7fd2200aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220152920 0x7fd2200aa950 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 --2- 172.21.15.144:0/3279206532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd220152540 0x7fd2200c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 >> 172.21.15.144:0/3279206532 conn(0x7fd2200ac290 msgr2=0x7fd22006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 shutdown_connections 2024-03-08T20:29:06.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.223+0000 7fd224c00640 1 -- 172.21.15.144:0/3279206532 wait complete. 2024-03-08T20:29:06.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 8d196f08-c34b-4987-9f34-44a3298e6687 3 2024-03-08T20:29:06.241 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.241+0000 7f288bc47040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T20:29:06.248 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.249+0000 7f64a2c73040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T20:29:06.296 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.296+0000 7f288bc47040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T20:29:06.307 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.307+0000 7f64a2c73040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T20:29:06.357 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.358+0000 7f288bc47040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T20:29:06.371 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.371+0000 7f64a2c73040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T20:29:06.412 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.412+0000 7f288bc47040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T20:29:06.428 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.428+0000 7f64a2c73040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T20:29:06.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.436+0000 7fea90a00640 1 Processor -- start 2024-03-08T20:29:06.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.436+0000 7fea90a00640 1 -- start start 2024-03-08T20:29:06.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea90a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fea8c0c8e50 0x7fea8c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea90a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea8c0c77b0 0x7fea8c14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea90a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c152d00 con 0x7fea8c14cde0 2024-03-08T20:29:06.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea90a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c14d240 con 0x7fea8c0c8e50 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea90a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c152fc0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea8c0c77b0 0x7fea8c14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea8c0c77b0 0x7fea8c14c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43230/0 (socket says 172.21.15.144:43230) 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea83e00640 1 -- 172.21.15.144:0/3684051208 learned_addr learned my addr 172.21.15.144:0/3684051208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.438+0000 7fea89e00640 1 --2- 172.21.15.144:0/3684051208 >> v2:172.21.15.118:3300/0 conn(0x7fea8c0c8e50 0x7fea8c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.439+0000 7fea83e00640 1 -- 172.21.15.144:0/3684051208 >> v2:172.21.15.118:3300/0 conn(0x7fea8c0c8e50 msgr2=0x7fea8c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.439+0000 7fea83e00640 1 --2- 172.21.15.144:0/3684051208 >> v2:172.21.15.118:3300/0 conn(0x7fea8c0c8e50 0x7fea8c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.439+0000 7fea83e00640 1 -- 172.21.15.144:0/3684051208 >> v1:172.21.15.118:6789/0 conn(0x7fea8c14cde0 legacy=0x7fea8c1564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:06.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.439+0000 7fea83e00640 1 -- 172.21.15.144:0/3684051208 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c1532a0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.440+0000 7fea83e00640 1 --2- 172.21.15.144:0/3684051208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c0c77b0 0x7fea8c14c8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0c8ae0 tx=0x7fea7402b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52cd8069181e34e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.440+0000 7fea89400640 1 -- 172.21.15.144:0/3684051208 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74038070 con 0x7fea8c0c77b0 2024-03-08T20:29:06.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.440+0000 7fea89400640 1 -- 172.21.15.144:0/3684051208 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7402f050 con 0x7fea8c0c77b0 2024-03-08T20:29:06.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.440+0000 7fea89400640 1 -- 172.21.15.144:0/3684051208 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74031970 con 0x7fea8c0c77b0 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 -- 172.21.15.144:0/3684051208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c0c77b0 msgr2=0x7fea8c14c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 --2- 172.21.15.144:0/3684051208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c0c77b0 0x7fea8c14c8a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0c8ae0 tx=0x7fea7402b7f0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 -- 172.21.15.144:0/3684051208 shutdown_connections 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 --2- 172.21.15.144:0/3684051208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c0c77b0 0x7fea8c14c8a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 --2- 172.21.15.144:0/3684051208 >> v2:172.21.15.118:3300/0 conn(0x7fea8c0c8e50 0x7fea8c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 -- 172.21.15.144:0/3684051208 >> 172.21.15.144:0/3684051208 conn(0x7fea8c066e40 msgr2=0x7fea8c067250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 -- 172.21.15.144:0/3684051208 shutdown_connections 2024-03-08T20:29:06.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.441+0000 7fea90a00640 1 -- 172.21.15.144:0/3684051208 wait complete. 2024-03-08T20:29:06.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.443+0000 7fea90a00640 1 Processor -- start 2024-03-08T20:29:06.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.443+0000 7fea90a00640 1 -- start start 2024-03-08T20:29:06.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea8c0c8e50 0x7fea8c1eb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 0x7fea8c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0c9230 con 0x7fea8c0c8e50 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c153860 con 0x7fea8c14cde0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea90a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0c93b0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50522/0 (socket says 172.21.15.144:50522) 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 -- 172.21.15.144:0/3682084308 learned_addr learned my addr 172.21.15.144:0/3682084308 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea8a800640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 0x7fea8c14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea83e00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea8c0c8e50 0x7fea8c1eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 -- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 msgr2=0x7fea8c14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 0x7fea8c14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 -- 172.21.15.144:0/3682084308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea8c0c8e50 msgr2=0x7fea8c1eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea8c0c8e50 0x7fea8c1eb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea89e00640 1 -- 172.21.15.144:0/3682084308 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c1eaa80 con 0x7fea8c0c77b0 2024-03-08T20:29:06.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.444+0000 7fea8a800640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 0x7fea8c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea89e00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00d5f0 tx=0x7fea7c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0125f0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c019070 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0129d0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c14df00 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c14e4c0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.445+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fea7c012b70 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.446+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fea7c01e8f0 con 0x7fea8c0c77b0 2024-03-08T20:29:06.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.446+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c074a40 con 0x7fea8c0c77b0 2024-03-08T20:29:06.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.449+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fea7c01eb80 con 0x7fea8c0c77b0 2024-03-08T20:29:06.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.528+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8d196f08-c34b-4987-9f34-44a3298e6687", "id": 3} v 0) v1 -- 0x7fea8c151e00 con 0x7fea8c0c77b0 2024-03-08T20:29:06.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.534+0000 7fea82000640 1 -- 172.21.15.144:0/3682084308 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d196f08-c34b-4987-9f34-44a3298e6687", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fea7c01e460 con 0x7fea8c0c77b0 2024-03-08T20:29:06.534 INFO:teuthology.orchestra.run.smithi144.stdout:3 2024-03-08T20:29:06.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 msgr2=0x7fea8c1edff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00d5f0 tx=0x7fea7c00dab0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 shutdown_connections 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea8c14cde0 0x7fea8c14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fea8c0c8e50 0x7fea8c1eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.535+0000 7fea90a00640 1 --2- 172.21.15.144:0/3682084308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea8c0c77b0 0x7fea8c1edff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.536+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 >> 172.21.15.144:0/3682084308 conn(0x7fea8c066e40 msgr2=0x7fea8c0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.536+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 shutdown_connections 2024-03-08T20:29:06.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.536+0000 7fea90a00640 1 -- 172.21.15.144:0/3682084308 wait complete. 2024-03-08T20:29:06.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 1d3c67b7-91bc-4851-b463-62aa11430758 4 2024-03-08T20:29:06.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.738+0000 7fcf0e200640 1 Processor -- start 2024-03-08T20:29:06.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.738+0000 7fcf0e200640 1 -- start start 2024-03-08T20:29:06.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.739+0000 7fcf0e200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.739+0000 7fcf0e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0806c390 con 0x7fcf080c5540 2024-03-08T20:29:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.739+0000 7fcf0e200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf080c7130 con 0x7fcf0814ee90 2024-03-08T20:29:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.739+0000 7fcf0e200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c8880 con 0x7fcf080bdd10 2024-03-08T20:29:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf0ce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf0814ee90 0x7fcf081557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60280/0 (socket says 172.21.15.144:60280) 2024-03-08T20:29:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf0ce00640 1 -- 172.21.15.144:0/255639849 learned_addr learned my addr 172.21.15.144:0/255639849 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-03-08T20:29:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07400640 1 -- 172.21.15.144:0/255639849 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154012646 0 0) 0x7fcf080c7130 con 0x7fcf0814ee90 2024-03-08T20:29:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07400640 1 -- 172.21.15.144:0/255639849 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef0003520 con 0x7fcf0814ee90 2024-03-08T20:29:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07e00640 1 -- 172.21.15.144:0/255639849 >> v1:172.21.15.144:6789/0 conn(0x7fcf0814ee90 legacy=0x7fcf081557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07e00640 1 -- 172.21.15.144:0/255639849 >> v1:172.21.15.118:6789/0 conn(0x7fcf080c5540 legacy=0x7fcf0806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.740+0000 7fcf07e00640 1 -- 172.21.15.144:0/255639849 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080c7410 con 0x7fcf080bdd10 2024-03-08T20:29:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.742+0000 7fcf07e00640 1 --2- 172.21.15.144:0/255639849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080c5000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcef40097d0 tx=0x7fcef402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce014cd4b6b456b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.742+0000 7fcf07400640 1 -- 172.21.15.144:0/255639849 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4035020 con 0x7fcf080bdd10 2024-03-08T20:29:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.742+0000 7fcf07400640 1 -- 172.21.15.144:0/255639849 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4031800 con 0x7fcf080bdd10 2024-03-08T20:29:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.742+0000 7fcf07400640 1 -- 172.21.15.144:0/255639849 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4031bd0 con 0x7fcf080bdd10 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 -- 172.21.15.144:0/255639849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 msgr2=0x7fcf080c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 --2- 172.21.15.144:0/255639849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080c5000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcef40097d0 tx=0x7fcef402b8a0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 -- 172.21.15.144:0/255639849 shutdown_connections 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 --2- 172.21.15.144:0/255639849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080c5000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 -- 172.21.15.144:0/255639849 >> 172.21.15.144:0/255639849 conn(0x7fcf080ac3f0 msgr2=0x7fcf080ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 -- 172.21.15.144:0/255639849 shutdown_connections 2024-03-08T20:29:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.743+0000 7fcf0e200640 1 -- 172.21.15.144:0/255639849 wait complete. 2024-03-08T20:29:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.745+0000 7fcf0e200640 1 Processor -- start 2024-03-08T20:29:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.745+0000 7fcf0e200640 1 -- start start 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf080c5540 0x7fcf080c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 0x7fcf080aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080c79d0 con 0x7fcf080c5540 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0814f270 con 0x7fcf0814ee90 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0e200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0806cfa0 con 0x7fcf080bdd10 2024-03-08T20:29:06.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0ce00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 0x7fcf080aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0ce00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50532/0 (socket says 172.21.15.144:50532) 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf0ce00640 1 -- 172.21.15.144:0/2057985122 learned_addr learned my addr 172.21.15.144:0/2057985122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.746+0000 7fcf07e00640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf080c5540 0x7fcf080c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 -- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 msgr2=0x7fcf080aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 0x7fcf080aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 -- 172.21.15.144:0/2057985122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf080c5540 msgr2=0x7fcf080c0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf080c5540 0x7fcf080c0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 -- 172.21.15.144:0/2057985122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08152550 con 0x7fcf080bdd10 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0d800640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 0x7fcf080aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0ce00640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c440 tx=0x7fcefc00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc017070 con 0x7fcf080bdd10 2024-03-08T20:29:06.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc005ce0 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0814f490 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0072b0 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0814f700 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcefc01a070 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.747+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fcefc007450 con 0x7fcf080bdd10 2024-03-08T20:29:06.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.749+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf080c0b10 con 0x7fcf080bdd10 2024-03-08T20:29:06.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.751+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fcefc021070 con 0x7fcf080bdd10 2024-03-08T20:29:06.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.858+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d3c67b7-91bc-4851-b463-62aa11430758", "id": 4} v 0) v1 -- 0x7fcf08074a40 con 0x7fcf080bdd10 2024-03-08T20:29:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.863+0000 7fcf04c00640 1 -- 172.21.15.144:0/2057985122 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d3c67b7-91bc-4851-b463-62aa11430758", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcefc01c440 con 0x7fcf080bdd10 2024-03-08T20:29:06.863 INFO:teuthology.orchestra.run.smithi144.stdout:4 2024-03-08T20:29:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 msgr2=0x7fcf080ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c440 tx=0x7fcefc00c900 comp rx=0 tx=0).stop 2024-03-08T20:29:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 shutdown_connections 2024-03-08T20:29:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0814ee90 0x7fcf080aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf080c5540 0x7fcf080c0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 --2- 172.21.15.144:0/2057985122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf080bdd10 0x7fcf080ad300 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 >> 172.21.15.144:0/2057985122 conn(0x7fcf080ac3f0 msgr2=0x7fcf080ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 shutdown_connections 2024-03-08T20:29:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:06.864+0000 7fcf0e200640 1 -- 172.21.15.144:0/2057985122 wait complete. 2024-03-08T20:29:06.865 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:06.865+0000 7f288bc47040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-08T20:29:06.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 50af7f9b-0a4e-480e-afef-a451e3408cc5 5 2024-03-08T20:29:06.929 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:06.929+0000 7f64a2c73040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-08T20:29:07.024 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.024+0000 7f288bc47040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T20:29:07.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.069+0000 7ff19b200640 1 Processor -- start 2024-03-08T20:29:07.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.069+0000 7ff19b200640 1 -- start start 2024-03-08T20:29:07.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.070+0000 7ff19b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff19c071d10 0x7ff19c152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.070+0000 7ff19b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff19c066a20 0x7ff19c1525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.070+0000 7ff19b200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c152af0 con 0x7ff19c06bf90 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c155000 con 0x7ff19c071d10 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c0c4b40 con 0x7ff19c066a20 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff19c066a20 0x7ff19c1525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff19c066a20 0x7ff19c1525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43256/0 (socket says 172.21.15.144:43256) 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 -- 172.21.15.144:0/771625657 learned_addr learned my addr 172.21.15.144:0/771625657 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:07.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff199400640 1 --2- 172.21.15.144:0/771625657 >> v2:172.21.15.118:3300/0 conn(0x7ff19c071d10 0x7ff19c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 -- 172.21.15.144:0/771625657 >> v2:172.21.15.118:3300/0 conn(0x7ff19c071d10 msgr2=0x7ff19c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:07.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 --2- 172.21.15.144:0/771625657 >> v2:172.21.15.118:3300/0 conn(0x7ff19c071d10 0x7ff19c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 -- 172.21.15.144:0/771625657 >> v1:172.21.15.118:6789/0 conn(0x7ff19c06bf90 legacy=0x7ff19c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.071+0000 7ff19a800640 1 -- 172.21.15.144:0/771625657 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0c4e00 con 0x7ff19c066a20 2024-03-08T20:29:07.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.072+0000 7ff19a800640 1 --2- 172.21.15.144:0/771625657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c066a20 0x7ff19c1525b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0c6130 tx=0x7ff19402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8555bf1aeb96631e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.073+0000 7ff198a00640 1 -- 172.21.15.144:0/771625657 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19402e070 con 0x7ff19c066a20 2024-03-08T20:29:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.073+0000 7ff198a00640 1 -- 172.21.15.144:0/771625657 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194037070 con 0x7ff19c066a20 2024-03-08T20:29:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.073+0000 7ff198a00640 1 -- 172.21.15.144:0/771625657 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194031a00 con 0x7ff19c066a20 2024-03-08T20:29:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.073+0000 7ff19b200640 1 -- 172.21.15.144:0/771625657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c066a20 msgr2=0x7ff19c1525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.073+0000 7ff19b200640 1 --2- 172.21.15.144:0/771625657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c066a20 0x7ff19c1525b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0c6130 tx=0x7ff19402b880 comp rx=0 tx=0).stop 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 -- 172.21.15.144:0/771625657 shutdown_connections 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 --2- 172.21.15.144:0/771625657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c066a20 0x7ff19c1525b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 --2- 172.21.15.144:0/771625657 >> v2:172.21.15.118:3300/0 conn(0x7ff19c071d10 0x7ff19c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 -- 172.21.15.144:0/771625657 >> 172.21.15.144:0/771625657 conn(0x7ff19c0c35c0 msgr2=0x7ff19c0c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 -- 172.21.15.144:0/771625657 shutdown_connections 2024-03-08T20:29:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.074+0000 7ff19b200640 1 -- 172.21.15.144:0/771625657 wait complete. 2024-03-08T20:29:07.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.075+0000 7ff19b200640 1 Processor -- start 2024-03-08T20:29:07.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.075+0000 7ff19b200640 1 -- start start 2024-03-08T20:29:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 0x7ff19c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 0x7ff19c1edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c155bf0 con 0x7ff19c066a20 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c0c50e0 con 0x7ff19c06bf90 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19b200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c155d70 con 0x7ff19c071d10 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff199400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff19a800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 0x7ff19c1edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff199400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43272/0 (socket says 172.21.15.144:43272) 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.076+0000 7ff199400640 1 -- 172.21.15.144:0/1846364905 learned_addr learned my addr 172.21.15.144:0/1846364905 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199e00640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 0x7ff19c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 -- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 msgr2=0x7ff19c1edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 0x7ff19c1edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 -- 172.21.15.144:0/1846364905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 msgr2=0x7ff19c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 0x7ff19c0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 -- 172.21.15.144:0/1846364905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c158120 con 0x7ff19c06bf90 2024-03-08T20:29:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff19a800640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 0x7ff19c1edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199e00640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 0x7ff19c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.077+0000 7ff199400640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d5d0 tx=0x7ff18400da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1840125f0 con 0x7ff19c06bf90 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184019070 con 0x7ff19c06bf90 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1840129b0 con 0x7ff19c06bf90 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c14ec10 con 0x7ff19c06bf90 2024-03-08T20:29:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c1ee7f0 con 0x7ff19c06bf90 2024-03-08T20:29:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff184012b50 con 0x7ff19c06bf90 2024-03-08T20:29:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.078+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff18401e9e0 con 0x7ff19c06bf90 2024-03-08T20:29:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.079+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c074a40 con 0x7ff19c06bf90 2024-03-08T20:29:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.081+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff18401e460 con 0x7ff19c06bf90 2024-03-08T20:29:07.099 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.099+0000 7f64a2c73040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T20:29:07.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.160+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50af7f9b-0a4e-480e-afef-a451e3408cc5", "id": 5} v 0) v1 -- 0x7ff19c0c4400 con 0x7ff19c06bf90 2024-03-08T20:29:07.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.167+0000 7ff192000640 1 -- 172.21.15.144:0/1846364905 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50af7f9b-0a4e-480e-afef-a451e3408cc5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff18401e640 con 0x7ff19c06bf90 2024-03-08T20:29:07.167 INFO:teuthology.orchestra.run.smithi144.stdout:5 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 msgr2=0x7ff19c1568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d5d0 tx=0x7ff18400da90 comp rx=0 tx=0).stop 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 shutdown_connections 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff19c071d10 0x7ff19c1edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c06bf90 0x7ff19c1568a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 --2- 172.21.15.144:0/1846364905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff19c066a20 0x7ff19c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.168+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 >> 172.21.15.144:0/1846364905 conn(0x7ff19c0c35c0 msgr2=0x7ff19c151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.169+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 shutdown_connections 2024-03-08T20:29:07.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.169+0000 7ff19b200640 1 -- 172.21.15.144:0/1846364905 wait complete. 2024-03-08T20:29:07.178 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.179+0000 7f288bc47040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T20:29:07.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new c7ec4211-d24b-4c39-be77-e838e7b0e61d 6 2024-03-08T20:29:07.233 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.233+0000 7f288bc47040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T20:29:07.258 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.258+0000 7f64a2c73040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T20:29:07.316 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.316+0000 7f64a2c73040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T20:29:07.362 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.362+0000 7f288bc47040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T20:29:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.370+0000 7fcfa2c00640 1 Processor -- start 2024-03-08T20:29:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.370+0000 7fcfa2c00640 1 -- start start 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf9c14cd20 0x7fcf9c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa2c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf9c156110 0x7fcf9c0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa2c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c156960 con 0x7fcf9c0c5720 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa2c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c0c3140 con 0x7fcf9c156110 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c156c40 con 0x7fcf9c14cd20 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.371+0000 7fcfa1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf9c14cd20 0x7fcf9c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa2200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf9c0c5720 0x7fcf9c0c35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60292/0 (socket says 172.21.15.144:60292) 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa2200640 1 -- 172.21.15.144:0/3026539260 learned_addr learned my addr 172.21.15.144:0/3026539260 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa0e00640 1 --2- 172.21.15.144:0/3026539260 >> v2:172.21.15.118:3300/0 conn(0x7fcf9c156110 0x7fcf9c0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa1800640 1 -- 172.21.15.144:0/3026539260 >> v2:172.21.15.118:3300/0 conn(0x7fcf9c156110 msgr2=0x7fcf9c0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa1800640 1 --2- 172.21.15.144:0/3026539260 >> v2:172.21.15.118:3300/0 conn(0x7fcf9c156110 0x7fcf9c0c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa1800640 1 -- 172.21.15.144:0/3026539260 >> v1:172.21.15.144:6789/0 conn(0x7fcf9c0c5720 legacy=0x7fcf9c0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.372+0000 7fcfa1800640 1 -- 172.21.15.144:0/3026539260 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c156f20 con 0x7fcf9c14cd20 2024-03-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.373+0000 7fcfa1800640 1 --2- 172.21.15.144:0/3026539260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c152b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0c6af0 tx=0x7fcf9002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d749d8130596dc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.373+0000 7fcf9be00640 1 -- 172.21.15.144:0/3026539260 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900315a0 con 0x7fcf9c14cd20 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcf9be00640 1 -- 172.21.15.144:0/3026539260 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90037070 con 0x7fcf9c14cd20 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcf9be00640 1 -- 172.21.15.144:0/3026539260 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90031960 con 0x7fcf9c14cd20 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 -- 172.21.15.144:0/3026539260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 msgr2=0x7fcf9c152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/3026539260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c152b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0c6af0 tx=0x7fcf9002b840 comp rx=0 tx=0).stop 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 -- 172.21.15.144:0/3026539260 shutdown_connections 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/3026539260 >> v2:172.21.15.118:3300/0 conn(0x7fcf9c156110 0x7fcf9c0c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/3026539260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c152b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 -- 172.21.15.144:0/3026539260 >> 172.21.15.144:0/3026539260 conn(0x7fcf9c066c30 msgr2=0x7fcf9c067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 -- 172.21.15.144:0/3026539260 shutdown_connections 2024-03-08T20:29:07.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.374+0000 7fcfa2c00640 1 -- 172.21.15.144:0/3026539260 wait complete. 2024-03-08T20:29:07.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.376+0000 7fcfa2c00640 1 Processor -- start 2024-03-08T20:29:07.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.376+0000 7fcfa2c00640 1 -- start start 2024-03-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf9c0c5720 0x7fcf9c1eb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c156740 con 0x7fcf9c0c5720 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c1565c0 con 0x7fcf9c14cd20 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c0c3ce0 con 0x7fcf9c156110 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:50556/0 (socket says 172.21.15.144:50556) 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43296/0 (socket says 172.21.15.144:43296) 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa2200640 1 -- 172.21.15.144:0/2431304153 learned_addr learned my addr 172.21.15.144:0/2431304153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.377+0000 7fcfa1800640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf9c0c5720 0x7fcf9c1eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 -- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 msgr2=0x7fcf9c154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 -- 172.21.15.144:0/2431304153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf9c0c5720 msgr2=0x7fcf9c1eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf9c0c5720 0x7fcf9c1eb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 -- 172.21.15.144:0/2431304153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c153900 con 0x7fcf9c156110 2024-03-08T20:29:07.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa0e00640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2200640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400cbc0 tx=0x7fcf9400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94017070 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400ad40 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c152360 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94012600 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c14d2a0 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.378+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcf9401a070 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.379+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcf9401cdf0 con 0x7fcf9c156110 2024-03-08T20:29:07.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.380+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c152880 con 0x7fcf9c156110 2024-03-08T20:29:07.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.382+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fcf9c152880 con 0x7fcf9c156110 2024-03-08T20:29:07.474 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.474+0000 7f64a2c73040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T20:29:07.475 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.475+0000 7f288bc47040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T20:29:07.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.488+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7ec4211-d24b-4c39-be77-e838e7b0e61d", "id": 6} v 0) v1 -- 0x7fcf9c14d4a0 con 0x7fcf9c156110 2024-03-08T20:29:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.493+0000 7fcf99600640 1 -- 172.21.15.144:0/2431304153 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7ec4211-d24b-4c39-be77-e838e7b0e61d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf9c14d4a0 con 0x7fcf9c156110 2024-03-08T20:29:07.493 INFO:teuthology.orchestra.run.smithi144.stdout:6 2024-03-08T20:29:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 msgr2=0x7fcf9c1512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400cbc0 tx=0x7fcf9400a430 comp rx=0 tx=0).stop 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 shutdown_connections 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf9c156110 0x7fcf9c1512c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf9c14cd20 0x7fcf9c154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 --2- 172.21.15.144:0/2431304153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf9c0c5720 0x7fcf9c1eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 >> 172.21.15.144:0/2431304153 conn(0x7fcf9c066c30 msgr2=0x7fcf9c14bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 shutdown_connections 2024-03-08T20:29:07.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.495+0000 7fcfa2c00640 1 -- 172.21.15.144:0/2431304153 wait complete. 2024-03-08T20:29:07.510 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new d0314da8-813e-45ab-9b4d-54eb9b07008c 7 2024-03-08T20:29:07.594 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.594+0000 7f64a2c73040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T20:29:07.652 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.652+0000 7f288bc47040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.701+0000 7fb653200640 1 Processor -- start 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.701+0000 7fb653200640 1 -- start start 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.702+0000 7fb653200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 0x7fb6540c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.702+0000 7fb653200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6540c5540 0x7fb65406c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.702+0000 7fb653200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65406c390 con 0x7fb65414ee90 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.702+0000 7fb653200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540c8880 con 0x7fb6540bdd10 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.702+0000 7fb653200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65414f270 con 0x7fb6540c5540 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6540c5540 0x7fb65406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6540c5540 0x7fb65406c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43298/0 (socket says 172.21.15.144:43298) 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 -- 172.21.15.144:0/1888681006 learned_addr learned my addr 172.21.15.144:0/1888681006 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb651400640 1 --2- 172.21.15.144:0/1888681006 >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 0x7fb6540c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 -- 172.21.15.144:0/1888681006 >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 msgr2=0x7fb6540c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 --2- 172.21.15.144:0/1888681006 >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 0x7fb6540c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 -- 172.21.15.144:0/1888681006 >> v1:172.21.15.118:6789/0 conn(0x7fb65414ee90 legacy=0x7fb6541557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb652800640 1 -- 172.21.15.144:0/1888681006 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540c7130 con 0x7fb6540c5540 2024-03-08T20:29:07.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.703+0000 7fb651400640 1 --2- 172.21.15.144:0/1888681006 >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 0x7fb6540c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:07.705 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.702+0000 7f288bc47040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.704+0000 7fb652800640 1 --2- 172.21.15.144:0/1888681006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540c5540 0x7fb65406c890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb65406dee0 tx=0x7fb64c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d05530ddd0aedf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.704+0000 7fb650a00640 1 -- 172.21.15.144:0/1888681006 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c02ca80 con 0x7fb6540c5540 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb650a00640 1 -- 172.21.15.144:0/1888681006 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c02cc20 con 0x7fb6540c5540 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb650a00640 1 -- 172.21.15.144:0/1888681006 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0343f0 con 0x7fb6540c5540 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 -- 172.21.15.144:0/1888681006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540c5540 msgr2=0x7fb65406c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 --2- 172.21.15.144:0/1888681006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540c5540 0x7fb65406c890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb65406dee0 tx=0x7fb64c02bee0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 -- 172.21.15.144:0/1888681006 shutdown_connections 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 --2- 172.21.15.144:0/1888681006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540c5540 0x7fb65406c890 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 --2- 172.21.15.144:0/1888681006 >> v2:172.21.15.118:3300/0 conn(0x7fb6540bdd10 0x7fb6540c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 -- 172.21.15.144:0/1888681006 >> 172.21.15.144:0/1888681006 conn(0x7fb6540ac3f0 msgr2=0x7fb6540ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.705+0000 7fb653200640 1 -- 172.21.15.144:0/1888681006 shutdown_connections 2024-03-08T20:29:07.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.706+0000 7fb653200640 1 -- 172.21.15.144:0/1888681006 wait complete. 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.707+0000 7fb653200640 1 Processor -- start 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.707+0000 7fb653200640 1 -- start start 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6540bdd10 0x7fb6541eb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 0x7fb6541510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:07.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c79d0 con 0x7fb6540c5540 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c76f0 con 0x7fb65414ee90 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb653200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65406cdd0 con 0x7fb6540bdd10 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb652800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb651e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6540bdd10 0x7fb6541eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb652800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43300/0 (socket says 172.21.15.144:43300) 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.708+0000 7fb652800640 1 -- 172.21.15.144:0/1609640483 learned_addr learned my addr 172.21.15.144:0/1609640483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-03-08T20:29:07.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb651400640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 0x7fb6541510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:07.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 -- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6540bdd10 msgr2=0x7fb6541eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6540bdd10 0x7fb6541eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 -- 172.21.15.144:0/1609640483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 msgr2=0x7fb6541510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 0x7fb6541510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 -- 172.21.15.144:0/1609640483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540c4090 con 0x7fb65414ee90 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb651400640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 0x7fb6541510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb652800640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009f40 tx=0x7fb64c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c044020 con 0x7fb65414ee90 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c040470 con 0x7fb65414ee90 2024-03-08T20:29:07.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540c4370 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.709+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c009510 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.710+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540c4930 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.710+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb64c047020 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.710+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb64c03edf0 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.711+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb654074a40 con 0x7fb65414ee90 2024-03-08T20:29:07.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.713+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb64c04e030 con 0x7fb65414ee90 2024-03-08T20:29:07.778 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.778+0000 7f64a2c73040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T20:29:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.792+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0314da8-813e-45ab-9b4d-54eb9b07008c", "id": 7} v 0) v1 -- 0x7fb6540c4b00 con 0x7fb65414ee90 2024-03-08T20:29:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.801+0000 7fb64a000640 1 -- 172.21.15.144:0/1609640483 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0314da8-813e-45ab-9b4d-54eb9b07008c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb64c040db0 con 0x7fb65414ee90 2024-03-08T20:29:07.801 INFO:teuthology.orchestra.run.smithi144.stdout:7 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 msgr2=0x7fb65414a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009f40 tx=0x7fb64c004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 shutdown_connections 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65414ee90 0x7fb65414a900 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6540c5540 0x7fb6541510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 --2- 172.21.15.144:0/1609640483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6540bdd10 0x7fb6541eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 >> 172.21.15.144:0/1609640483 conn(0x7fb6540ac3f0 msgr2=0x7fb6540ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 shutdown_connections 2024-03-08T20:29:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-03-08T20:29:07.803+0000 7fb653200640 1 -- 172.21.15.144:0/1609640483 wait complete. 2024-03-08T20:29:07.818 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-08T20:29:07.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-08T20:29:07.825 INFO:tasks.ceph.osd.0:Started 2024-03-08T20:29:07.826 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-08T20:29:07.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-08T20:29:07.831 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:07.831+0000 7f64a2c73040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T20:29:07.833 INFO:tasks.ceph.osd.1:Started 2024-03-08T20:29:07.833 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-08T20:29:07.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-08T20:29:07.839 INFO:tasks.ceph.osd.2:Started 2024-03-08T20:29:07.839 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-08T20:29:07.840 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-08T20:29:07.844 INFO:tasks.ceph.osd.3:Started 2024-03-08T20:29:07.844 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-08T20:29:07.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-08T20:29:07.850 INFO:tasks.ceph.osd.4:Started 2024-03-08T20:29:07.850 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-08T20:29:07.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-08T20:29:07.856 INFO:tasks.ceph.osd.5:Started 2024-03-08T20:29:07.856 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-08T20:29:07.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-08T20:29:07.861 INFO:tasks.ceph.osd.6:Started 2024-03-08T20:29:07.861 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-08T20:29:07.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-08T20:29:07.866 INFO:tasks.ceph.osd.7:Started 2024-03-08T20:29:07.867 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:07.889 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:07.888+0000 7f288bc47040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T20:29:08.066 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:08.066+0000 7f64a2c73040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T20:29:08.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.074+0000 7fa601000640 1 Processor -- start 2024-03-08T20:29:08.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.074+0000 7fa601000640 1 -- start start 2024-03-08T20:29:08.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.075+0000 7fa601000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5fc0ad350 0x7fa5fc0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:08.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.075+0000 7fa601000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5fc0c4950 0x7fa5fc0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:08.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.075+0000 7fa601000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc152d70 con 0x7fa5fc153830 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.075+0000 7fa601000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c7df0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.075+0000 7fa601000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c80d0 con 0x7fa5fc0ad350 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5fc0c4950 0x7fa5fc0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5fc0ad350 0x7fa5fc0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5fc0ad350 0x7fa5fc0ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:36282/0 (socket says 172.21.15.118:36282) 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 -- 172.21.15.118:0/2751410955 learned_addr learned my addr 172.21.15.118:0/2751410955 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 -- 172.21.15.118:0/2751410955 >> v2:172.21.15.118:3300/0 conn(0x7fa5fc0c4950 msgr2=0x7fa5fc0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 --2- 172.21.15.118:0/2751410955 >> v2:172.21.15.118:3300/0 conn(0x7fa5fc0c4950 0x7fa5fc0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 -- 172.21.15.118:0/2751410955 >> v1:172.21.15.118:6789/0 conn(0x7fa5fc153830 legacy=0x7fa5fc0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9400640 1 -- 172.21.15.118:0/2751410955 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502303706 0 0) 0x7fa5fc152d70 con 0x7fa5fc153830 2024-03-08T20:29:08.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.076+0000 7fa5f9e00640 1 -- 172.21.15.118:0/2751410955 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc153030 con 0x7fa5fc0ad350 2024-03-08T20:29:08.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.077+0000 7fa5f9e00640 1 --2- 172.21.15.118:0/2751410955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0ad730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0aadb0 tx=0x7fa5ec02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358076c633eaa30f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:08.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa5f9400640 1 -- 172.21.15.118:0/2751410955 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec02e070 con 0x7fa5fc0ad350 2024-03-08T20:29:08.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa5f9400640 1 -- 172.21.15.118:0/2751410955 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec037070 con 0x7fa5fc0ad350 2024-03-08T20:29:08.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa5f9400640 1 -- 172.21.15.118:0/2751410955 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec031a00 con 0x7fa5fc0ad350 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa601000640 1 -- 172.21.15.118:0/2751410955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 msgr2=0x7fa5fc0ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa601000640 1 --2- 172.21.15.118:0/2751410955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0ad730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0aadb0 tx=0x7fa5ec02b880 comp rx=0 tx=0).stop 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa601000640 1 -- 172.21.15.118:0/2751410955 shutdown_connections 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa601000640 1 --2- 172.21.15.118:0/2751410955 >> v2:172.21.15.118:3300/0 conn(0x7fa5fc0c4950 0x7fa5fc0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.078+0000 7fa601000640 1 --2- 172.21.15.118:0/2751410955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0ad730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.079+0000 7fa601000640 1 -- 172.21.15.118:0/2751410955 >> 172.21.15.118:0/2751410955 conn(0x7fa5fc067330 msgr2=0x7fa5fc0aa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:08.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.079+0000 7fa601000640 1 -- 172.21.15.118:0/2751410955 shutdown_connections 2024-03-08T20:29:08.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.079+0000 7fa601000640 1 -- 172.21.15.118:0/2751410955 wait complete. 2024-03-08T20:29:08.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.080+0000 7fa601000640 1 Processor -- start 2024-03-08T20:29:08.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.080+0000 7fa601000640 1 -- start start 2024-03-08T20:29:08.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:08.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:08.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 0x7fa5fc1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:08.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c4fc0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc153c60 con 0x7fa5fc0ad350 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa601000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc0c5140 con 0x7fa5fc153830 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa5f1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa5f1400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53182/0 (socket says 172.21.15.118:53182) 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa5f1400640 1 -- 172.21.15.118:0/3982469370 learned_addr learned my addr 172.21.15.118:0/3982469370 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.081+0000 7fa5f9e00640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5fa800640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 0x7fa5fc1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 -- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 msgr2=0x7fa5fc1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 0x7fa5fc1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 -- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 msgr2=0x7fa5fc0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 -- 172.21.15.118:0/3982469370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc155840 con 0x7fa5fc0c4950 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5fa800640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 0x7fa5fc1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:08.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f1400640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400e9b0 tx=0x7fa5e400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:08.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4017070 con 0x7fa5fc0c4950 2024-03-08T20:29:08.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400c9a0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400cd90 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.082+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc1e89d0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.083+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc0709f0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.083+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa5e401a070 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.083+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa5e40066f0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.083+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5fc0a82e0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.086+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa5fc0a82e0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.150+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5fc0be7e0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.150+0000 7fa5f2a00640 1 -- 172.21.15.118:0/3982469370 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fa5e40059f0 con 0x7fa5fc0c4950 2024-03-08T20:29:08.150 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:08.150 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":10,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:07.795491+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:08.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.151+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 msgr2=0x7fa5fc154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:08.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.151+0000 7fa601000640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400e9b0 tx=0x7fa5e400ee70 comp rx=0 tx=0).stop 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 shutdown_connections 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5fc153830 0x7fa5fc1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0c4950 0x7fa5fc154160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 --2- 172.21.15.118:0/3982469370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5fc0ad350 0x7fa5fc0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 >> 172.21.15.118:0/3982469370 conn(0x7fa5fc067330 msgr2=0x7fa5fc0c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 shutdown_connections 2024-03-08T20:29:08.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:08.152+0000 7fa601000640 1 -- 172.21.15.118:0/3982469370 wait complete. 2024-03-08T20:29:08.167 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-08T20:29:08.167 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-08T20:29:08.533 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-03-08T20:29:08.533+0000 7f55bf80c640 -1 Falling back to public interface 2024-03-08T20:29:08.539 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-03-08T20:29:08.539+0000 7fc427448640 -1 Falling back to public interface 2024-03-08T20:29:08.539 INFO:tasks.ceph.osd.6.smithi144.stderr:2024-03-08T20:29:08.540+0000 7f2fbd2ac640 -1 Falling back to public interface 2024-03-08T20:29:08.540 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-03-08T20:29:08.540+0000 7fd73cd85640 -1 Falling back to public interface 2024-03-08T20:29:08.547 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-03-08T20:29:08.548+0000 7fab69e0e640 -1 Falling back to public interface 2024-03-08T20:29:08.548 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-03-08T20:29:08.548+0000 7fed5ea15640 -1 Falling back to public interface 2024-03-08T20:29:08.582 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-03-08T20:29:08.583+0000 7f9ab4cc6640 -1 Falling back to public interface 2024-03-08T20:29:08.585 INFO:tasks.ceph.osd.7.smithi144.stderr:2024-03-08T20:29:08.586+0000 7fa58cc19640 -1 Falling back to public interface 2024-03-08T20:29:08.964 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:08.964+0000 7f288bc47040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T20:29:08.972 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:09.129 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.129+0000 7f9b1ca00640 1 Processor -- start 2024-03-08T20:29:09.129 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.129+0000 7f9b1ca00640 1 -- start start 2024-03-08T20:29:09.134 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b1ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b18152570 0x7f9b180c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:09.134 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b1ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9b18158e20 0x7f9b180c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b1ca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180c6c80 con 0x7f9b180c3120 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b1ca00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180c3620 con 0x7f9b18158e20 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b1ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180c3900 con 0x7f9b18152570 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b15400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9b180c3120 0x7f9b18155830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:38946/0 (socket says 172.21.15.118:38946) 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b15400640 1 -- 172.21.15.118:0/1750290347 learned_addr learned my addr 172.21.15.118:0/1750290347 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:09.135 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b15e00640 1 --2- 172.21.15.118:0/1750290347 >> v2:172.21.15.144:3300/0 conn(0x7f9b18152570 0x7f9b180c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.130+0000 7f9b16800640 1 --2- 172.21.15.118:0/1750290347 >> v2:172.21.15.118:3300/0 conn(0x7f9b18158e20 0x7f9b180c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b14a00640 1 -- 172.21.15.118:0/1750290347 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258291594 0 0) 0x7f9b180c6c80 con 0x7f9b180c3120 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b14a00640 1 -- 172.21.15.118:0/1750290347 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc003520 con 0x7f9b180c3120 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b16800640 1 -- 172.21.15.118:0/1750290347 >> v2:172.21.15.144:3300/0 conn(0x7f9b18152570 msgr2=0x7f9b180c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b16800640 1 --2- 172.21.15.118:0/1750290347 >> v2:172.21.15.144:3300/0 conn(0x7f9b18152570 0x7f9b180c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.136 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b16800640 1 -- 172.21.15.118:0/1750290347 >> v1:172.21.15.118:6789/0 conn(0x7f9b180c3120 legacy=0x7f9b18155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.131+0000 7f9b16800640 1 -- 172.21.15.118:0/1750290347 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18155030 con 0x7f9b18158e20 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.132+0000 7f9b16800640 1 --2- 172.21.15.118:0/1750290347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b18158e20 0x7f9b180c8be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b180c6290 tx=0x7f9b1002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0815cdc37ec2dd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.132+0000 7f9b14a00640 1 -- 172.21.15.118:0/1750290347 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10039070 con 0x7f9b18158e20 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.132+0000 7f9b14a00640 1 -- 172.21.15.118:0/1750290347 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1002cbf0 con 0x7f9b18158e20 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.132+0000 7f9b14a00640 1 -- 172.21.15.118:0/1750290347 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10034440 con 0x7f9b18158e20 2024-03-08T20:29:09.137 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 -- 172.21.15.118:0/1750290347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b18158e20 msgr2=0x7f9b180c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/1750290347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b18158e20 0x7f9b180c8be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b180c6290 tx=0x7f9b1002be40 comp rx=0 tx=0).stop 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 -- 172.21.15.118:0/1750290347 shutdown_connections 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/1750290347 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b18158e20 0x7f9b180c8be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/1750290347 >> v2:172.21.15.144:3300/0 conn(0x7f9b18152570 0x7f9b180c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 -- 172.21.15.118:0/1750290347 >> 172.21.15.118:0/1750290347 conn(0x7f9b1806b130 msgr2=0x7f9b1806b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 -- 172.21.15.118:0/1750290347 shutdown_connections 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.133+0000 7f9b1ca00640 1 -- 172.21.15.118:0/1750290347 wait complete. 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.135+0000 7f9b1ca00640 1 Processor -- start 2024-03-08T20:29:09.138 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.135+0000 7f9b1ca00640 1 -- start start 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b18152570 0x7f9b1806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 0x7f9b181ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18159250 con 0x7f9b180c3120 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c9120 con 0x7f9b18158e20 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b1ca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18071290 con 0x7f9b18152570 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:53204/0 (socket says 172.21.15.118:53204) 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 -- 172.21.15.118:0/50977585 learned_addr learned my addr 172.21.15.118:0/50977585 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15400640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b18152570 0x7f9b1806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:09.141 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b16800640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 0x7f9b181ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 -- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b18152570 msgr2=0x7f9b1806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b18152570 0x7f9b1806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 -- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 msgr2=0x7f9b181ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 0x7f9b181ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b15e00640 1 -- 172.21.15.118:0/50977585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180c6850 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.136+0000 7f9b16800640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 0x7f9b181ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b15e00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e9e0 tx=0x7f9b0800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08017070 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800c9d0 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800cdc0 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18070cd0 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b181edd90 con 0x7f9b180c3120 2024-03-08T20:29:09.142 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9b0801a070 con 0x7f9b180c3120 2024-03-08T20:29:09.143 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.137+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9b0801cc10 con 0x7f9b180c3120 2024-03-08T20:29:09.143 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.138+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18074a10 con 0x7f9b180c3120 2024-03-08T20:29:09.143 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.140+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9b0801c540 con 0x7f9b180c3120 2024-03-08T20:29:09.167 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:09.167+0000 7f64a2c73040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T20:29:09.207 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.208+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b180c2140 con 0x7f9b180c3120 2024-03-08T20:29:09.208 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.208+0000 7f9b0e000640 1 -- 172.21.15.118:0/50977585 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9b0801c7e0 con 0x7f9b180c3120 2024-03-08T20:29:09.209 INFO:teuthology.misc.health.smithi118.stdout: 2024-03-08T20:29:09.209 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":10,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:07.795491+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:09.211 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 msgr2=0x7f9b180c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:09.212 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800e9e0 tx=0x7f9b0800eea0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.212 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 shutdown_connections 2024-03-08T20:29:09.212 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b18158e20 0x7f9b181ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.212 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b18152570 0x7f9b1806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.212 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 --2- 172.21.15.118:0/50977585 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9b180c3120 0x7f9b180c6310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:09.213 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 >> 172.21.15.118:0/50977585 conn(0x7f9b1806b130 msgr2=0x7f9b1806be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:09.213 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 shutdown_connections 2024-03-08T20:29:09.213 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:09.210+0000 7f9b1ca00640 1 -- 172.21.15.118:0/50977585 wait complete. 2024-03-08T20:29:09.223 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-08T20:29:09.291 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:09.291+0000 7f288bc47040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T20:29:09.352 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:09.352+0000 7f288bc47040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T20:29:09.484 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:09.484+0000 7f64a2c73040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T20:29:09.486 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:09.487+0000 7f288bc47040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T20:29:09.552 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:09.553+0000 7f64a2c73040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T20:29:09.686 INFO:tasks.ceph.mgr.x.smithi144.stderr:2024-03-08T20:29:09.686+0000 7f64a2c73040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T20:29:10.520 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:10.521+0000 7f282c600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-08T20:29:10.524 INFO:tasks.ceph.mgr.y.smithi118.stderr:2024-03-08T20:29:10.525+0000 7f282c600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-08T20:29:11.823 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-03-08T20:29:11.824+0000 7fd73cd85640 -1 osd.4 0 log_to_monitors true 2024-03-08T20:29:11.876 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-03-08T20:29:11.877+0000 7fc427448640 -1 osd.0 0 log_to_monitors true 2024-03-08T20:29:12.056 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-03-08T20:29:12.056+0000 7f55bf80c640 -1 osd.5 0 log_to_monitors true 2024-03-08T20:29:12.090 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-03-08T20:29:12.091+0000 7fab69e0e640 -1 osd.1 0 log_to_monitors true 2024-03-08T20:29:12.118 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-03-08T20:29:12.118+0000 7fed5ea15640 -1 osd.2 0 log_to_monitors true 2024-03-08T20:29:12.122 INFO:tasks.ceph.osd.6.smithi144.stderr:2024-03-08T20:29:12.123+0000 7f2fbd2ac640 -1 osd.6 0 log_to_monitors true 2024-03-08T20:29:12.157 INFO:tasks.ceph.osd.7.smithi144.stderr:2024-03-08T20:29:12.158+0000 7fa58cc19640 -1 osd.7 0 log_to_monitors true 2024-03-08T20:29:12.178 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-03-08T20:29:12.179+0000 7f9ab4cc6640 -1 osd.3 0 log_to_monitors true 2024-03-08T20:29:14.955 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-03-08T20:29:14.955+0000 7fc422c00640 -1 osd.0 0 waiting for initial osdmap 2024-03-08T20:29:14.963 INFO:tasks.ceph.osd.0.smithi118.stderr:2024-03-08T20:29:14.962+0000 7fc418200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:14.989 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-03-08T20:29:14.989+0000 7fed59400640 -1 osd.2 0 waiting for initial osdmap 2024-03-08T20:29:14.994 INFO:tasks.ceph.osd.2.smithi118.stderr:2024-03-08T20:29:14.993+0000 7fed4f400640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:14.994 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-03-08T20:29:14.995+0000 7fd737c00640 -1 osd.4 0 waiting for initial osdmap 2024-03-08T20:29:15.005 INFO:tasks.ceph.osd.4.smithi144.stderr:2024-03-08T20:29:15.005+0000 7fd72dc00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:15.006 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-03-08T20:29:15.005+0000 7fab64800640 -1 osd.1 0 waiting for initial osdmap 2024-03-08T20:29:15.007 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-03-08T20:29:15.007+0000 7f55ba000640 -1 osd.5 0 waiting for initial osdmap 2024-03-08T20:29:15.007 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-03-08T20:29:15.007+0000 7f9aafc00640 -1 osd.3 0 waiting for initial osdmap 2024-03-08T20:29:15.011 INFO:tasks.ceph.osd.7.smithi144.stderr:2024-03-08T20:29:15.012+0000 7fa587600640 -1 osd.7 0 waiting for initial osdmap 2024-03-08T20:29:15.011 INFO:tasks.ceph.osd.1.smithi118.stderr:2024-03-08T20:29:15.011+0000 7fab5a800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:15.014 INFO:tasks.ceph.osd.3.smithi118.stderr:2024-03-08T20:29:15.014+0000 7f9aa5c00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:15.017 INFO:tasks.ceph.osd.6.smithi144.stderr:2024-03-08T20:29:15.017+0000 7f2fb8c00640 -1 osd.6 0 waiting for initial osdmap 2024-03-08T20:29:15.020 INFO:tasks.ceph.osd.5.smithi144.stderr:2024-03-08T20:29:15.021+0000 7f55b0000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:15.023 INFO:tasks.ceph.osd.7.smithi144.stderr:2024-03-08T20:29:15.024+0000 7fa57d600640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:15.025 INFO:tasks.ceph.osd.6.smithi144.stderr:2024-03-08T20:29:15.025+0000 7f2fae200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T20:29:16.030 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:16.196 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.195+0000 7f2513a00640 1 Processor -- start 2024-03-08T20:29:16.197 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.195+0000 7f2513a00640 1 -- start start 2024-03-08T20:29:16.198 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2513a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 0x7f250c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.198 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2513a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f250c0c2b80 0x7f250c071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.198 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2513a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c0c16b0 con 0x7f250c150ec0 2024-03-08T20:29:16.198 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2513a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c0c3920 con 0x7f250c0c2b80 2024-03-08T20:29:16.198 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2513a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c14e990 con 0x7f250c06f300 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f250be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f250c0c2b80 0x7f250c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2511a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f250c150ec0 0x7f250c151370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48808/0 (socket says 172.21.15.118:48808) 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2511a00640 1 -- 172.21.15.118:0/235411806 learned_addr learned my addr 172.21.15.118:0/235411806 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.197+0000 7f2511000640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 0x7f250c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.198+0000 7f250be00640 1 -- 172.21.15.118:0/235411806 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 msgr2=0x7f250c14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.198+0000 7f250be00640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 0x7f250c14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.198+0000 7f250be00640 1 -- 172.21.15.118:0/235411806 >> v1:172.21.15.118:6789/0 conn(0x7f250c150ec0 legacy=0x7f250c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.198+0000 7f250be00640 1 -- 172.21.15.118:0/235411806 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0711f0 con 0x7f250c0c2b80 2024-03-08T20:29:16.199 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.198+0000 7f2511000640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 0x7f250c14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:16.200 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f250be00640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c0c2b80 0x7f250c071960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097a0 tx=0x7f24f802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9580d1e022cdf91 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.200 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f250b400640 1 -- 172.21.15.118:0/235411806 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8039070 con 0x7f250c0c2b80 2024-03-08T20:29:16.200 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f250b400640 1 -- 172.21.15.118:0/235411806 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f80316f0 con 0x7f250c0c2b80 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f250b400640 1 -- 172.21.15.118:0/235411806 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8031ac0 con 0x7f250c0c2b80 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 -- 172.21.15.118:0/235411806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c0c2b80 msgr2=0x7f250c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c0c2b80 0x7f250c071960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097a0 tx=0x7f24f802b790 comp rx=0 tx=0).stop 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 -- 172.21.15.118:0/235411806 shutdown_connections 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c0c2b80 0x7f250c071960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 --2- 172.21.15.118:0/235411806 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c06f300 0x7f250c14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.199+0000 7f2513a00640 1 -- 172.21.15.118:0/235411806 >> 172.21.15.118:0/235411806 conn(0x7f250c0a8c90 msgr2=0x7f250c06ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.200+0000 7f2513a00640 1 -- 172.21.15.118:0/235411806 shutdown_connections 2024-03-08T20:29:16.201 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.200+0000 7f2513a00640 1 -- 172.21.15.118:0/235411806 wait complete. 2024-03-08T20:29:16.202 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.201+0000 7f2513a00640 1 Processor -- start 2024-03-08T20:29:16.202 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.201+0000 7f2513a00640 1 -- start start 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 0x7f250c0a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 0x7f250c0abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c070fa0 con 0x7f250c06f300 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0c1460 con 0x7f250c0c2b80 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2513a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c071ea0 con 0x7f250c150ec0 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2511000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2511000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44690/0 (socket says 172.21.15.118:44690) 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2511000640 1 -- 172.21.15.118:0/21333134 learned_addr learned my addr 172.21.15.118:0/21333134 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.202+0000 7f2511a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 0x7f250c0abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f250be00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 0x7f250c0a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 -- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 msgr2=0x7f250c0abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.204 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 0x7f250c0abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 -- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 msgr2=0x7f250c0a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 0x7f250c0a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 -- 172.21.15.118:0/21333134 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c1ee720 con 0x7f250c06f300 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 0x7f250c0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f250be00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 0x7f250c0a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2511000640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f250000c820 tx=0x7f250000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500015070 con 0x7f250c06f300 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500007a30 con 0x7f250c06f300 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500007de0 con 0x7f250c06f300 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c0aa410 con 0x7f250c06f300 2024-03-08T20:29:16.205 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.203+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c0aa6f0 con 0x7f250c06f300 2024-03-08T20:29:16.206 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.204+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c074a10 con 0x7f250c06f300 2024-03-08T20:29:16.206 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.205+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7f2500018070 con 0x7f250c06f300 2024-03-08T20:29:16.206 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.206+0000 7f2508c00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 0x7f24ec06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.207 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.206+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f250008a3c0 con 0x7f250c06f300 2024-03-08T20:29:16.207 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.206+0000 7f250be00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 0x7f24ec06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.207 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.207+0000 7f250be00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 0x7f24ec06e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f24f8036000 tx=0x7f24f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.211 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.211+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2500059450 con 0x7f250c06f300 2024-03-08T20:29:16.397 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.396+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f250c0c1240 con 0x7f250c06f300 2024-03-08T20:29:16.398 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.397+0000 7f2508c00640 1 -- 172.21.15.118:0/21333134 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10957 (secure 0 0 0) 0x7f2500058d50 con 0x7f250c06f300 2024-03-08T20:29:16.398 INFO:teuthology.misc.health.smithi118.stdout: 2024-03-08T20:29:16.398 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":13,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:15.946677+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.399+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 msgr2=0x7f24ec06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.399+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 0x7f24ec06e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f24f8036000 tx=0x7f24f8008030 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.399+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 msgr2=0x7f250c1440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f250000c820 tx=0x7f250000cce0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 shutdown_connections 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24ec06bb40 0x7f24ec06e000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250c150ec0 0x7f250c0abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c0c2b80 0x7f250c0a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 --2- 172.21.15.118:0/21333134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250c06f300 0x7f250c1440b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 >> 172.21.15.118:0/21333134 conn(0x7f250c0a8c90 msgr2=0x7f250c14d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 shutdown_connections 2024-03-08T20:29:16.401 INFO:teuthology.misc.health.smithi118.stderr:2024-03-08T20:29:16.400+0000 7f2513a00640 1 -- 172.21.15.118:0/21333134 wait complete. 2024-03-08T20:29:16.413 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-08T20:29:16.413 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-08T20:29:16.414 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-08T20:29:16.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-08T20:29:16.418 INFO:tasks.ceph.mds.a:Started 2024-03-08T20:29:16.418 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-08T20:29:16.419 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-08T20:29:16.422 INFO:tasks.ceph.mds.c:Started 2024-03-08T20:29:16.422 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-08T20:29:16.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-08T20:29:16.430 INFO:tasks.ceph.mds.b:Started 2024-03-08T20:29:16.430 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-08T20:29:16.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-08T20:29:16.437 INFO:tasks.ceph.mds.d:Started 2024-03-08T20:29:16.437 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-08T20:29:16.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:16.563 INFO:tasks.ceph.mds.a.smithi118.stdout:starting mds.a at 2024-03-08T20:29:16.567 INFO:tasks.ceph.mds.c.smithi118.stdout:starting mds.c at 2024-03-08T20:29:16.585 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2024-03-08T20:29:16.586 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2024-03-08T20:29:16.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.618+0000 7f22ade00640 1 Processor -- start 2024-03-08T20:29:16.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.618+0000 7f22ade00640 1 -- start start 2024-03-08T20:29:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22ade00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f22a80a9310 0x7f22a806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22ade00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a806fa50 con 0x7f22a814ed50 2024-03-08T20:29:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22ade00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a8154e90 con 0x7f22a806b790 2024-03-08T20:29:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22ade00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a806fcf0 con 0x7f22a80a9310 2024-03-08T20:29:16.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22a6a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f22a814ed50 0x7f22a80c4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48820/0 (socket says 172.21.15.118:48820) 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22a6a00640 1 -- 172.21.15.118:0/1922748137 learned_addr learned my addr 172.21.15.118:0/1922748137 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.619+0000 7f22a7400640 1 --2- 172.21.15.118:0/1922748137 >> v2:172.21.15.144:3300/0 conn(0x7f22a80a9310 0x7f22a806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.620+0000 7f22a7400640 1 -- 172.21.15.118:0/1922748137 >> v1:172.21.15.144:6789/0 conn(0x7f22a806b790 legacy=0x7f22a8155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.620+0000 7f22a5600640 1 -- 172.21.15.118:0/1922748137 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275496024 0 0) 0x7f22a806fa50 con 0x7f22a814ed50 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.620+0000 7f22a7400640 1 -- 172.21.15.118:0/1922748137 >> v1:172.21.15.118:6789/0 conn(0x7f22a814ed50 legacy=0x7f22a80c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.620+0000 7f22a7400640 1 -- 172.21.15.118:0/1922748137 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a806ffd0 con 0x7f22a80a9310 2024-03-08T20:29:16.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22a7400640 1 --2- 172.21.15.118:0/1922748137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a80a9310 0x7f22a806ef40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009d90 tx=0x7f22a002bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10ba964250fe5c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22a5600640 1 -- 172.21.15.118:0/1922748137 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0039070 con 0x7f22a80a9310 2024-03-08T20:29:16.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22a5600640 1 -- 172.21.15.118:0/1922748137 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a002ca50 con 0x7f22a80a9310 2024-03-08T20:29:16.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22a5600640 1 -- 172.21.15.118:0/1922748137 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a002ce20 con 0x7f22a80a9310 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22ade00640 1 -- 172.21.15.118:0/1922748137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a80a9310 msgr2=0x7f22a806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.621+0000 7f22ade00640 1 --2- 172.21.15.118:0/1922748137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a80a9310 0x7f22a806ef40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009d90 tx=0x7f22a002bd20 comp rx=0 tx=0).stop 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.622+0000 7f22ade00640 1 -- 172.21.15.118:0/1922748137 shutdown_connections 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.622+0000 7f22ade00640 1 --2- 172.21.15.118:0/1922748137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a80a9310 0x7f22a806ef40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.622+0000 7f22ade00640 1 -- 172.21.15.118:0/1922748137 >> 172.21.15.118:0/1922748137 conn(0x7f22a806e790 msgr2=0x7f22a80a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.622+0000 7f22ade00640 1 -- 172.21.15.118:0/1922748137 shutdown_connections 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.622+0000 7f22ade00640 1 -- 172.21.15.118:0/1922748137 wait complete. 2024-03-08T20:29:16.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.623+0000 7f22ade00640 1 Processor -- start 2024-03-08T20:29:16.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.623+0000 7f22ade00640 1 -- start start 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22a806b790 0x7f22a80c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a814ed50 0x7f22a80ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a814f2b0 con 0x7f22a80a9310 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a814f130 con 0x7f22a814ed50 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22ade00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a806f480 con 0x7f22a806b790 2024-03-08T20:29:16.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22a6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22a6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44730/0 (socket says 172.21.15.118:44730) 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22a6000640 1 -- 172.21.15.118:0/51868077 learned_addr learned my addr 172.21.15.118:0/51868077 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.624+0000 7f22a6a00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22a806b790 0x7f22a80c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a7400640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a814ed50 0x7f22a80ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 -- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22a806b790 msgr2=0x7f22a80c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22a806b790 0x7f22a80c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 -- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a814ed50 msgr2=0x7f22a80ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a814ed50 0x7f22a80ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 -- 172.21.15.118:0/51868077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80ac2d0 con 0x7f22a80a9310 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22a6000640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f229400c780 tx=0x7f229400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294017070 con 0x7f22a80a9310 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294005290 con 0x7f22a80a9310 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a80ac5b0 con 0x7f22a80a9310 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229400a880 con 0x7f22a80a9310 2024-03-08T20:29:16.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.625+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a80c7030 con 0x7f22a80a9310 2024-03-08T20:29:16.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.626+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a806cc90 con 0x7f22a80a9310 2024-03-08T20:29:16.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.627+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7f229401a070 con 0x7f22a80a9310 2024-03-08T20:29:16.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.628+0000 7f229f400640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 0x7f228806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:16.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.628+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2294089950 con 0x7f22a80a9310 2024-03-08T20:29:16.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.628+0000 7f22a6a00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 0x7f228806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:16.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.629+0000 7f22a6a00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 0x7f228806e000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2298007c30 tx=0x7f2298007b80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:16.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.633+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f22a806cc90 con 0x7f22a80a9310 2024-03-08T20:29:16.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.818+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22a8074a40 con 0x7f22a80a9310 2024-03-08T20:29:16.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.820+0000 7f229f400640 1 -- 172.21.15.118:0/51868077 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10957 (secure 0 0 0) 0x7f2294058390 con 0x7f22a80a9310 2024-03-08T20:29:16.821 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:16.821 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":13,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:15.946677+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:16.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 msgr2=0x7f228806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 0x7f228806e000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2298007c30 tx=0x7f2298007b80 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 msgr2=0x7f22a80aacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f229400c780 tx=0x7f229400cc40 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 shutdown_connections 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f228806bb40 0x7f228806e000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a814ed50 0x7f22a80ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22a80a9310 0x7f22a80aacb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 --2- 172.21.15.118:0/51868077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22a806b790 0x7f22a80c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 >> 172.21.15.118:0/51868077 conn(0x7f22a806e790 msgr2=0x7f22a80a96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 shutdown_connections 2024-03-08T20:29:16.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:16.823+0000 7f22ade00640 1 -- 172.21.15.118:0/51868077 wait complete. 2024-03-08T20:29:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-08T20:29:16.841 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:17.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.037+0000 7f992b600640 1 Processor -- start 2024-03-08T20:29:17.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.037+0000 7f992b600640 1 -- start start 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f992406af80 0x7f992406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f992406ebd0 0x7f992414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9924150410 0x7f9924152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99241508a0 con 0x7f9924150410 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99240aa980 con 0x7f992406ebd0 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f992b600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99240aac60 con 0x7f992406af80 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9924150410 0x7f9924152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9924150410 0x7f9924152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44734/0 (socket says 172.21.15.118:44734) 2024-03-08T20:29:17.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 -- 172.21.15.118:0/326947448 learned_addr learned my addr 172.21.15.118:0/326947448 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9923e00640 1 --2- 172.21.15.118:0/326947448 >> v2:172.21.15.144:3300/0 conn(0x7f992406ebd0 0x7f992414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9928c00640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f992406af80 0x7f992406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 -- 172.21.15.118:0/326947448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f992406af80 msgr2=0x7f992406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f992406af80 0x7f992406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 -- 172.21.15.118:0/326947448 >> v2:172.21.15.144:3300/0 conn(0x7f992406ebd0 msgr2=0x7f992414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 --2- 172.21.15.118:0/326947448 >> v2:172.21.15.144:3300/0 conn(0x7f992406ebd0 0x7f992414fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.039+0000 7f9929600640 1 -- 172.21.15.118:0/326947448 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99240aaf40 con 0x7f9924150410 2024-03-08T20:29:17.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f9929600640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9924150410 0x7f9924152e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f992406bdd0 tx=0x7f991c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e387c8ac44986d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:17.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f9923400640 1 -- 172.21.15.118:0/326947448 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c02c9e0 con 0x7f9924150410 2024-03-08T20:29:17.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f9923400640 1 -- 172.21.15.118:0/326947448 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c02cb80 con 0x7f9924150410 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f9923400640 1 -- 172.21.15.118:0/326947448 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0343f0 con 0x7f9924150410 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f992b600640 1 -- 172.21.15.118:0/326947448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9924150410 msgr2=0x7f9924152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f992b600640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9924150410 0x7f9924152e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f992406bdd0 tx=0x7f991c02be40 comp rx=0 tx=0).stop 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f992b600640 1 -- 172.21.15.118:0/326947448 shutdown_connections 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f992b600640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9924150410 0x7f9924152e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.041+0000 7f992b600640 1 --2- 172.21.15.118:0/326947448 >> v2:172.21.15.144:3300/0 conn(0x7f992406ebd0 0x7f992414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.042+0000 7f992b600640 1 --2- 172.21.15.118:0/326947448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f992406af80 0x7f992406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.042+0000 7f992b600640 1 -- 172.21.15.118:0/326947448 >> 172.21.15.118:0/326947448 conn(0x7f99240a84c0 msgr2=0x7f99240a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.042+0000 7f992b600640 1 -- 172.21.15.118:0/326947448 shutdown_connections 2024-03-08T20:29:17.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.042+0000 7f992b600640 1 -- 172.21.15.118:0/326947448 wait complete. 2024-03-08T20:29:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.043+0000 7f992b600640 1 Processor -- start 2024-03-08T20:29:17.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.043+0000 7f992b600640 1 -- start start 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992406ebd0 0x7f9924070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9924150410 0x7f9924143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99240c3f90 con 0x7f992406af80 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99240c3e10 con 0x7f992406ebd0 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.044+0000 7f992b600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992406b360 con 0x7f9924150410 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44740/0 (socket says 172.21.15.118:44740) 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 -- 172.21.15.118:0/2403842583 learned_addr learned my addr 172.21.15.118:0/2403842583 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:17.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 -- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9924150410 msgr2=0x7f9924143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9924150410 0x7f9924143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 -- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992406ebd0 msgr2=0x7f9924070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992406ebd0 0x7f9924070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 -- 172.21.15.118:0/2403842583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99241eb120 con 0x7f992406af80 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9928c00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f991800d830 tx=0x7f991800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918018020 con 0x7f992406af80 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99180096a0 con 0x7f992406af80 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918009a70 con 0x7f992406af80 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.045+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99241eb400 con 0x7f992406af80 2024-03-08T20:29:17.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.046+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99241dfa90 con 0x7f992406af80 2024-03-08T20:29:17.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.047+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99241df5a0 con 0x7f992406af80 2024-03-08T20:29:17.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.047+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7f991801b020 con 0x7f992406af80 2024-03-08T20:29:17.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.048+0000 7f9920c00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 0x7f990406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:17.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.048+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f991808a920 con 0x7f992406af80 2024-03-08T20:29:17.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.049+0000 7f9923e00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 0x7f990406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:17.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.049+0000 7f9923e00640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 0x7f990406e000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f99240aa0e0 tx=0x7f9910008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:17.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.053+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9918022030 con 0x7f992406af80 2024-03-08T20:29:17.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.286+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9924074a40 con 0x7f992406af80 2024-03-08T20:29:17.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.287+0000 7f9920c00640 1 -- 172.21.15.118:0/2403842583 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f99180102e0 con 0x7f992406af80 2024-03-08T20:29:17.288 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:17.288 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-08T20:29:17.288 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 2 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.289+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 msgr2=0x7f990406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.289+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 0x7f990406e000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f99240aa0e0 tx=0x7f9910008040 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.289+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 msgr2=0x7f99241dd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.289+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f991800d830 tx=0x7f991800dcf0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 shutdown_connections 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f990406bb40 0x7f990406e000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9924150410 0x7f9924143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992406ebd0 0x7f9924070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 --2- 172.21.15.118:0/2403842583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f992406af80 0x7f99241dd9e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:17.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 >> 172.21.15.118:0/2403842583 conn(0x7f99240a84c0 msgr2=0x7f992406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 shutdown_connections 2024-03-08T20:29:17.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:17.290+0000 7f992b600640 1 -- 172.21.15.118:0/2403842583 wait complete. 2024-03-08T20:29:19.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:19.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.498+0000 7f6e8b200640 1 Processor -- start 2024-03-08T20:29:19.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.498+0000 7f6e8b200640 1 -- start start 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e8b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e840c2320 0x7f6e84151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e8b200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e84152580 con 0x7f6e840a6290 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e8b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e84152860 con 0x7f6e840abc60 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e8b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e840c2790 con 0x7f6e840c2320 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e83400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6e840a6290 0x7f6e840c1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:48824/0 (socket says 172.21.15.118:48824) 2024-03-08T20:29:19.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.500+0000 7f6e83400640 1 -- 172.21.15.118:0/3029623693 learned_addr learned my addr 172.21.15.118:0/3029623693 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:19.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e89200640 1 --2- 172.21.15.118:0/3029623693 >> v2:172.21.15.144:3300/0 conn(0x7f6e840c2320 0x7f6e84151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032044309 0 0) 0x7f6e84152580 con 0x7f6e840a6290 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68003520 con 0x7f6e840a6290 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309537364 0 0) 0x7f6e68003520 con 0x7f6e840a6290 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 >> v2:172.21.15.144:3300/0 conn(0x7f6e840c2320 msgr2=0x7f6e84151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 --2- 172.21.15.118:0/3029623693 >> v2:172.21.15.144:3300/0 conn(0x7f6e840c2320 0x7f6e84151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 >> v1:172.21.15.144:6789/0 conn(0x7f6e840abc60 legacy=0x7f6e8406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84152b40 con 0x7f6e840a6290 2024-03-08T20:29:19.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f6e70001670 con 0x7f6e840a6290 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 >> v1:172.21.15.118:6789/0 conn(0x7f6e840a6290 legacy=0x7f6e840c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004800 0x7f6e68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.501+0000 7f6e82a00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680052e0 0x7f6e6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840c2790 con 0x7f6e680039b0 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800c1b0 con 0x7f6e68004800 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800e5c0 con 0x7f6e680052e0 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83400640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004800 0x7f6e68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e89200640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680052e0 0x7f6e6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 -- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680052e0 msgr2=0x7f6e6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e680052e0 0x7f6e6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 -- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004800 msgr2=0x7f6e68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:19.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e68004800 0x7f6e68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e83e00640 1 -- 172.21.15.118:0/3029623693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68003520 con 0x7f6e680039b0 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.502+0000 7f6e89200640 1 -- 172.21.15.118:0/3029623693 reap_dead start 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.503+0000 7f6e83e00640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e68003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001720 tx=0x7f6e68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2048860e71908e75 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74001370 con 0x7f6e680039b0 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740052d0 con 0x7f6e680039b0 2024-03-08T20:29:19.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e82a00640 1 -- 172.21.15.118:0/3029623693 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74003830 con 0x7f6e680039b0 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e8b200640 1 -- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 msgr2=0x7f6e68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e8b200640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e68003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e74001720 tx=0x7f6e68005830 comp rx=0 tx=0).stop 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e8b200640 1 -- 172.21.15.118:0/3029623693 shutdown_connections 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e8b200640 1 --2- 172.21.15.118:0/3029623693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e68003dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.504+0000 7f6e8b200640 1 -- 172.21.15.118:0/3029623693 >> 172.21.15.118:0/3029623693 conn(0x7f6e840c36e0 msgr2=0x7f6e840c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.505+0000 7f6e8b200640 1 -- 172.21.15.118:0/3029623693 shutdown_connections 2024-03-08T20:29:19.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.505+0000 7f6e8b200640 1 -- 172.21.15.118:0/3029623693 wait complete. 2024-03-08T20:29:19.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.507+0000 7f6e8b200640 1 Processor -- start 2024-03-08T20:29:19.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.507+0000 7f6e8b200640 1 -- start start 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e84153130 0x7f6e8414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e840c0200 0x7f6e841ea500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840c1780 con 0x7f6e680039b0 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84152e20 con 0x7f6e840c0200 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e8b200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840c4b40 con 0x7f6e84153130 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44780/0 (socket says 172.21.15.118:44780) 2024-03-08T20:29:19.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 -- 172.21.15.118:0/2411448496 learned_addr learned my addr 172.21.15.118:0/2411448496 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 -- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e84153130 msgr2=0x7f6e8414ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e84153130 0x7f6e8414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 -- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e840c0200 msgr2=0x7f6e841ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e89200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e840c0200 0x7f6e841ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e840c0200 0x7f6e841ea500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.509+0000 7f6e83e00640 1 -- 172.21.15.118:0/2411448496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84153a50 con 0x7f6e680039b0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e83e00640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e74005040 tx=0x7f6e74001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74041070 con 0x7f6e680039b0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e74005480 con 0x7f6e680039b0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007a30 con 0x7f6e680039b0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e84153d30 con 0x7f6e680039b0 2024-03-08T20:29:19.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.510+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840c0fa0 con 0x7f6e680039b0 2024-03-08T20:29:19.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.511+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84074a40 con 0x7f6e680039b0 2024-03-08T20:29:19.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.512+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7f6e74044070 con 0x7f6e680039b0 2024-03-08T20:29:19.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.513+0000 7f6e7be00640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 0x7f6e6406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.513+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e740ac210 con 0x7f6e680039b0 2024-03-08T20:29:19.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.513+0000 7f6e83400640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 0x7f6e6406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.514+0000 7f6e83400640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 0x7f6e6406e030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e8414db30 tx=0x7f6e70001e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:19.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.519+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6e7407b090 con 0x7f6e680039b0 2024-03-08T20:29:19.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.775+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e8406fe20 con 0x7f6e680039b0 2024-03-08T20:29:19.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.776+0000 7f6e7be00640 1 -- 172.21.15.118:0/2411448496 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f6e7407a990 con 0x7f6e680039b0 2024-03-08T20:29:19.777 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:19.777 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-08T20:29:19.777 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 3 2024-03-08T20:29:19.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.778+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 msgr2=0x7f6e6406e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.778+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 0x7f6e6406e030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e8414db30 tx=0x7f6e70001e30 comp rx=0 tx=0).stop 2024-03-08T20:29:19.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.778+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 msgr2=0x7f6e84155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.778+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e74005040 tx=0x7f6e74001120 comp rx=0 tx=0).stop 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 shutdown_connections 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e6406bb70 0x7f6e6406e030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e840c0200 0x7f6e841ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e84153130 0x7f6e8414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 --2- 172.21.15.118:0/2411448496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e680039b0 0x7f6e84155fb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 >> 172.21.15.118:0/2411448496 conn(0x7f6e840c36e0 msgr2=0x7f6e8406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 shutdown_connections 2024-03-08T20:29:19.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.779+0000 7f6e8b200640 1 -- 172.21.15.118:0/2411448496 wait complete. 2024-03-08T20:29:19.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:19.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.989+0000 7f091f400640 1 Processor -- start 2024-03-08T20:29:19.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.989+0000 7f091f400640 1 -- start start 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091f400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09180bde30 0x7f09180c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091f400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0918155e20 con 0x7f09180c5120 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091f400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180c72c0 con 0x7f09180c8730 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091f400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09180c75a0 con 0x7f09180bde30 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091ca00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f09180c5120 0x7f091806c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36596/0 (socket says 172.21.15.118:36596) 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091ca00640 1 -- 172.21.15.118:0/2119000628 learned_addr learned my addr 172.21.15.118:0/2119000628 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:19.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.990+0000 7f091d400640 1 --2- 172.21.15.118:0/2119000628 >> v2:172.21.15.118:3300/0 conn(0x7f09180bde30 0x7f09180c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.991+0000 7f0917400640 1 -- 172.21.15.118:0/2119000628 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937270955 0 0) 0x7f0918155e20 con 0x7f09180c5120 2024-03-08T20:29:19.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.991+0000 7f0917400640 1 -- 172.21.15.118:0/2119000628 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0900003520 con 0x7f09180c5120 2024-03-08T20:29:19.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.991+0000 7f091d400640 1 -- 172.21.15.118:0/2119000628 >> v1:172.21.15.144:6789/0 conn(0x7f09180c8730 legacy=0x7f091806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:19.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.991+0000 7f091d400640 1 -- 172.21.15.118:0/2119000628 >> v1:172.21.15.118:6789/0 conn(0x7f09180c5120 legacy=0x7f091806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.991+0000 7f091d400640 1 -- 172.21.15.118:0/2119000628 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180c7880 con 0x7f09180bde30 2024-03-08T20:29:19.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.992+0000 7f091d400640 1 --2- 172.21.15.118:0/2119000628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180bde30 0x7f09180c5500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0910009d90 tx=0x7f091002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17edf08c2cdfc850 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:19.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f0917400640 1 -- 172.21.15.118:0/2119000628 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910039070 con 0x7f09180bde30 2024-03-08T20:29:19.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f0917400640 1 -- 172.21.15.118:0/2119000628 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091002cbd0 con 0x7f09180bde30 2024-03-08T20:29:19.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f0917400640 1 -- 172.21.15.118:0/2119000628 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910034440 con 0x7f09180bde30 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f091f400640 1 -- 172.21.15.118:0/2119000628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180bde30 msgr2=0x7f09180c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f091f400640 1 --2- 172.21.15.118:0/2119000628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180bde30 0x7f09180c5500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0910009d90 tx=0x7f091002be20 comp rx=0 tx=0).stop 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f091f400640 1 -- 172.21.15.118:0/2119000628 shutdown_connections 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f091f400640 1 --2- 172.21.15.118:0/2119000628 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180bde30 0x7f09180c5500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.993+0000 7f091f400640 1 -- 172.21.15.118:0/2119000628 >> 172.21.15.118:0/2119000628 conn(0x7f0918072cc0 msgr2=0x7f09180ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.994+0000 7f091f400640 1 -- 172.21.15.118:0/2119000628 shutdown_connections 2024-03-08T20:29:19.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.994+0000 7f091f400640 1 -- 172.21.15.118:0/2119000628 wait complete. 2024-03-08T20:29:19.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.995+0000 7f091f400640 1 Processor -- start 2024-03-08T20:29:19.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.995+0000 7f091f400640 1 -- start start 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09180bde30 0x7f09181e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09180c8730 0x7f09180bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0918155a30 con 0x7f09180c5120 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181558b0 con 0x7f09180c8730 2024-03-08T20:29:19.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f091f400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0918155bb0 con 0x7f09180bde30 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f0917e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f0917e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59246/0 (socket says 172.21.15.118:59246) 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.996+0000 7f0917e00640 1 -- 172.21.15.118:0/1493283961 learned_addr learned my addr 172.21.15.118:0/1493283961 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f091d400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09180c8730 0x7f09180bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f091ca00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09180bde30 0x7f09181e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 -- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09180bde30 msgr2=0x7f09181e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09180bde30 0x7f09181e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 -- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09180c8730 msgr2=0x7f09180bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09180c8730 0x7f09180bee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 -- 172.21.15.118:0/1493283961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09181eaac0 con 0x7f09180c5120 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0917e00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f090400b3f0 tx=0x7f090400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904015020 con 0x7f09180c5120 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904011830 con 0x7f09180c5120 2024-03-08T20:29:19.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904011c20 con 0x7f09180c5120 2024-03-08T20:29:20.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.997+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09181eada0 con 0x7f09180c5120 2024-03-08T20:29:20.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.998+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09181eb360 con 0x7f09180c5120 2024-03-08T20:29:20.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:19.999+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0918074a40 con 0x7f09180c5120 2024-03-08T20:29:20.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.000+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0904018020 con 0x7f09180c5120 2024-03-08T20:29:20.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.001+0000 7f0914c00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 0x7f08f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.001+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f090408a330 con 0x7f09180c5120 2024-03-08T20:29:20.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.001+0000 7f091ca00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 0x7f08f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.001+0000 7f091ca00640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 0x7f08f806e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f090c000f60 tx=0x7f090c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.006+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f090401f030 con 0x7f09180c5120 2024-03-08T20:29:20.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.205+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f091806d6c0 con 0x7f09180c5120 2024-03-08T20:29:20.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.207+0000 7f0914c00640 1 -- 172.21.15.118:0/1493283961 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f09040172c0 con 0x7f09180c5120 2024-03-08T20:29:20.207 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:20.207 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":17,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:19.968113+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.209+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 msgr2=0x7f08f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.209+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 0x7f08f806e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f090c000f60 tx=0x7f090c009040 comp rx=0 tx=0).stop 2024-03-08T20:29:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.209+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 msgr2=0x7f09180be920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.209+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f090400b3f0 tx=0x7f090400b8b0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 shutdown_connections 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f08f806bbd0 0x7f08f806e090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09180c8730 0x7f09180bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09180c5120 0x7f09180be920 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 --2- 172.21.15.118:0/1493283961 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09180bde30 0x7f09181e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 >> 172.21.15.118:0/1493283961 conn(0x7f0918072cc0 msgr2=0x7f091814f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 shutdown_connections 2024-03-08T20:29:20.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.210+0000 7f091f400640 1 -- 172.21.15.118:0/1493283961 wait complete. 2024-03-08T20:29:20.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T20:29:20.231 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:29:20.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.426+0000 7f6e37a00640 1 Processor -- start 2024-03-08T20:29:20.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.427+0000 7f6e37a00640 1 -- start start 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e37a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e37a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e300c4480 0x7f6e301541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e37a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e30154710 con 0x7f6e300c5a20 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e37a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300c5590 con 0x7f6e300c4480 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e37a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300c4980 con 0x7f6e3006e4b0 2024-03-08T20:29:20.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.428+0000 7f6e35000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e2fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e300c4480 0x7f6e301541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:42596/0 (socket says 172.21.15.118:42596) 2024-03-08T20:29:20.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 -- 172.21.15.118:0/2463958398 learned_addr learned my addr 172.21.15.118:0/2463958398 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 -- 172.21.15.118:0/2463958398 >> v2:172.21.15.144:3300/0 conn(0x7f6e300c4480 msgr2=0x7f6e301541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 --2- 172.21.15.118:0/2463958398 >> v2:172.21.15.144:3300/0 conn(0x7f6e300c4480 0x7f6e301541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 -- 172.21.15.118:0/2463958398 >> v1:172.21.15.144:6789/0 conn(0x7f6e300c5a20 legacy=0x7f6e3006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.429+0000 7f6e35000640 1 -- 172.21.15.118:0/2463958398 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300c4c60 con 0x7f6e3006e4b0 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.430+0000 7f6e35000640 1 --2- 172.21.15.118:0/2463958398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009870 tx=0x7f6e2002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a83425c74e6a7a3f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.430+0000 7f6e2f400640 1 -- 172.21.15.118:0/2463958398 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20035020 con 0x7f6e3006e4b0 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e2f400640 1 -- 172.21.15.118:0/2463958398 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20031640 con 0x7f6e3006e4b0 2024-03-08T20:29:20.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e2f400640 1 -- 172.21.15.118:0/2463958398 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2002d040 con 0x7f6e3006e4b0 2024-03-08T20:29:20.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 -- 172.21.15.118:0/2463958398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 msgr2=0x7f6e30152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 --2- 172.21.15.118:0/2463958398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009870 tx=0x7f6e2002b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 -- 172.21.15.118:0/2463958398 shutdown_connections 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 --2- 172.21.15.118:0/2463958398 >> v2:172.21.15.144:3300/0 conn(0x7f6e300c4480 0x7f6e301541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 --2- 172.21.15.118:0/2463958398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e30152ce0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 -- 172.21.15.118:0/2463958398 >> 172.21.15.118:0/2463958398 conn(0x7f6e3006b720 msgr2=0x7f6e300c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 -- 172.21.15.118:0/2463958398 shutdown_connections 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.431+0000 7f6e37a00640 1 -- 172.21.15.118:0/2463958398 wait complete. 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.433+0000 7f6e37a00640 1 Processor -- start 2024-03-08T20:29:20.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.434+0000 7f6e37a00640 1 -- start start 2024-03-08T20:29:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e301dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e300c4480 0x7f6e30070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3006efa0 con 0x7f6e300c5a20 2024-03-08T20:29:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300c5220 con 0x7f6e300c4480 2024-03-08T20:29:20.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e37a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300c5e70 con 0x7f6e3006e4b0 2024-03-08T20:29:20.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e35a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e35a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59256/0 (socket says 172.21.15.118:59256) 2024-03-08T20:29:20.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e35000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e301dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e35a00640 1 -- 172.21.15.118:0/4022360890 learned_addr learned my addr 172.21.15.118:0/4022360890 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.435+0000 7f6e2fe00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e300c4480 0x7f6e30070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 -- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 msgr2=0x7f6e301dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e301dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 -- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e300c4480 msgr2=0x7f6e30070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e300c4480 0x7f6e30070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 -- 172.21.15.118:0/4022360890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3014b780 con 0x7f6e300c5a20 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e35a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c3c0 tx=0x7f6e2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28017070 con 0x7f6e300c5a20 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e280052d0 con 0x7f6e300c5a20 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e301eaf90 con 0x7f6e300c5a20 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28003810 con 0x7f6e300c5a20 2024-03-08T20:29:20.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.436+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e301dff80 con 0x7f6e300c5a20 2024-03-08T20:29:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.438+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e301ead80 con 0x7f6e300c5a20 2024-03-08T20:29:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.438+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6e2801a070 con 0x7f6e300c5a20 2024-03-08T20:29:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.439+0000 7f6e2cc00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 0x7f6e0c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.439+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e280899e0 con 0x7f6e300c5a20 2024-03-08T20:29:20.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.440+0000 7f6e35000640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 0x7f6e0c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.440+0000 7f6e35000640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 0x7f6e0c06e0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036000 tx=0x7f6e2003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.445+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6e280581c0 con 0x7f6e300c5a20 2024-03-08T20:29:20.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.649+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e30074a40 con 0x7f6e300c5a20 2024-03-08T20:29:20.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.650+0000 7f6e2cc00640 1 -- 172.21.15.118:0/4022360890 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e2805c260 con 0x7f6e300c5a20 2024-03-08T20:29:20.651 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:29:20.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 msgr2=0x7f6e0c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 0x7f6e0c06e0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e20036000 tx=0x7f6e2003c040 comp rx=0 tx=0).stop 2024-03-08T20:29:20.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 msgr2=0x7f6e300714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c3c0 tx=0x7f6e2800c880 comp rx=0 tx=0).stop 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 shutdown_connections 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6e0c06bc00 0x7f6e0c06e0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6e300c5a20 0x7f6e300714c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e300c4480 0x7f6e30070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 --2- 172.21.15.118:0/4022360890 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e3006e4b0 0x7f6e301dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 >> 172.21.15.118:0/4022360890 conn(0x7f6e3006b720 msgr2=0x7f6e30155770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:20.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 shutdown_connections 2024-03-08T20:29:20.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.653+0000 7f6e37a00640 1 -- 172.21.15.118:0/4022360890 wait complete. 2024-03-08T20:29:20.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-08T20:29:20.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.878+0000 7f9720800640 1 Processor -- start 2024-03-08T20:29:20.878 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.878+0000 7f9720800640 1 -- start start 2024-03-08T20:29:20.879 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f9720800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806af80 0x7f971806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f9720800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f971806ebd0 0x7f971814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f9720800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97180aa980 con 0x7f9718150410 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f9720800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97181508a0 con 0x7f971806ebd0 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f9720800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97180aac60 con 0x7f971806af80 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971d400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f971806ebd0 0x7f971814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971e800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9718150410 0x7f9718152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36606/0 (socket says 172.21.15.118:36606) 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971e800640 1 -- 172.21.15.118:0/976389550 learned_addr learned my addr 172.21.15.118:0/976389550 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:20.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971de00640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806af80 0x7f971806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971d400640 1 -- 172.21.15.118:0/976389550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806af80 msgr2=0x7f971806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971d400640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806af80 0x7f971806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971d400640 1 -- 172.21.15.118:0/976389550 >> v1:172.21.15.118:6789/0 conn(0x7f9718150410 legacy=0x7f9718152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971d400640 1 -- 172.21.15.118:0/976389550 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97180aaf40 con 0x7f971806ebd0 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.880+0000 7f971ca00640 1 -- 172.21.15.118:0/976389550 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366681986 0 0) 0x7f97180aa980 con 0x7f9718150410 2024-03-08T20:29:20.881 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f971d400640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806ebd0 0x7f971814fed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f97080097a0 tx=0x7f970802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23334a456bd56e59 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f971ca00640 1 -- 172.21.15.118:0/976389550 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080315a0 con 0x7f971806ebd0 2024-03-08T20:29:20.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f971ca00640 1 -- 172.21.15.118:0/976389550 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708037070 con 0x7f971806ebd0 2024-03-08T20:29:20.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f971ca00640 1 -- 172.21.15.118:0/976389550 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708031960 con 0x7f971806ebd0 2024-03-08T20:29:20.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f9720800640 1 -- 172.21.15.118:0/976389550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806ebd0 msgr2=0x7f971814fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.881+0000 7f9720800640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806ebd0 0x7f971814fed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f97080097a0 tx=0x7f970802b840 comp rx=0 tx=0).stop 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 -- 172.21.15.118:0/976389550 shutdown_connections 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806ebd0 0x7f971814fed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 --2- 172.21.15.118:0/976389550 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806af80 0x7f971806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 -- 172.21.15.118:0/976389550 >> 172.21.15.118:0/976389550 conn(0x7f97180a84c0 msgr2=0x7f97180a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 -- 172.21.15.118:0/976389550 shutdown_connections 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.882+0000 7f9720800640 1 -- 172.21.15.118:0/976389550 wait complete. 2024-03-08T20:29:20.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.883+0000 7f9720800640 1 Processor -- start 2024-03-08T20:29:20.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.883+0000 7f9720800640 1 -- start start 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806ebd0 0x7f971813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9718150410 0x7f971813fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180c3f90 con 0x7f971806af80 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97180c3e10 con 0x7f9718150410 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.884+0000 7f9720800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971806b360 con 0x7f971806ebd0 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59272/0 (socket says 172.21.15.118:59272) 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 -- 172.21.15.118:0/1487657105 learned_addr learned my addr 172.21.15.118:0/1487657105 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971d400640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806ebd0 0x7f971813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 -- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806ebd0 msgr2=0x7f971813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806ebd0 0x7f971813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971e800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9718150410 0x7f971813fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 -- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9718150410 msgr2=0x7f971813fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9718150410 0x7f971813fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 -- 172.21.15.118:0/1487657105 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718140400 con 0x7f971806af80 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f971de00640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f970c00e870 tx=0x7f970c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.885+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c017070 con 0x7f971806af80 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.886+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970c00c940 con 0x7f971806af80 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.886+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970c00cd30 con 0x7f971806af80 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.886+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9718148a10 con 0x7f971806af80 2024-03-08T20:29:20.887 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.886+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97181eb480 con 0x7f971806af80 2024-03-08T20:29:20.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.887+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718074a40 con 0x7f971806af80 2024-03-08T20:29:20.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.888+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f970c01a070 con 0x7f971806af80 2024-03-08T20:29:20.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.889+0000 7f9712000640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 0x7f96fc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:20.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.889+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f970c08a600 con 0x7f971806af80 2024-03-08T20:29:20.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.889+0000 7f971d400640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 0x7f96fc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:20.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.889+0000 7f971d400640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 0x7f96fc06e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9708036000 tx=0x7f9708008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:20.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:20.893+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f970c059430 con 0x7f971806af80 2024-03-08T20:29:21.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.097+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f97180a8c20 con 0x7f971806af80 2024-03-08T20:29:21.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.098+0000 7f9712000640 1 -- 172.21.15.118:0/1487657105 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f970c058d30 con 0x7f971806af80 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout:[ 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: { 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: "poolnum": 1, 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: "poolname": ".mgr" 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-03-08T20:29:21.099 INFO:teuthology.orchestra.run.smithi118.stdout:] 2024-03-08T20:29:21.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 msgr2=0x7f96fc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 0x7f96fc06e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9708036000 tx=0x7f9708008030 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 msgr2=0x7f97180bfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f970c00e870 tx=0x7f970c00ed30 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 shutdown_connections 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f96fc06bbd0 0x7f96fc06e090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9718150410 0x7f971813fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f971806ebd0 0x7f971813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 --2- 172.21.15.118:0/1487657105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f971806af80 0x7f97180bfac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 >> 172.21.15.118:0/1487657105 conn(0x7f97180a84c0 msgr2=0x7f971814ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 shutdown_connections 2024-03-08T20:29:21.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.101+0000 7f9720800640 1 -- 172.21.15.118:0/1487657105 wait complete. 2024-03-08T20:29:21.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-08T20:29:21.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-08T20:29:21.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.331+0000 7f5fe4800640 1 Processor -- start 2024-03-08T20:29:21.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.331+0000 7f5fe4800640 1 -- start start 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe4800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fdc0c1020 0x7f5fdc0c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe4800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc152d00 con 0x7f5fdc06e000 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe4800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc152fc0 con 0x7f5fdc0a9760 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe4800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc153bd0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fdc0c1020 0x7f5fdc0c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe2800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5fdc06e000 0x7f5fdc06e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36612/0 (socket says 172.21.15.118:36612) 2024-03-08T20:29:21.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.333+0000 7f5fe2800640 1 -- 172.21.15.118:0/1415301577 learned_addr learned my addr 172.21.15.118:0/1415301577 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.334+0000 7f5fe1e00640 1 -- 172.21.15.118:0/1415301577 >> v1:172.21.15.144:6789/0 conn(0x7f5fdc0a9760 legacy=0x7f5fdc0a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.334+0000 7f5fe1e00640 1 -- 172.21.15.118:0/1415301577 >> v1:172.21.15.118:6789/0 conn(0x7f5fdc06e000 legacy=0x7f5fdc06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.334+0000 7f5fe1e00640 1 -- 172.21.15.118:0/1415301577 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc1532a0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.334+0000 7f5fe0a00640 1 -- 172.21.15.118:0/1415301577 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657434765 0 0) 0x7f5fdc152d00 con 0x7f5fdc06e000 2024-03-08T20:29:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.335+0000 7f5fe1e00640 1 --2- 172.21.15.118:0/1415301577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc0c1400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097a0 tx=0x7f5fd002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e4e536b776d2f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.335+0000 7f5fe0a00640 1 -- 172.21.15.118:0/1415301577 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0035020 con 0x7f5fdc0c1020 2024-03-08T20:29:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.335+0000 7f5fe0a00640 1 -- 172.21.15.118:0/1415301577 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0031830 con 0x7f5fdc0c1020 2024-03-08T20:29:21.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.335+0000 7f5fe0a00640 1 -- 172.21.15.118:0/1415301577 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0031c00 con 0x7f5fdc0c1020 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 -- 172.21.15.118:0/1415301577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc0c1020 msgr2=0x7f5fdc0c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 --2- 172.21.15.118:0/1415301577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc0c1400 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097a0 tx=0x7f5fd002b8d0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 -- 172.21.15.118:0/1415301577 shutdown_connections 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 --2- 172.21.15.118:0/1415301577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc0c1400 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 -- 172.21.15.118:0/1415301577 >> 172.21.15.118:0/1415301577 conn(0x7f5fdc0a8cb0 msgr2=0x7f5fdc06ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 -- 172.21.15.118:0/1415301577 shutdown_connections 2024-03-08T20:29:21.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.336+0000 7f5fe4800640 1 -- 172.21.15.118:0/1415301577 wait complete. 2024-03-08T20:29:21.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.338+0000 7f5fe4800640 1 Processor -- start 2024-03-08T20:29:21.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.338+0000 7f5fe4800640 1 -- start start 2024-03-08T20:29:21.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc06e000 0x7f5fdc0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:21.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fdc0a9760 0x7f5fdc1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:21.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:21.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc06eb80 con 0x7f5fdc0c1020 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc153860 con 0x7f5fdc06e000 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe4800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc06ed00 con 0x7f5fdc0a9760 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59288/0 (socket says 172.21.15.118:59288) 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 -- 172.21.15.118:0/908250058 learned_addr learned my addr 172.21.15.118:0/908250058 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe1e00640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc06e000 0x7f5fdc0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe1400640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fdc0a9760 0x7f5fdc1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:21.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 -- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fdc0a9760 msgr2=0x7f5fdc1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fdc0a9760 0x7f5fdc1419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 -- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc06e000 msgr2=0x7f5fdc0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc06e000 0x7f5fdc0bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.339+0000 7f5fe2800640 1 -- 172.21.15.118:0/908250058 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc1eb8f0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fe2800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c7a0 tx=0x7f5fd800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8018070 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800a640 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0722f0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800aab0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.340+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc1eb5a0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.341+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fdc0720e0 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.342+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5fd801b070 con 0x7f5fdc0c1020 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.343+0000 7f5fd6000640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 0x7f5fc006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:21.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.343+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5fd8089c00 con 0x7f5fdc0c1020 2024-03-08T20:29:21.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.343+0000 7f5fe1e00640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 0x7f5fc006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:21.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.344+0000 7f5fe1e00640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 0x7f5fc006e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0036000 tx=0x7f5fd003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:21.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.348+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5fd8090080 con 0x7f5fdc0c1020 2024-03-08T20:29:21.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:21.550+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5fdc074a40 con 0x7f5fdc0c1020 2024-03-08T20:29:22.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:29:22.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:29:22.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.191+0000 7f5fd6000640 1 -- 172.21.15.118:0/908250058 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5fd8058480 con 0x7f5fdc0c1020 2024-03-08T20:29:22.191 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' created 2024-03-08T20:29:22.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 msgr2=0x7f5fc006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 0x7f5fc006e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0036000 tx=0x7f5fd003c040 comp rx=0 tx=0).stop 2024-03-08T20:29:22.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 msgr2=0x7f5fdc141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c7a0 tx=0x7f5fd800cc60 comp rx=0 tx=0).stop 2024-03-08T20:29:22.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 shutdown_connections 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5fc006bbd0 0x7f5fc006e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5fdc0c1020 0x7f5fdc141f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5fdc0a9760 0x7f5fdc1419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.195+0000 7f5fe4800640 1 --2- 172.21.15.118:0/908250058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fdc06e000 0x7f5fdc0bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.196+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 >> 172.21.15.118:0/908250058 conn(0x7f5fdc0a8cb0 msgr2=0x7f5fdc06ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.196+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 shutdown_connections 2024-03-08T20:29:22.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.196+0000 7f5fe4800640 1 -- 172.21.15.118:0/908250058 wait complete. 2024-03-08T20:29:22.223 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-08T20:29:22.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.468+0000 7f934aa00640 1 Processor -- start 2024-03-08T20:29:22.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.469+0000 7f934aa00640 1 -- start start 2024-03-08T20:29:22.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f934aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f93441564b0 0x7f93440c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f934aa00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9344157180 con 0x7f93440c1090 2024-03-08T20:29:22.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f934aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440c66e0 con 0x7f9344066d80 2024-03-08T20:29:22.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f934aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440c3550 con 0x7f93441564b0 2024-03-08T20:29:22.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f9343400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f93440c1090 0x7f93440c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36620/0 (socket says 172.21.15.118:36620) 2024-03-08T20:29:22.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f9343400640 1 -- 172.21.15.118:0/3910092556 learned_addr learned my addr 172.21.15.118:0/3910092556 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:22.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f9343e00640 1 --2- 172.21.15.118:0/3910092556 >> v2:172.21.15.144:3300/0 conn(0x7f93441564b0 0x7f93440c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.470+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735864702 0 0) 0x7f9344157180 con 0x7f93440c1090 2024-03-08T20:29:22.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9328003520 con 0x7f93440c1090 2024-03-08T20:29:22.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668907412 0 0) 0x7f9328003520 con 0x7f93440c1090 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 >> v2:172.21.15.144:3300/0 conn(0x7f93441564b0 msgr2=0x7f93440c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 --2- 172.21.15.118:0/3910092556 >> v2:172.21.15.144:3300/0 conn(0x7f93441564b0 0x7f93440c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 >> v1:172.21.15.144:6789/0 conn(0x7f9344066d80 legacy=0x7f934414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344156ea0 con 0x7f93440c1090 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f93340019f0 con 0x7f93440c1090 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 >> v1:172.21.15.118:6789/0 conn(0x7f93440c1090 legacy=0x7f93440c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93280039b0 0x7f9328003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9328004800 0x7f9328004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f932800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932800c0c0 con 0x7f93280051c0 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932800c270 con 0x7f9328004800 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932800c470 con 0x7f93280039b0 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.471+0000 7f9348a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f932800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9343e00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93280039b0 0x7f9328003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9343400640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9328004800 0x7f9328004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9348a00640 1 -- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93280039b0 msgr2=0x7f9328003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9348a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f93280039b0 0x7f9328003db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9348a00640 1 -- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9328004800 msgr2=0x7f9328004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9348a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9328004800 0x7f9328004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9348a00640 1 -- 172.21.15.118:0/3910092556 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328003520 con 0x7f93280051c0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.472+0000 7f9343400640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9328004800 0x7f9328004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f9348a00640 1 -- 172.21.15.118:0/3910092556 reap_dead start 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f9348a00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f932800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f933c003db0 tx=0x7f9328005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1062c51147653e05 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c003980 con 0x7f93280051c0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c007240 con 0x7f93280051c0 2024-03-08T20:29:22.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f9342a00640 1 -- 172.21.15.118:0/3910092556 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c007630 con 0x7f93280051c0 2024-03-08T20:29:22.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f934aa00640 1 -- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 msgr2=0x7f932800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.473+0000 7f934aa00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f932800b9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f933c003db0 tx=0x7f9328005830 comp rx=0 tx=0).stop 2024-03-08T20:29:22.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.474+0000 7f934aa00640 1 -- 172.21.15.118:0/3910092556 shutdown_connections 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.474+0000 7f934aa00640 1 --2- 172.21.15.118:0/3910092556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f932800b9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.474+0000 7f934aa00640 1 -- 172.21.15.118:0/3910092556 >> 172.21.15.118:0/3910092556 conn(0x7f93440c3b80 msgr2=0x7f93440c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.474+0000 7f934aa00640 1 -- 172.21.15.118:0/3910092556 shutdown_connections 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.474+0000 7f934aa00640 1 -- 172.21.15.118:0/3910092556 wait complete. 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.475+0000 7f934aa00640 1 Processor -- start 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.475+0000 7f934aa00640 1 -- start start 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93441457c0 0x7f9344144c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9344153e90 0x7f9344145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c1d30 con 0x7f93280051c0 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c1a50 con 0x7f93441457c0 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.476+0000 7f934aa00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c4eb0 con 0x7f9344153e90 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59310/0 (socket says 172.21.15.118:59310) 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 -- 172.21.15.118:0/2169616683 learned_addr learned my addr 172.21.15.118:0/2169616683 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 -- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9344153e90 msgr2=0x7f9344145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9344153e90 0x7f9344145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 -- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93441457c0 msgr2=0x7f9344144c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93441457c0 0x7f9344144c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 -- 172.21.15.118:0/2169616683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93441df3c0 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f9343e00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f932c010860 tx=0x7f932c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00f040 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00eb60 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.477+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93441df6a0 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.478+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c01c400 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.478+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93441dfc60 con 0x7f93280051c0 2024-03-08T20:29:22.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.479+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9344074a40 con 0x7f93280051c0 2024-03-08T20:29:22.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.480+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f932c01c5a0 con 0x7f93280051c0 2024-03-08T20:29:22.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.481+0000 7f933be00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 0x7f932006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:22.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.481+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f932c08b090 con 0x7f93280051c0 2024-03-08T20:29:22.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.481+0000 7f9343400640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 0x7f932006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:22.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.482+0000 7f9343400640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 0x7f932006e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9334001350 tx=0x7f9334009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:22.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.487+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f932c018030 con 0x7f93280051c0 2024-03-08T20:29:22.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:22.682+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f9344066b60 con 0x7f93280051c0 2024-03-08T20:29:23.208 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.208+0000 7f933be00640 1 -- 172.21.15.118:0/2169616683 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f932c059cc0 con 0x7f93280051c0 2024-03-08T20:29:23.208 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' created 2024-03-08T20:29:23.211 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.211+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 msgr2=0x7f932006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.211+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 0x7f932006e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9334001350 tx=0x7f9334009040 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.211+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 msgr2=0x7f9344149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.211+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f932c010860 tx=0x7f932c010d20 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 shutdown_connections 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f932006bc00 0x7f932006e0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9344153e90 0x7f9344145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93441457c0 0x7f9344144c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 --2- 172.21.15.118:0/2169616683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93280051c0 0x7f9344149df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 >> 172.21.15.118:0/2169616683 conn(0x7f93440c3b80 msgr2=0x7f9344072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 shutdown_connections 2024-03-08T20:29:23.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.212+0000 7f934aa00640 1 -- 172.21.15.118:0/2169616683 wait complete. 2024-03-08T20:29:23.243 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-08T20:29:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.426+0000 7ffb94000640 1 Processor -- start 2024-03-08T20:29:23.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.427+0000 7ffb94000640 1 -- start start 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb8c0c5ad0 0x7ffb8c152110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb8c0c29a0 0x7ffb8c152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c06cf90 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c156190 con 0x7ffb8c0c5ad0 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb94000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0c6390 con 0x7ffb8c072f40 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb8c0c29a0 0x7ffb8c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb8c0c29a0 0x7ffb8c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59320/0 (socket says 172.21.15.118:59320) 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 -- 172.21.15.118:0/1218131430 learned_addr learned my addr 172.21.15.118:0/1218131430 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb91600640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 -- 172.21.15.118:0/1218131430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 msgr2=0x7ffb8c0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c0c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 -- 172.21.15.118:0/1218131430 >> v2:172.21.15.144:3300/0 conn(0x7ffb8c0c5ad0 msgr2=0x7ffb8c152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb90c00640 1 --2- 172.21.15.118:0/1218131430 >> v2:172.21.15.144:3300/0 conn(0x7ffb8c0c5ad0 0x7ffb8c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.428+0000 7ffb92000640 1 --2- 172.21.15.118:0/1218131430 >> v2:172.21.15.144:3300/0 conn(0x7ffb8c0c5ad0 0x7ffb8c152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.429+0000 7ffb92000640 1 -- 172.21.15.118:0/1218131430 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c155610 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.429+0000 7ffb92000640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c152650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06f420 tx=0x7ffb8402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7953a8f3e1a5773a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb8be00640 1 -- 172.21.15.118:0/1218131430 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8402ca70 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb8be00640 1 -- 172.21.15.118:0/1218131430 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8402cc10 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb8be00640 1 -- 172.21.15.118:0/1218131430 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840343f0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 -- 172.21.15.118:0/1218131430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 msgr2=0x7ffb8c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c152650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c06f420 tx=0x7ffb8402bed0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 -- 172.21.15.118:0/1218131430 shutdown_connections 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c152650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 --2- 172.21.15.118:0/1218131430 >> v2:172.21.15.144:3300/0 conn(0x7ffb8c0c5ad0 0x7ffb8c152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 --2- 172.21.15.118:0/1218131430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.430+0000 7ffb94000640 1 -- 172.21.15.118:0/1218131430 >> 172.21.15.118:0/1218131430 conn(0x7ffb8c06b720 msgr2=0x7ffb8c0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.431+0000 7ffb94000640 1 -- 172.21.15.118:0/1218131430 shutdown_connections 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.431+0000 7ffb94000640 1 -- 172.21.15.118:0/1218131430 wait complete. 2024-03-08T20:29:23.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.432+0000 7ffb94000640 1 Processor -- start 2024-03-08T20:29:23.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.432+0000 7ffb94000640 1 -- start start 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c1ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c0c5ad0 0x7ffb8c1eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c155eb0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c155bd0 con 0x7ffb8c0c5ad0 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb94000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c073320 con 0x7ffb8c072f40 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb90c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb90c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59336/0 (socket says 172.21.15.118:59336) 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.433+0000 7ffb90c00640 1 -- 172.21.15.118:0/2330005470 learned_addr learned my addr 172.21.15.118:0/2330005470 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb92000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c0c5ad0 0x7ffb8c1eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb91600640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c1ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 -- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 msgr2=0x7ffb8c1ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c1ee930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 -- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c0c5ad0 msgr2=0x7ffb8c1eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c0c5ad0 0x7ffb8c1eb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 -- 172.21.15.118:0/2330005470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c1eee70 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb90c00640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c820 tx=0x7ffb7800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78015070 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78004240 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800ce10 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.434+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c1eabf0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.435+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c154da0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.436+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c1ea9e0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.436 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.437+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ffb78007830 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.438+0000 7ffb89600640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 0x7ffb6c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:23.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.438+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ffb7808a940 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.437 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.438+0000 7ffb91600640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 0x7ffb6c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:23.438 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.439+0000 7ffb91600640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 0x7ffb6c06e0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006fd0 tx=0x7ffb80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:23.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.443+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ffb780593f0 con 0x7ffb8c0c29a0 2024-03-08T20:29:23.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:23.680+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb8c074a40 con 0x7ffb8c0c29a0 2024-03-08T20:29:24.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.212+0000 7ffb89600640 1 -- 172.21.15.118:0/2330005470 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ffb78058cf0 con 0x7ffb8c0c29a0 2024-03-08T20:29:24.212 INFO:teuthology.orchestra.run.smithi118.stderr:new fs with metadata pool 2 and data pool 3 2024-03-08T20:29:24.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.216+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 msgr2=0x7ffb6c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.216+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 0x7ffb6c06e0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006fd0 tx=0x7ffb80008040 comp rx=0 tx=0).stop 2024-03-08T20:29:24.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.216+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 msgr2=0x7ffb8c0a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.216+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c820 tx=0x7ffb7800cce0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 shutdown_connections 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffb6c06bc00 0x7ffb6c06e0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb8c0c5ad0 0x7ffb8c1eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb8c0c29a0 0x7ffb8c0a64d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 --2- 172.21.15.118:0/2330005470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb8c072f40 0x7ffb8c1ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 >> 172.21.15.118:0/2330005470 conn(0x7ffb8c06b720 msgr2=0x7ffb8c14ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:24.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 shutdown_connections 2024-03-08T20:29:24.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.217+0000 7ffb94000640 1 -- 172.21.15.118:0/2330005470 wait complete. 2024-03-08T20:29:24.252 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-08T20:29:24.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-08T20:29:24.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.439+0000 7fb441a00640 1 Processor -- start 2024-03-08T20:29:24.439 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.440+0000 7fb441a00640 1 -- start start 2024-03-08T20:29:24.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb441a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb43c0c5130 0x7fb43c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:24.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb441a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c155dd0 con 0x7fb43c155920 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb441a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c06cff0 con 0x7fb43c14ba20 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb441a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0c5610 con 0x7fb43c0c5130 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb43a000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb43c0c5130 0x7fb43c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb43b400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb43c155920 0x7fb43c0c71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36630/0 (socket says 172.21.15.118:36630) 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.441+0000 7fb43b400640 1 -- 172.21.15.118:0/3755737412 learned_addr learned my addr 172.21.15.118:0/3755737412 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:24.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.442+0000 7fb43a000640 1 -- 172.21.15.118:0/3755737412 >> v1:172.21.15.144:6789/0 conn(0x7fb43c14ba20 legacy=0x7fb43c06c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.442+0000 7fb43a000640 1 -- 172.21.15.118:0/3755737412 >> v1:172.21.15.118:6789/0 conn(0x7fb43c155920 legacy=0x7fb43c0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.442+0000 7fb43a000640 1 -- 172.21.15.118:0/3755737412 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0c58f0 con 0x7fb43c0c5130 2024-03-08T20:29:24.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.442+0000 7fb439600640 1 -- 172.21.15.118:0/3755737412 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577391440 0 0) 0x7fb43c155dd0 con 0x7fb43c155920 2024-03-08T20:29:24.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.443+0000 7fb43a000640 1 --2- 172.21.15.118:0/3755737412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c0c5130 0x7fb43c0c86b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097a0 tx=0x7fb42402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954f902fdfcaa293 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:24.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.443+0000 7fb439600640 1 -- 172.21.15.118:0/3755737412 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424034070 con 0x7fb43c0c5130 2024-03-08T20:29:24.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.443+0000 7fb439600640 1 -- 172.21.15.118:0/3755737412 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424030610 con 0x7fb43c0c5130 2024-03-08T20:29:24.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.443+0000 7fb439600640 1 -- 172.21.15.118:0/3755737412 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240309e0 con 0x7fb43c0c5130 2024-03-08T20:29:24.443 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 -- 172.21.15.118:0/3755737412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c0c5130 msgr2=0x7fb43c0c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 --2- 172.21.15.118:0/3755737412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c0c5130 0x7fb43c0c86b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4240097a0 tx=0x7fb42402b960 comp rx=0 tx=0).stop 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 -- 172.21.15.118:0/3755737412 shutdown_connections 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 --2- 172.21.15.118:0/3755737412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c0c5130 0x7fb43c0c86b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 -- 172.21.15.118:0/3755737412 >> 172.21.15.118:0/3755737412 conn(0x7fb43c0ac4e0 msgr2=0x7fb43c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 -- 172.21.15.118:0/3755737412 shutdown_connections 2024-03-08T20:29:24.444 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.444+0000 7fb441a00640 1 -- 172.21.15.118:0/3755737412 wait complete. 2024-03-08T20:29:24.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.445+0000 7fb441a00640 1 Processor -- start 2024-03-08T20:29:24.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.445+0000 7fb441a00640 1 -- start start 2024-03-08T20:29:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0c5130 0x7fb43c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:24.447 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 0x7fb43c1ec390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0be090 con 0x7fb43c155920 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c06c3c0 con 0x7fb43c14ba20 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb441a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0c78d0 con 0x7fb43c0c5130 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.446+0000 7fb43b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59350/0 (socket says 172.21.15.118:59350) 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 -- 172.21.15.118:0/540691219 learned_addr learned my addr 172.21.15.118:0/540691219 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43a000640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 0x7fb43c1ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43aa00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0c5130 0x7fb43c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 -- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0c5130 msgr2=0x7fb43c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0c5130 0x7fb43c158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 -- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 msgr2=0x7fb43c1ec390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:24.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 0x7fb43c1ec390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 -- 172.21.15.118:0/540691219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0c0c70 con 0x7fb43c155920 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43a000640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 0x7fb43c1ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb43b400640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c7b0 tx=0x7fb43400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.447+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434018070 con 0x7fb43c155920 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.448+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400a640 con 0x7fb43c155920 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.448+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c0c0f50 con 0x7fb43c155920 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.448+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ce60 con 0x7fb43c155920 2024-03-08T20:29:24.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.448+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c1ebb90 con 0x7fb43c155920 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.449+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c074a40 con 0x7fb43c155920 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.449+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb43401b070 con 0x7fb43c155920 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.450+0000 7fb432a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 0x7fb41806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.450+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb434089ff0 con 0x7fb43c155920 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.451+0000 7fb43aa00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 0x7fb41806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:24.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.451+0000 7fb43aa00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 0x7fb41806e0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb43c1eec40 tx=0x7fb42c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:24.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.455+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb434058b10 con 0x7fb43c155920 2024-03-08T20:29:24.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:24.654+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb43c06d960 con 0x7fb43c155920 2024-03-08T20:29:25.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.235+0000 7fb432a00640 1 -- 172.21.15.118:0/540691219 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb434058410 con 0x7fb43c155920 2024-03-08T20:29:25.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.239+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 msgr2=0x7fb41806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:25.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.239+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 0x7fb41806e0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb43c1eec40 tx=0x7fb42c009040 comp rx=0 tx=0).stop 2024-03-08T20:29:25.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.239+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 msgr2=0x7fb43c1ec8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.239+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c7b0 tx=0x7fb43400cc70 comp rx=0 tx=0).stop 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 shutdown_connections 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb41806bc00 0x7fb41806e0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb43c155920 0x7fb43c1ec8d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb43c14ba20 0x7fb43c1ec390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.241 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 --2- 172.21.15.118:0/540691219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb43c0c5130 0x7fb43c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 >> 172.21.15.118:0/540691219 conn(0x7fb43c0ac4e0 msgr2=0x7fb43c0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:25.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 shutdown_connections 2024-03-08T20:29:25.242 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.240+0000 7fb441a00640 1 -- 172.21.15.118:0/540691219 wait complete. 2024-03-08T20:29:25.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-08T20:29:25.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.459+0000 7f184d600640 1 Processor -- start 2024-03-08T20:29:25.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.460+0000 7f184d600640 1 -- start start 2024-03-08T20:29:25.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f184d600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1848152730 0x7f18480c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f184d600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18480bfac0 0x7f18480c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f184d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480c1c50 con 0x7f18480c15d0 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f184d600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18480c0830 con 0x7f18480bfac0 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f184d600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c2390 con 0x7f1848152730 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f183fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18480bfac0 0x7f18480c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f183fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18480bfac0 0x7f18480c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59362/0 (socket says 172.21.15.118:59362) 2024-03-08T20:29:25.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f183fe00640 1 -- 172.21.15.118:0/3293379290 learned_addr learned my addr 172.21.15.118:0/3293379290 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:25.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.461+0000 7f1846a00640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1848152730 0x7f18480c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.462+0000 7f183fe00640 1 -- 172.21.15.118:0/3293379290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1848152730 msgr2=0x7f18480c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:25.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.462+0000 7f183fe00640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1848152730 0x7f18480c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.462+0000 7f183fe00640 1 -- 172.21.15.118:0/3293379290 >> v1:172.21.15.144:6789/0 conn(0x7f18480c15d0 legacy=0x7f1848071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:25.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.462+0000 7f183fe00640 1 -- 172.21.15.118:0/3293379290 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480c2660 con 0x7f18480bfac0 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.463+0000 7f183fe00640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f18480c1090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1830009870 tx=0x7f183002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50908fb74381216 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.463+0000 7f1846000640 1 -- 172.21.15.118:0/3293379290 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830035020 con 0x7f18480bfac0 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.463+0000 7f1846000640 1 -- 172.21.15.118:0/3293379290 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830031640 con 0x7f18480bfac0 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.463+0000 7f1846000640 1 -- 172.21.15.118:0/3293379290 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183002d040 con 0x7f18480bfac0 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 -- 172.21.15.118:0/3293379290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 msgr2=0x7f18480c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f18480c1090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1830009870 tx=0x7f183002b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 -- 172.21.15.118:0/3293379290 shutdown_connections 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f18480c1090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 --2- 172.21.15.118:0/3293379290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1848152730 0x7f18480c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 -- 172.21.15.118:0/3293379290 >> 172.21.15.118:0/3293379290 conn(0x7f18480c6690 msgr2=0x7f18480c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 -- 172.21.15.118:0/3293379290 shutdown_connections 2024-03-08T20:29:25.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.464+0000 7f184d600640 1 -- 172.21.15.118:0/3293379290 wait complete. 2024-03-08T20:29:25.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.465+0000 7f184d600640 1 Processor -- start 2024-03-08T20:29:25.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 -- start start 2024-03-08T20:29:25.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18480c15d0 0x7f18480aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1848152730 0x7f18480aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c0cc0 con 0x7f18480bfac0 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c04c0 con 0x7f1848152730 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.466+0000 7f184d600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848072320 con 0x7f18480c15d0 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59376/0 (socket says 172.21.15.118:59376) 2024-03-08T20:29:25.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 -- 172.21.15.118:0/422667601 learned_addr learned my addr 172.21.15.118:0/422667601 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 -- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18480c15d0 msgr2=0x7f18480aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f183fe00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18480c15d0 0x7f18480aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18480c15d0 0x7f18480aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1847400640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1848152730 0x7f18480aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 -- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1848152730 msgr2=0x7f18480aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1848152730 0x7f18480aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 -- 172.21.15.118:0/422667601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848156350 con 0x7f18480bfac0 2024-03-08T20:29:25.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.467+0000 7f1846a00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f183800d620 tx=0x7f183800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:25.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.468+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800b620 con 0x7f18480bfac0 2024-03-08T20:29:25.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.468+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838019070 con 0x7f18480bfac0 2024-03-08T20:29:25.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.468+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800ba00 con 0x7f18480bfac0 2024-03-08T20:29:25.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.468+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18481ea820 con 0x7f18480bfac0 2024-03-08T20:29:25.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.468+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481eadc0 con 0x7f18480bfac0 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.469+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1848074a40 con 0x7f18480bfac0 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.470+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f183800bba0 con 0x7f18480bfac0 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.470+0000 7f183ea00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 0x7f182406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.471+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f183808b060 con 0x7f18480bfac0 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.471+0000 7f183fe00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 0x7f182406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:25.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.471+0000 7f183fe00640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 0x7f182406e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1830036000 tx=0x7f1830008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:25.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.475+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1838059980 con 0x7f18480bfac0 2024-03-08T20:29:25.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:25.678+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18481593a0 con 0x7f18480bfac0 2024-03-08T20:29:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.244+0000 7f183ea00640 1 -- 172.21.15.118:0/422667601 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f1838059280 con 0x7f18480bfac0 2024-03-08T20:29:27.244 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data_ec' created 2024-03-08T20:29:27.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.247+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 msgr2=0x7f182406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.247+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 0x7f182406e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1830036000 tx=0x7f1830008030 comp rx=0 tx=0).stop 2024-03-08T20:29:27.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.247+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 msgr2=0x7f184806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.247 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.247+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f183800d620 tx=0x7f183800dae0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 shutdown_connections 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f182406bbd0 0x7f182406e090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1848152730 0x7f18480aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18480c15d0 0x7f18480aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 --2- 172.21.15.118:0/422667601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480bfac0 0x7f184806e1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 >> 172.21.15.118:0/422667601 conn(0x7f18480c6690 msgr2=0x7f184814fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 shutdown_connections 2024-03-08T20:29:27.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.248+0000 7f184d600640 1 -- 172.21.15.118:0/422667601 wait complete. 2024-03-08T20:29:27.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-08T20:29:27.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.466+0000 7f7bbca00640 1 Processor -- start 2024-03-08T20:29:27.466 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.466+0000 7f7bbca00640 1 -- start start 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.467+0000 7f7bbca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7bb80c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.467+0000 7f7bbca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bb806e000 0x7f7bb806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.467+0000 7f7bbca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb8152d00 con 0x7f7bb80a9760 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bbca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb8153bd0 con 0x7f7bb806e000 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bbca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8152fc0 con 0x7f7bb80c1020 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bad400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7bb80a9760 0x7f7bb80a9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36638/0 (socket says 172.21.15.118:36638) 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bad400640 1 -- 172.21.15.118:0/111211979 learned_addr learned my addr 172.21.15.118:0/111211979 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bb5e00640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7bb80c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bb6800640 1 --2- 172.21.15.118:0/111211979 >> v2:172.21.15.144:3300/0 conn(0x7f7bb806e000 0x7f7bb806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269132601 0 0) 0x7f7bb8152d00 con 0x7f7bb80a9760 2024-03-08T20:29:27.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.468+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b9c003520 con 0x7f7bb80a9760 2024-03-08T20:29:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063318296 0 0) 0x7f7b9c003520 con 0x7f7bb80a9760 2024-03-08T20:29:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 msgr2=0x7f7bb80c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7bb80c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.471 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 >> v2:172.21.15.144:3300/0 conn(0x7f7bb806e000 msgr2=0x7f7bb806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 --2- 172.21.15.118:0/111211979 >> v2:172.21.15.144:3300/0 conn(0x7f7bb806e000 0x7f7bb806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb81532a0 con 0x7f7bb80a9760 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f7ba0001670 con 0x7f7bb80a9760 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 >> v1:172.21.15.118:6789/0 conn(0x7f7bb80a9760 legacy=0x7f7bb80a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7b9c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b9c003f30 0x7f7b9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b9c004d40 0x7f7b9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8153bd0 con 0x7f7b9c004d40 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8152fc0 con 0x7f7b9c003f30 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c00ba10 con 0x7f7bb80c1020 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb6800640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b9c004d40 0x7f7b9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.469+0000 7f7bb5e00640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7b9c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bad400640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b9c003f30 0x7f7b9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.472 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bb6800640 1 -- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 msgr2=0x7f7b9c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bb6800640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb80c1020 0x7f7b9c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bb6800640 1 -- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b9c003f30 msgr2=0x7f7b9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bb6800640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b9c003f30 0x7f7b9c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.470+0000 7f7bb6800640 1 -- 172.21.15.118:0/111211979 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c003520 con 0x7f7b9c004d40 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.471+0000 7f7bb6800640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b9c004d40 0x7f7b9c0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009af0 tx=0x7f7b9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a30c41646acf2c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.471+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0039070 con 0x7f7b9c004d40 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.471+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb002c710 con 0x7f7b9c004d40 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.471+0000 7f7bb5400640 1 -- 172.21.15.118:0/111211979 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0009690 con 0x7f7b9c004d40 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 -- 172.21.15.118:0/111211979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b9c004d40 msgr2=0x7f7b9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 --2- 172.21.15.118:0/111211979 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7b9c004d40 0x7f7b9c0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009af0 tx=0x7f7b9c005830 comp rx=0 tx=0).stop 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bb6800640 1 -- 172.21.15.118:0/111211979 reap_dead start 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 -- 172.21.15.118:0/111211979 shutdown_connections 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 -- 172.21.15.118:0/111211979 >> 172.21.15.118:0/111211979 conn(0x7f7bb80a8cb0 msgr2=0x7f7bb806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:27.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 -- 172.21.15.118:0/111211979 shutdown_connections 2024-03-08T20:29:27.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.472+0000 7f7bbca00640 1 -- 172.21.15.118:0/111211979 wait complete. 2024-03-08T20:29:27.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.474+0000 7f7bbca00640 1 Processor -- start 2024-03-08T20:29:27.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.474+0000 7f7bbca00640 1 -- start start 2024-03-08T20:29:27.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb8141310 0x7f7bb8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb80c5950 0x7f7bb81ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8150590 con 0x7f7bb81525a0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8153860 con 0x7f7bb80c5950 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bbca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8150710 con 0x7f7bb8141310 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59398/0 (socket says 172.21.15.118:59398) 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 -- 172.21.15.118:0/3924983219 learned_addr learned my addr 172.21.15.118:0/3924983219 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bb5e00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb8141310 0x7f7bb8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bb6800640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb80c5950 0x7f7bb81ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 -- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb8141310 msgr2=0x7f7bb8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb8141310 0x7f7bb8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 -- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb80c5950 msgr2=0x7f7bb81ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb80c5950 0x7f7bb81ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.475+0000 7f7bad400640 1 -- 172.21.15.118:0/3924983219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80c5ec0 con 0x7f7bb81525a0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7bad400640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000db70 tx=0x7f7ba000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:27.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0019070 con 0x7f7bb81525a0 2024-03-08T20:29:27.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0004cb0 con 0x7f7bb81525a0 2024-03-08T20:29:27.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0004e60 con 0x7f7bb81525a0 2024-03-08T20:29:27.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb80c61a0 con 0x7f7bb81525a0 2024-03-08T20:29:27.478 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.476+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8072360 con 0x7f7bb81525a0 2024-03-08T20:29:27.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.477+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb814dc70 con 0x7f7bb81525a0 2024-03-08T20:29:27.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.479+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7ba0007310 con 0x7f7bb81525a0 2024-03-08T20:29:27.479 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.480+0000 7f7baea00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 0x7f7b9406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:27.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.480+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f7ba008a790 con 0x7f7bb81525a0 2024-03-08T20:29:27.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.480+0000 7f7bb5e00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 0x7f7b9406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:27.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.481+0000 7f7bb5e00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 0x7f7b9406e0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8007520 tx=0x7f7ba800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:27.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.485+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7ba0058ec0 con 0x7f7bb81525a0 2024-03-08T20:29:27.611 INFO:tasks.ceph.mds.b.smithi144.stderr:2024-03-08T20:29:27.610+0000 7fd68bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T20:29:27.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:27.680+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f7bb8074a40 con 0x7f7bb81525a0 2024-03-08T20:29:28.248 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.248+0000 7f7baea00640 1 -- 172.21.15.118:0/3924983219 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7ba00587c0 con 0x7f7bb81525a0 2024-03-08T20:29:28.248 INFO:teuthology.orchestra.run.smithi118.stderr:set pool 4 allow_ec_overwrites to true 2024-03-08T20:29:28.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.251+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 msgr2=0x7f7b9406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.251+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 0x7f7b9406e0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8007520 tx=0x7f7ba800b040 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.251+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 msgr2=0x7f7bb81edff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.251+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000db70 tx=0x7f7ba000df70 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 shutdown_connections 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7b9406bc00 0x7f7b9406e0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb80c5950 0x7f7bb81ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bb81525a0 0x7f7bb81edff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 --2- 172.21.15.118:0/3924983219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bb8141310 0x7f7bb8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 >> 172.21.15.118:0/3924983219 conn(0x7f7bb80a8cb0 msgr2=0x7f7bb806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 shutdown_connections 2024-03-08T20:29:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.252+0000 7f7bbca00640 1 -- 172.21.15.118:0/3924983219 wait complete. 2024-03-08T20:29:28.292 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-08T20:29:28.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.476+0000 7fa78a600640 1 Processor -- start 2024-03-08T20:29:28.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.476+0000 7fa78a600640 1 -- start start 2024-03-08T20:29:28.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.477+0000 7fa78a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa784152540 0x7fa784155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.477+0000 7fa78a600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7840c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.477+0000 7fa78a600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa784154ed0 con 0x7fa784158440 2024-03-08T20:29:28.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.477+0000 7fa78a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa784158e90 con 0x7fa784152540 2024-03-08T20:29:28.477 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.477+0000 7fa78a600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa784159170 con 0x7fa784152920 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa789c00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa784158440 0x7fa7840c5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36648/0 (socket says 172.21.15.118:36648) 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa789c00640 1 -- 172.21.15.118:0/3437723785 learned_addr learned my addr 172.21.15.118:0/3437723785 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa789200640 1 --2- 172.21.15.118:0/3437723785 >> v2:172.21.15.144:3300/0 conn(0x7fa784152540 0x7fa784155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa783e00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7840c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216732948 0 0) 0x7fa784154ed0 con 0x7fa784158440 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.478+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa768003520 con 0x7fa784158440 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1049268281 0 0) 0x7fa768003520 con 0x7fa784158440 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 msgr2=0x7fa7840c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7840c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 >> v2:172.21.15.144:3300/0 conn(0x7fa784152540 msgr2=0x7fa784155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 --2- 172.21.15.118:0/3437723785 >> v2:172.21.15.144:3300/0 conn(0x7fa784152540 0x7fa784155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784155190 con 0x7fa784158440 2024-03-08T20:29:28.480 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fa77c001670 con 0x7fa784158440 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 >> v1:172.21.15.118:6789/0 conn(0x7fa784158440 legacy=0x7fa7840c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768003f30 0x7fa768004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768004d40 0x7fa7680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784158e90 con 0x7fa768003f30 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784159170 con 0x7fa768004d40 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76800baa0 con 0x7fa784152920 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa783e00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768003f30 0x7fa768004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa789c00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768004d40 0x7fa7680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.479+0000 7fa789200640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.480+0000 7fa783e00640 1 -- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 msgr2=0x7fa7680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.480+0000 7fa783e00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa784152920 0x7fa7680039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.480+0000 7fa783e00640 1 -- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768004d40 msgr2=0x7fa7680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:28.481 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.480+0000 7fa783e00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768004d40 0x7fa7680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.480+0000 7fa783e00640 1 -- 172.21.15.118:0/3437723785 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768003520 con 0x7fa768003f30 2024-03-08T20:29:28.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa783e00640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768003f30 0x7fa768004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa770009ac0 tx=0x7fa768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf956e30f8985295 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770039070 con 0x7fa768003f30 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77002c6b0 con 0x7fa768003f30 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa783400640 1 -- 172.21.15.118:0/3437723785 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770009690 con 0x7fa768003f30 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa78a600640 1 -- 172.21.15.118:0/3437723785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768003f30 msgr2=0x7fa768004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa78a600640 1 --2- 172.21.15.118:0/3437723785 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa768003f30 0x7fa768004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa770009ac0 tx=0x7fa768005830 comp rx=0 tx=0).stop 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa789c00640 1 -- 172.21.15.118:0/3437723785 reap_dead start 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa78a600640 1 -- 172.21.15.118:0/3437723785 shutdown_connections 2024-03-08T20:29:28.483 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa78a600640 1 -- 172.21.15.118:0/3437723785 >> 172.21.15.118:0/3437723785 conn(0x7fa7840ac290 msgr2=0x7fa7840ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:28.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.481+0000 7fa78a600640 1 -- 172.21.15.118:0/3437723785 shutdown_connections 2024-03-08T20:29:28.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.482+0000 7fa78a600640 1 -- 172.21.15.118:0/3437723785 wait complete. 2024-03-08T20:29:28.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.483+0000 7fa78a600640 1 Processor -- start 2024-03-08T20:29:28.484 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.483+0000 7fa78a600640 1 -- start start 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 0x7fa784154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7840c91f0 0x7fa7841eb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840c5910 con 0x7fa7840ca1e0 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840c5790 con 0x7fa768003f30 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa78a600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78406d900 con 0x7fa7840c91f0 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa783e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa783e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59414/0 (socket says 172.21.15.118:59414) 2024-03-08T20:29:28.486 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.484+0000 7fa783e00640 1 -- 172.21.15.118:0/4065652295 learned_addr learned my addr 172.21.15.118:0/4065652295 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa789200640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 0x7fa784154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa789c00640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7840c91f0 0x7fa7841eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 -- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7840c91f0 msgr2=0x7fa7841eb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7840c91f0 0x7fa7841eb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 -- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 msgr2=0x7fa784154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 0x7fa784154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 -- 172.21.15.118:0/4065652295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784147e10 con 0x7fa7840ca1e0 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa789200640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 0x7fa784154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa783e00640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa770000c00 tx=0x7fa770004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:28.487 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770042020 con 0x7fa7840ca1e0 2024-03-08T20:29:28.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77003a040 con 0x7fa7840ca1e0 2024-03-08T20:29:28.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.485+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770039070 con 0x7fa7840ca1e0 2024-03-08T20:29:28.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.486+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840c8710 con 0x7fa7840ca1e0 2024-03-08T20:29:28.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.486+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78414dcf0 con 0x7fa7840ca1e0 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.487+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7840c8500 con 0x7fa7840ca1e0 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.488+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa770045020 con 0x7fa7840ca1e0 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.488+0000 7fa780c00640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 0x7fa76406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.489+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fa7700ac190 con 0x7fa7840ca1e0 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.489+0000 7fa789200640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 0x7fa76406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:28.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.489+0000 7fa789200640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 0x7fa76406e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7841486a0 tx=0x7fa77400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:28.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.493+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa77004c070 con 0x7fa7840ca1e0 2024-03-08T20:29:28.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:28.731+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa784074a20 con 0x7fa7840ca1e0 2024-03-08T20:29:29.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.329+0000 7fa780c00640 1 -- 172.21.15.118:0/4065652295 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa77007a950 con 0x7fa7840ca1e0 2024-03-08T20:29:29.329 INFO:teuthology.orchestra.run.smithi118.stderr:added data pool 4 to fsmap 2024-03-08T20:29:29.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 msgr2=0x7fa76406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 0x7fa76406e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7841486a0 tx=0x7fa77400b040 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 msgr2=0x7fa78414d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa770000c00 tx=0x7fa770004730 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 shutdown_connections 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa76406bbd0 0x7fa76406e090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7840c91f0 0x7fa7841eb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa7840ca1e0 0x7fa78414d7b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 --2- 172.21.15.118:0/4065652295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa768003f30 0x7fa784154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 >> 172.21.15.118:0/4065652295 conn(0x7fa7840ac290 msgr2=0x7fa7841508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 shutdown_connections 2024-03-08T20:29:29.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.333+0000 7fa78a600640 1 -- 172.21.15.118:0/4065652295 wait complete. 2024-03-08T20:29:29.353 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:29.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.556+0000 7f86b6800640 1 Processor -- start 2024-03-08T20:29:29.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.556+0000 7f86b6800640 1 -- start start 2024-03-08T20:29:29.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b6800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86b00c6610 0x7f86b0072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:29.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b6800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b006dce0 con 0x7f86b0153610 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b6800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b006eca0 con 0x7f86b014fbe0 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b6800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b0154790 con 0x7f86b00c6610 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b5400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f86b00c6610 0x7f86b0072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b4a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f86b0153610 0x7f86b0154080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:36658/0 (socket says 172.21.15.118:36658) 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b4a00640 1 -- 172.21.15.118:0/2132856562 learned_addr learned my addr 172.21.15.118:0/2132856562 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b5400640 1 -- 172.21.15.118:0/2132856562 >> v1:172.21.15.144:6789/0 conn(0x7f86b014fbe0 legacy=0x7f86b0150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:29.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b5400640 1 -- 172.21.15.118:0/2132856562 >> v1:172.21.15.118:6789/0 conn(0x7f86b0153610 legacy=0x7f86b0154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.558+0000 7f86b5400640 1 -- 172.21.15.118:0/2132856562 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b006ef80 con 0x7f86b00c6610 2024-03-08T20:29:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86b5400640 1 --2- 172.21.15.118:0/2132856562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b00c6610 0x7f86b0072e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097a0 tx=0x7f86a402b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4943579f234f02b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86afe00640 1 -- 172.21.15.118:0/2132856562 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4037070 con 0x7f86b00c6610 2024-03-08T20:29:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86afe00640 1 -- 172.21.15.118:0/2132856562 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a4030710 con 0x7f86b00c6610 2024-03-08T20:29:29.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86afe00640 1 -- 172.21.15.118:0/2132856562 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4030ae0 con 0x7f86b00c6610 2024-03-08T20:29:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86b6800640 1 -- 172.21.15.118:0/2132856562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b00c6610 msgr2=0x7f86b0072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.560+0000 7f86b6800640 1 --2- 172.21.15.118:0/2132856562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b00c6610 0x7f86b0072e00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86a40097a0 tx=0x7f86a402b680 comp rx=0 tx=0).stop 2024-03-08T20:29:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.561+0000 7f86b6800640 1 -- 172.21.15.118:0/2132856562 shutdown_connections 2024-03-08T20:29:29.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.561+0000 7f86b6800640 1 --2- 172.21.15.118:0/2132856562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b00c6610 0x7f86b0072e00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.561+0000 7f86b6800640 1 -- 172.21.15.118:0/2132856562 >> 172.21.15.118:0/2132856562 conn(0x7f86b006ad10 msgr2=0x7f86b006b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.561+0000 7f86b6800640 1 -- 172.21.15.118:0/2132856562 shutdown_connections 2024-03-08T20:29:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.561+0000 7f86b6800640 1 -- 172.21.15.118:0/2132856562 wait complete. 2024-03-08T20:29:29.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.562+0000 7f86b6800640 1 Processor -- start 2024-03-08T20:29:29.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.562+0000 7f86b6800640 1 -- start start 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00c6610 0x7f86b01ec790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86b014fbe0 0x7f86b0156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b00728e0 con 0x7f86b0153610 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b0072600 con 0x7f86b014fbe0 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b6800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b0153aa0 con 0x7f86b00c6610 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.563+0000 7f86b5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59434/0 (socket says 172.21.15.118:59434) 2024-03-08T20:29:29.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 -- 172.21.15.118:0/889363865 learned_addr learned my addr 172.21.15.118:0/889363865 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b4a00640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86b014fbe0 0x7f86b0156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 -- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00c6610 msgr2=0x7f86b01ec790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5400640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00c6610 0x7f86b01ec790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00c6610 0x7f86b01ec790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 -- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86b014fbe0 msgr2=0x7f86b0156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86b014fbe0 0x7f86b0156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 -- 172.21.15.118:0/889363865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b01dfa00 con 0x7f86b0153610 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86b5e00640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c780 tx=0x7f86a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8004b60 con 0x7f86b0153610 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8004d00 con 0x7f86b0153610 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.564+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800aa90 con 0x7f86b0153610 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.565+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b01dfce0 con 0x7f86b0153610 2024-03-08T20:29:29.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.565+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b01ebcb0 con 0x7f86b0153610 2024-03-08T20:29:29.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.566+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b004f050 con 0x7f86b0153610 2024-03-08T20:29:29.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.567+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f86a800ac30 con 0x7f86b0153610 2024-03-08T20:29:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.567+0000 7f86ad600640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 0x7f869006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.568+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f86a808b060 con 0x7f86b0153610 2024-03-08T20:29:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.568+0000 7f86b5400640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 0x7f869006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:29.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.568+0000 7f86b5400640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 0x7f869006e0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:29.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.572+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f86b004f050 con 0x7f86b0153610 2024-03-08T20:29:29.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.811+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86b0074a40 con 0x7f86b0153610 2024-03-08T20:29:29.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.812+0000 7f86ad600640 1 -- 172.21.15.118:0/889363865 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f86a8020070 con 0x7f86b0153610 2024-03-08T20:29:29.812 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:29.812 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:28.732819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-08T20:29:29.812 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 msgr2=0x7f869006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 0x7f869006e0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a4008030 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 msgr2=0x7f86b01e86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86a800c780 tx=0x7f86a800cc40 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 shutdown_connections 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f869006bc00 0x7f869006e0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86b0153610 0x7f86b01e86e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86b014fbe0 0x7f86b0156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 --2- 172.21.15.118:0/889363865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f86b00c6610 0x7f86b01ec790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 >> 172.21.15.118:0/889363865 conn(0x7f86b006ad10 msgr2=0x7f86b00c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:29.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 shutdown_connections 2024-03-08T20:29:29.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:29.815+0000 7f86b6800640 1 -- 172.21.15.118:0/889363865 wait complete. 2024-03-08T20:29:29.834 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:30.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.039+0000 7f36d4c00640 1 Processor -- start 2024-03-08T20:29:30.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.039+0000 7f36d4c00640 1 -- start start 2024-03-08T20:29:30.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.040+0000 7f36d4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f36d01526a0 0x7f36d0155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36d4c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d00c6830 con 0x7f36d006c290 2024-03-08T20:29:30.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36d4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d0155e80 con 0x7f36d00c9af0 2024-03-08T20:29:30.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36d4c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d00c87a0 con 0x7f36d01526a0 2024-03-08T20:29:30.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36cf400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f36d01526a0 0x7f36d0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36cea00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f36d006c290 0x7f36d00c5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33054/0 (socket says 172.21.15.118:33054) 2024-03-08T20:29:30.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36cea00640 1 -- 172.21.15.118:0/1376854767 learned_addr learned my addr 172.21.15.118:0/1376854767 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:30.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36ce000640 1 -- 172.21.15.118:0/1376854767 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677651480 0 0) 0x7f36d00c6830 con 0x7f36d006c290 2024-03-08T20:29:30.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36ce000640 1 -- 172.21.15.118:0/1376854767 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36b4003520 con 0x7f36d006c290 2024-03-08T20:29:30.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.041+0000 7f36cf400640 1 -- 172.21.15.118:0/1376854767 >> v1:172.21.15.144:6789/0 conn(0x7f36d00c9af0 legacy=0x7f36d015f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:30.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.042+0000 7f36cf400640 1 -- 172.21.15.118:0/1376854767 >> v1:172.21.15.118:6789/0 conn(0x7f36d006c290 legacy=0x7f36d00c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.042+0000 7f36cf400640 1 -- 172.21.15.118:0/1376854767 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00c89d0 con 0x7f36d01526a0 2024-03-08T20:29:30.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.043+0000 7f36cf400640 1 --2- 172.21.15.118:0/1376854767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d0155940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36d006df80 tx=0x7f36c002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a419a9a5113d2e36 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.043+0000 7f36ce000640 1 -- 172.21.15.118:0/1376854767 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0039070 con 0x7f36d01526a0 2024-03-08T20:29:30.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.043+0000 7f36ce000640 1 -- 172.21.15.118:0/1376854767 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c002cbb0 con 0x7f36d01526a0 2024-03-08T20:29:30.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.043+0000 7f36ce000640 1 -- 172.21.15.118:0/1376854767 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0034440 con 0x7f36d01526a0 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 -- 172.21.15.118:0/1376854767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 msgr2=0x7f36d0155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1376854767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d0155940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36d006df80 tx=0x7f36c002be00 comp rx=0 tx=0).stop 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 -- 172.21.15.118:0/1376854767 shutdown_connections 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1376854767 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d0155940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 -- 172.21.15.118:0/1376854767 >> 172.21.15.118:0/1376854767 conn(0x7f36d00ca680 msgr2=0x7f36d00caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 -- 172.21.15.118:0/1376854767 shutdown_connections 2024-03-08T20:29:30.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.044+0000 7f36d4c00640 1 -- 172.21.15.118:0/1376854767 wait complete. 2024-03-08T20:29:30.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.046+0000 7f36d4c00640 1 Processor -- start 2024-03-08T20:29:30.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.046+0000 7f36d4c00640 1 -- start start 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36d006c290 0x7f36d0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 0x7f36d0158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00c92f0 con 0x7f36d01526a0 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00c9660 con 0x7f36d00c9af0 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36d4c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d00cb500 con 0x7f36d006c290 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48842/0 (socket says 172.21.15.118:48842) 2024-03-08T20:29:30.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cfe00640 1 -- 172.21.15.118:0/1442950802 learned_addr learned my addr 172.21.15.118:0/1442950802 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cf400640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36d006c290 0x7f36d0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cea00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 0x7f36d0158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cfe00640 1 -- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36d006c290 msgr2=0x7f36d0158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.047+0000 7f36cfe00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36d006c290 0x7f36d0158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36cfe00640 1 -- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 msgr2=0x7f36d0158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36cfe00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 0x7f36d0158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36cfe00640 1 -- 172.21.15.118:0/1442950802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0157550 con 0x7f36d01526a0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36cea00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 0x7f36d0158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36cfe00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f36c800c440 tx=0x7f36c800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011790 con 0x7f36d01526a0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8017070 con 0x7f36d01526a0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011b70 con 0x7f36d01526a0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d0157830 con 0x7f36d01526a0 2024-03-08T20:29:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.048+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d0157df0 con 0x7f36d01526a0 2024-03-08T20:29:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.049+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d0074a40 con 0x7f36d01526a0 2024-03-08T20:29:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.050+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f36c8011d10 con 0x7f36d01526a0 2024-03-08T20:29:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.051+0000 7f36c7400640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 0x7f36ac06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.051+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f36c808abe0 con 0x7f36d01526a0 2024-03-08T20:29:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.051+0000 7f36cf400640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 0x7f36ac06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.052+0000 7f36cf400640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 0x7f36ac06e0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36c0036000 tx=0x7f36c0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.055+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f36c8059390 con 0x7f36d01526a0 2024-03-08T20:29:30.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.249+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36d00cb2e0 con 0x7f36d01526a0 2024-03-08T20:29:30.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.251+0000 7f36c7400640 1 -- 172.21.15.118:0/1442950802 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f36c8058c90 con 0x7f36d01526a0 2024-03-08T20:29:30.257 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:30.258 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:30.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 msgr2=0x7f36ac06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 0x7f36ac06e0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36c0036000 tx=0x7f36c0030000 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 msgr2=0x7f36d00be5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f36c800c440 tx=0x7f36c800c900 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 shutdown_connections 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36ac06bc00 0x7f36ac06e0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36d01526a0 0x7f36d00be5f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d00c9af0 0x7f36d0158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 --2- 172.21.15.118:0/1442950802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36d006c290 0x7f36d0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 >> 172.21.15.118:0/1442950802 conn(0x7f36d00ca680 msgr2=0x7f36d00bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 shutdown_connections 2024-03-08T20:29:30.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.254+0000 7f36d4c00640 1 -- 172.21.15.118:0/1442950802 wait complete. 2024-03-08T20:29:30.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:30.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.488+0000 7fc710800640 1 Processor -- start 2024-03-08T20:29:30.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.488+0000 7fc710800640 1 -- start start 2024-03-08T20:29:30.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc710800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc70806ad10 0x7fc70806b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.489 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc710800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc7081596f0 0x7fc708159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc710800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc708156df0 con 0x7fc708156a10 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc710800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806ea50 con 0x7fc7081596f0 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc710800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806eca0 con 0x7fc70806ad10 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc70e800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc7081596f0 0x7fc708159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc70e800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc7081596f0 0x7fc708159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48848/0 (socket says 172.21.15.118:48848) 2024-03-08T20:29:30.490 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc70e800640 1 -- 172.21.15.118:0/4000102905 learned_addr learned my addr 172.21.15.118:0/4000102905 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.490+0000 7fc70d400640 1 --2- 172.21.15.118:0/4000102905 >> v2:172.21.15.144:3300/0 conn(0x7fc70806ad10 0x7fc70806b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.491+0000 7fc70e800640 1 -- 172.21.15.118:0/4000102905 >> v2:172.21.15.144:3300/0 conn(0x7fc70806ad10 msgr2=0x7fc70806b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.491+0000 7fc70e800640 1 --2- 172.21.15.118:0/4000102905 >> v2:172.21.15.144:3300/0 conn(0x7fc70806ad10 0x7fc70806b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.491+0000 7fc70e800640 1 -- 172.21.15.118:0/4000102905 >> v1:172.21.15.144:6789/0 conn(0x7fc708156a10 legacy=0x7fc7080c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:30.491 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.491+0000 7fc70e800640 1 -- 172.21.15.118:0/4000102905 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70806ef80 con 0x7fc7081596f0 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.492+0000 7fc70e800640 1 --2- 172.21.15.118:0/4000102905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7081596f0 0x7fc708159b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc70806b840 tx=0x7fc70402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd819410b6547ae server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.492+0000 7fc70ca00640 1 -- 172.21.15.118:0/4000102905 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70402c9f0 con 0x7fc7081596f0 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.492+0000 7fc70ca00640 1 -- 172.21.15.118:0/4000102905 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70402cb90 con 0x7fc7081596f0 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.492+0000 7fc70ca00640 1 -- 172.21.15.118:0/4000102905 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7040343f0 con 0x7fc7081596f0 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 -- 172.21.15.118:0/4000102905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7081596f0 msgr2=0x7fc708159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 --2- 172.21.15.118:0/4000102905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7081596f0 0x7fc708159b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc70806b840 tx=0x7fc70402be50 comp rx=0 tx=0).stop 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 -- 172.21.15.118:0/4000102905 shutdown_connections 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 --2- 172.21.15.118:0/4000102905 >> v2:172.21.15.144:3300/0 conn(0x7fc70806ad10 0x7fc70806b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 --2- 172.21.15.118:0/4000102905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc7081596f0 0x7fc708159b40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 -- 172.21.15.118:0/4000102905 >> 172.21.15.118:0/4000102905 conn(0x7fc7080a84c0 msgr2=0x7fc7080a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 -- 172.21.15.118:0/4000102905 shutdown_connections 2024-03-08T20:29:30.493 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.493+0000 7fc710800640 1 -- 172.21.15.118:0/4000102905 wait complete. 2024-03-08T20:29:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.495+0000 7fc710800640 1 Processor -- start 2024-03-08T20:29:30.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.495+0000 7fc710800640 1 -- start start 2024-03-08T20:29:30.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc70806ad10 0x7fc7080721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 0x7fc7081f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70806e5b0 con 0x7fc708156a10 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70806e2d0 con 0x7fc7081596f0 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc710800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c2d70 con 0x7fc70806ad10 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48858/0 (socket says 172.21.15.118:48858) 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 -- 172.21.15.118:0/2220830624 learned_addr learned my addr 172.21.15.118:0/2220830624 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70e800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 0x7fc7081f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 -- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc70806ad10 msgr2=0x7fc7080721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70de00640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc70806ad10 0x7fc7080721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc70806ad10 0x7fc7080721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 -- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 msgr2=0x7fc7081f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 0x7fc7081f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70d400640 1 -- 172.21.15.118:0/2220830624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708159350 con 0x7fc708156a10 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.496+0000 7fc70e800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 0x7fc7081f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc70d400640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800d800 tx=0x7fc6f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800b6c0 con 0x7fc708156a10 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8019070 con 0x7fc708156a10 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800ba80 con 0x7fc708156a10 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7081eec40 con 0x7fc708156a10 2024-03-08T20:29:30.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.497+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7081ef200 con 0x7fc708156a10 2024-03-08T20:29:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.498+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708074a40 con 0x7fc708156a10 2024-03-08T20:29:30.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.499+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc6f800bc20 con 0x7fc708156a10 2024-03-08T20:29:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.500+0000 7fc702000640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 0x7fc6ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.500+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6f808b290 con 0x7fc708156a10 2024-03-08T20:29:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.501+0000 7fc70de00640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 0x7fc6ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.501+0000 7fc70de00640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 0x7fc6ec06e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc003d90 tx=0x7fc6fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.505+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc6f8059a30 con 0x7fc708156a10 2024-03-08T20:29:30.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.702+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7080c37a0 con 0x7fc708156a10 2024-03-08T20:29:30.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.706+0000 7fc702000640 1 -- 172.21.15.118:0/2220830624 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7fc6f8059330 con 0x7fc708156a10 2024-03-08T20:29:30.706 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:30.706 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 msgr2=0x7fc6ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 0x7fc6ec06e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc003d90 tx=0x7fc6fc009040 comp rx=0 tx=0).stop 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 msgr2=0x7fc70815bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800d800 tx=0x7fc6f800dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 shutdown_connections 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc6ec06bbd0 0x7fc6ec06e090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7081596f0 0x7fc7081f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc708156a10 0x7fc70815bd40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 --2- 172.21.15.118:0/2220830624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc70806ad10 0x7fc7080721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 >> 172.21.15.118:0/2220830624 conn(0x7fc7080a84c0 msgr2=0x7fc7081532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 shutdown_connections 2024-03-08T20:29:30.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.709+0000 7fc710800640 1 -- 172.21.15.118:0/2220830624 wait complete. 2024-03-08T20:29:30.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:30.942 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.943+0000 7fa07be00640 1 Processor -- start 2024-03-08T20:29:30.943 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.943+0000 7fa07be00640 1 -- start start 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.944+0000 7fa07be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa07414f210 0x7fa0740c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.944+0000 7fa07be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 0x7fa0741520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.944+0000 7fa07be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740c3e90 con 0x7fa0740aa7e0 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa07be00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740c1210 con 0x7fa07414f210 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa07be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740c14f0 con 0x7fa074151ce0 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa07414f210 0x7fa0740c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa07414f210 0x7fa0740c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48874/0 (socket says 172.21.15.118:48874) 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 -- 172.21.15.118:0/4102398219 learned_addr learned my addr 172.21.15.118:0/4102398219 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079e00640 1 --2- 172.21.15.118:0/4102398219 >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 0x7fa0741520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 -- 172.21.15.118:0/4102398219 >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 msgr2=0x7fa0741520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:30.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 --2- 172.21.15.118:0/4102398219 >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 0x7fa0741520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 -- 172.21.15.118:0/4102398219 >> v1:172.21.15.144:6789/0 conn(0x7fa0740aa7e0 legacy=0x7fa07406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:30.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079400640 1 -- 172.21.15.118:0/4102398219 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740c0cc0 con 0x7fa07414f210 2024-03-08T20:29:30.946 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.945+0000 7fa079e00640 1 --2- 172.21.15.118:0/4102398219 >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 0x7fa0741520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.946+0000 7fa079400640 1 --2- 172.21.15.118:0/4102398219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa07414f210 0x7fa0740c38b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0740c3630 tx=0x7fa06802dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18da6322f015a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.947+0000 7fa073e00640 1 -- 172.21.15.118:0/4102398219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06803b070 con 0x7fa07414f210 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.947+0000 7fa073e00640 1 -- 172.21.15.118:0/4102398219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06802ed80 con 0x7fa07414f210 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.947+0000 7fa073e00640 1 -- 172.21.15.118:0/4102398219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068036660 con 0x7fa07414f210 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.947+0000 7fa07be00640 1 -- 172.21.15.118:0/4102398219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa07414f210 msgr2=0x7fa0740c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.947+0000 7fa07be00640 1 --2- 172.21.15.118:0/4102398219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa07414f210 0x7fa0740c38b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa0740c3630 tx=0x7fa06802dfd0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 -- 172.21.15.118:0/4102398219 shutdown_connections 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 --2- 172.21.15.118:0/4102398219 >> v2:172.21.15.144:3300/0 conn(0x7fa074151ce0 0x7fa0741520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 --2- 172.21.15.118:0/4102398219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa07414f210 0x7fa0740c38b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 -- 172.21.15.118:0/4102398219 >> 172.21.15.118:0/4102398219 conn(0x7fa0740a84c0 msgr2=0x7fa0740a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 -- 172.21.15.118:0/4102398219 shutdown_connections 2024-03-08T20:29:30.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.948+0000 7fa07be00640 1 -- 172.21.15.118:0/4102398219 wait complete. 2024-03-08T20:29:30.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.949+0000 7fa07be00640 1 Processor -- start 2024-03-08T20:29:30.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.950+0000 7fa07be00640 1 -- start start 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.950+0000 7fa07be00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0740aa7e0 0x7fa0741433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa07be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa07414f210 0x7fa0740c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa07be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa07be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07406b5a0 con 0x7fa074151ce0 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa07be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07406b420 con 0x7fa07414f210 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa07be00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07414f5f0 con 0x7fa0740aa7e0 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48876/0 (socket says 172.21.15.118:48876) 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 -- 172.21.15.118:0/4187894468 learned_addr learned my addr 172.21.15.118:0/4187894468 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079400640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0740aa7e0 0x7fa0741433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa078a00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa07414f210 0x7fa0740c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 -- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0740aa7e0 msgr2=0x7fa0741433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0740aa7e0 0x7fa0741433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 -- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa07414f210 msgr2=0x7fa0740c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa07414f210 0x7fa0740c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.951+0000 7fa079e00640 1 -- 172.21.15.118:0/4187894468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0741431f0 con 0x7fa074151ce0 2024-03-08T20:29:30.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa079e00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00cef0 tx=0x7fa06c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c01a070 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00d860 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00dc50 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0740c5b00 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.952+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0741eb210 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.953+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0741ead20 con 0x7fa074151ce0 2024-03-08T20:29:30.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.954+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa06c01d070 con 0x7fa074151ce0 2024-03-08T20:29:30.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.955+0000 7fa071600640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 0x7fa05806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:30.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.955+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa06c08b670 con 0x7fa074151ce0 2024-03-08T20:29:30.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.956+0000 7fa079400640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 0x7fa05806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:30.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.956+0000 7fa079400640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 0x7fa05806e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa068038000 tx=0x7fa068008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:30.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:30.959+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa06c059ed0 con 0x7fa074151ce0 2024-03-08T20:29:31.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.192+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa074074a40 con 0x7fa074151ce0 2024-03-08T20:29:31.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.194+0000 7fa071600640 1 -- 172.21.15.118:0/4187894468 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fa06c0597d0 con 0x7fa074151ce0 2024-03-08T20:29:31.193 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:31.194 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:28.732819+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-08T20:29:31.194 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 7 2024-03-08T20:29:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 msgr2=0x7fa05806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 0x7fa05806e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa068038000 tx=0x7fa068008040 comp rx=0 tx=0).stop 2024-03-08T20:29:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 msgr2=0x7fa074142cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00cef0 tx=0x7fa06c00a710 comp rx=0 tx=0).stop 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 shutdown_connections 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa05806bbd0 0x7fa05806e090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa074151ce0 0x7fa074142cb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa07414f210 0x7fa0740c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 --2- 172.21.15.118:0/4187894468 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0740aa7e0 0x7fa0741433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.196+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 >> 172.21.15.118:0/4187894468 conn(0x7fa0740a84c0 msgr2=0x7fa074145250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.197+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 shutdown_connections 2024-03-08T20:29:31.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.197+0000 7fa07be00640 1 -- 172.21.15.118:0/4187894468 wait complete. 2024-03-08T20:29:31.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:31.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.419+0000 7fe737800640 1 Processor -- start 2024-03-08T20:29:31.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.419+0000 7fe737800640 1 -- start start 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.420+0000 7fe737800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe73014fed0 0x7fe730150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.420+0000 7fe737800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe7301532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.420+0000 7fe737800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300aa980 con 0x7fe73006af80 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.420+0000 7fe737800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe730150870 con 0x7fe73014fed0 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.420+0000 7fe737800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300aac60 con 0x7fe730152e10 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe734e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe73006af80 0x7fe73006e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33064/0 (socket says 172.21.15.118:33064) 2024-03-08T20:29:31.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe734e00640 1 -- 172.21.15.118:0/405588834 learned_addr learned my addr 172.21.15.118:0/405588834 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe735800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe7301532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe72fe00640 1 --2- 172.21.15.118:0/405588834 >> v2:172.21.15.144:3300/0 conn(0x7fe73014fed0 0x7fe730150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201239437 0 0) 0x7fe7300aa980 con 0x7fe73006af80 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.421+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe718003520 con 0x7fe73006af80 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053676475 0 0) 0x7fe718003520 con 0x7fe73006af80 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 msgr2=0x7fe7301532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe7301532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 >> v2:172.21.15.144:3300/0 conn(0x7fe73014fed0 msgr2=0x7fe730150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:31.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 --2- 172.21.15.118:0/405588834 >> v2:172.21.15.144:3300/0 conn(0x7fe73014fed0 0x7fe730150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7300aaf40 con 0x7fe73006af80 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fe724001670 con 0x7fe73006af80 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 >> v1:172.21.15.118:6789/0 conn(0x7fe73006af80 legacy=0x7fe73006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7180039b0 0x7fe718003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe718004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe718004d40 0x7fe7180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe730150870 con 0x7fe718004d40 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300aac60 con 0x7fe7180039b0 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71800ba40 con 0x7fe730152e10 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe718004d40 0x7fe7180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe734e00640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7180039b0 0x7fe718003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe72fe00640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe718004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.425 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 -- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 msgr2=0x7fe718004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730152e10 0x7fe718004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 -- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7180039b0 msgr2=0x7fe718003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7180039b0 0x7fe718003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.422+0000 7fe735800640 1 -- 172.21.15.118:0/405588834 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718003520 con 0x7fe718004d40 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.423+0000 7fe735800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe718004d40 0x7fe7180051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe728009fc0 tx=0x7fe718005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b166af4953640ae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728039070 con 0x7fe718004d40 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72802cc20 con 0x7fe718004d40 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe72f400640 1 -- 172.21.15.118:0/405588834 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728009c10 con 0x7fe718004d40 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 -- 172.21.15.118:0/405588834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe718004d40 msgr2=0x7fe7180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 --2- 172.21.15.118:0/405588834 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe718004d40 0x7fe7180051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe728009fc0 tx=0x7fe718005830 comp rx=0 tx=0).stop 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe735800640 1 -- 172.21.15.118:0/405588834 reap_dead start 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 -- 172.21.15.118:0/405588834 shutdown_connections 2024-03-08T20:29:31.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 -- 172.21.15.118:0/405588834 >> 172.21.15.118:0/405588834 conn(0x7fe7300a84c0 msgr2=0x7fe7300a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:31.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 -- 172.21.15.118:0/405588834 shutdown_connections 2024-03-08T20:29:31.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.424+0000 7fe737800640 1 -- 172.21.15.118:0/405588834 wait complete. 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.426+0000 7fe737800640 1 Processor -- start 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.426+0000 7fe737800640 1 -- start start 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe718004d40 0x7fe7301de870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73014ec10 0x7fe7301eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c3f90 con 0x7fe730072270 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300c3e10 con 0x7fe73014ec10 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe737800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73006eda0 con 0x7fe718004d40 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe735800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe735800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48894/0 (socket says 172.21.15.118:48894) 2024-03-08T20:29:31.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.427+0000 7fe735800640 1 -- 172.21.15.118:0/3898222353 learned_addr learned my addr 172.21.15.118:0/3898222353 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe734e00640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe718004d40 0x7fe7301de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 -- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe718004d40 msgr2=0x7fe7301de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe718004d40 0x7fe7301de870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe72fe00640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73014ec10 0x7fe7301eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 -- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73014ec10 msgr2=0x7fe7301eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73014ec10 0x7fe7301eda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 -- 172.21.15.118:0/3898222353 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7301edfc0 con 0x7fe730072270 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe735800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e230 tx=0x7fe728009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728039030 con 0x7fe730072270 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72803a040 con 0x7fe730072270 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728003990 con 0x7fe730072270 2024-03-08T20:29:31.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.428+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7301ea510 con 0x7fe730072270 2024-03-08T20:29:31.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.429+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7301ee540 con 0x7fe730072270 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.430+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe730074a40 con 0x7fe730072270 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.430+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe728045020 con 0x7fe730072270 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.431+0000 7fe72cc00640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 0x7fe71006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.431+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe7280acb90 con 0x7fe730072270 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.432+0000 7fe734e00640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 0x7fe71006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:31.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.432+0000 7fe734e00640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 0x7fe71006e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7240057f0 tx=0x7fe724000f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:31.435 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.436+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe72807b3b0 con 0x7fe730072270 2024-03-08T20:29:31.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.632+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe730153b90 con 0x7fe730072270 2024-03-08T20:29:31.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.635+0000 7fe72cc00640 1 -- 172.21.15.118:0/3898222353 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7fe72807acb0 con 0x7fe730072270 2024-03-08T20:29:31.635 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:31.635 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 msgr2=0x7fe71006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 0x7fe71006e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe7240057f0 tx=0x7fe724000f50 comp rx=0 tx=0).stop 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 msgr2=0x7fe7301eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e230 tx=0x7fe728009750 comp rx=0 tx=0).stop 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 shutdown_connections 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe71006bbd0 0x7fe71006e090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe730072270 0x7fe7301eacf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73014ec10 0x7fe7301eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 --2- 172.21.15.118:0/3898222353 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe718004d40 0x7fe7301de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:31.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.637+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 >> 172.21.15.118:0/3898222353 conn(0x7fe7300a84c0 msgr2=0x7fe7301dcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:31.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.638+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 shutdown_connections 2024-03-08T20:29:31.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:31.638+0000 7fe737800640 1 -- 172.21.15.118:0/3898222353 wait complete. 2024-03-08T20:29:32.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T20:29:23.681785+0000', 'modified': '2024-03-08T20:29:28.732819+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6834/3218952395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 3218952395}, {'type': 'v1', 'addr': '172.21.15.144:6834', 'nonce': 3218952395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-03-08T20:29:32.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T20:29:32.059 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-08T20:29:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.280+0000 7f09e1200640 1 Processor -- start 2024-03-08T20:29:32.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.280+0000 7f09e1200640 1 -- start start 2024-03-08T20:29:32.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.281+0000 7f09e1200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09dc071e70 0x7f09dc0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.281+0000 7f09e1200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc158670 0x7f09dc158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.281+0000 7f09e1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc0c2960 con 0x7f09dc06c4b0 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.281+0000 7f09e1200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0c2c40 con 0x7f09dc071e70 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.281+0000 7f09e1200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0c2f20 con 0x7f09dc158670 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09dc071e70 0x7f09dc0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09dc071e70 0x7f09dc0c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48904/0 (socket says 172.21.15.118:48904) 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 -- 172.21.15.118:0/1363229305 learned_addr learned my addr 172.21.15.118:0/1363229305 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09da800640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc158670 0x7f09dc158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 -- 172.21.15.118:0/1363229305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc158670 msgr2=0x7f09dc158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc158670 0x7f09dc158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 -- 172.21.15.118:0/1363229305 >> v1:172.21.15.144:6789/0 conn(0x7f09dc06c4b0 legacy=0x7f09dc1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.282+0000 7f09d9400640 1 -- 172.21.15.118:0/1363229305 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0c3200 con 0x7f09dc071e70 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.283+0000 7f09d9400640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc071e70 0x7f09dc0c38f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f09dc072400 tx=0x7f09c802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30502a95fcf7c637 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.283+0000 7f09d8a00640 1 -- 172.21.15.118:0/1363229305 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8034070 con 0x7f09dc071e70 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09d8a00640 1 -- 172.21.15.118:0/1363229305 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8030610 con 0x7f09dc071e70 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09d8a00640 1 -- 172.21.15.118:0/1363229305 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80309e0 con 0x7f09dc071e70 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 -- 172.21.15.118:0/1363229305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc071e70 msgr2=0x7f09dc0c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc071e70 0x7f09dc0c38f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f09dc072400 tx=0x7f09c802b960 comp rx=0 tx=0).stop 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 -- 172.21.15.118:0/1363229305 shutdown_connections 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc158670 0x7f09dc158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 --2- 172.21.15.118:0/1363229305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc071e70 0x7f09dc0c38f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 -- 172.21.15.118:0/1363229305 >> 172.21.15.118:0/1363229305 conn(0x7f09dc0a9760 msgr2=0x7f09dc0a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 -- 172.21.15.118:0/1363229305 shutdown_connections 2024-03-08T20:29:32.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.284+0000 7f09e1200640 1 -- 172.21.15.118:0/1363229305 wait complete. 2024-03-08T20:29:32.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.286+0000 7f09e1200640 1 Processor -- start 2024-03-08T20:29:32.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.286+0000 7f09e1200640 1 -- start start 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc06c4b0 0x7f09dc06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09dc071e70 0x7f09dc14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1560d0 con 0x7f09dc158670 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc06c890 con 0x7f09dc071e70 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09e1200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1565c0 con 0x7f09dc06c4b0 2024-03-08T20:29:32.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.287+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48906/0 (socket says 172.21.15.118:48906) 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 -- 172.21.15.118:0/922963393 learned_addr learned my addr 172.21.15.118:0/922963393 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09d9e00640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc06c4b0 0x7f09dc06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09d9400640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09dc071e70 0x7f09dc14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 -- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc06c4b0 msgr2=0x7f09dc06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc06c4b0 0x7f09dc06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 -- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09dc071e70 msgr2=0x7f09dc14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09dc071e70 0x7f09dc14f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 -- 172.21.15.118:0/922963393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc06e710 con 0x7f09dc158670 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09da800640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f09d400cc30 tx=0x7f09d400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09d2000640 1 -- 172.21.15.118:0/922963393 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ce40 con 0x7f09dc158670 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09d2000640 1 -- 172.21.15.118:0/922963393 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4003990 con 0x7f09dc158670 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.288+0000 7f09d2000640 1 -- 172.21.15.118:0/922963393 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4003d40 con 0x7f09dc158670 2024-03-08T20:29:32.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.289+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc06fd00 con 0x7f09dc158670 2024-03-08T20:29:32.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.289+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc06ffe0 con 0x7f09dc158670 2024-03-08T20:29:32.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.291+0000 7f09d2000640 1 -- 172.21.15.118:0/922963393 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f09d4003ee0 con 0x7f09dc158670 2024-03-08T20:29:32.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.292+0000 7f09d2000640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 0x7f09bc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.292+0000 7f09d2000640 1 -- 172.21.15.118:0/922963393 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f09d408b340 con 0x7f09dc158670 2024-03-08T20:29:32.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.293+0000 7f09d9e00640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 0x7f09bc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.293+0000 7f09e3f6c740 1 Processor -- start 2024-03-08T20:29:32.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.293+0000 7f09e3f6c740 1 -- start start 2024-03-08T20:29:32.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.293+0000 7f09d9e00640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 0x7f09bc06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09cc004ea0 tx=0x7f09cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 0x56228fcc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc7ec0 0x56228fc89e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fbee6f0 con 0x56228fcc4d50 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fb979e0 con 0x56228fcc7ec0 2024-03-08T20:29:32.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56228fbea790 con 0x56228fc8b0f0 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09d9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09d9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48912/0 (socket says 172.21.15.118:48912) 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.294+0000 7f09d9e00640 1 -- 172.21.15.118:0/1063010951 learned_addr learned my addr 172.21.15.118:0/1063010951 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9400640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 0x56228fcc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09da800640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc7ec0 0x56228fc89e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 -- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 msgr2=0x56228fcc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 0x56228fcc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 -- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc7ec0 msgr2=0x56228fc89e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc7ec0 0x56228fc89e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 -- 172.21.15.118:0/1063010951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56228fb8b720 con 0x56228fcc4d50 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9400640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 0x56228fcc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:32.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e810 tx=0x7f09cc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8fc2737c10a60b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09c6a00640 1 -- 172.21.15.118:0/1063010951 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc025070 con 0x56228fcc4d50 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09c6a00640 1 -- 172.21.15.118:0/1063010951 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc0159b0 con 0x56228fcc4d50 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.295+0000 7f09c6a00640 1 -- 172.21.15.118:0/1063010951 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc015d60 con 0x56228fcc4d50 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1063010951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 msgr2=0x56228fcc5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e810 tx=0x7f09cc011000 comp rx=0 tx=0).stop 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1063010951 shutdown_connections 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc7ec0 0x56228fc89e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fc8b0f0 0x56228fcc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1063010951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc4d50 0x56228fcc5ec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1063010951 >> 172.21.15.118:0/1063010951 conn(0x56228fc86730 msgr2=0x56228fcab140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1063010951 shutdown_connections 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.296+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1063010951 wait complete. 2024-03-08T20:29:32.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.297+0000 7f09e3f6c740 1 -- start start 2024-03-08T20:29:32.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.297+0000 7f09e3f6c740 1 Processor -- start 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 0x56228fc89f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc7ec0 0x56228fcd64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fcc7a30 con 0x56228fca8510 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fbaae20 con 0x56228fcc4d50 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56228fcc74f0 con 0x56228fcc7ec0 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09e3f6c740 10 client.0 _ll_register_callbacks cb 0x56228fbe58d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48926/0 (socket says 172.21.15.118:48926) 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09da800640 1 -- 172.21.15.118:0/1274685626 learned_addr learned my addr 172.21.15.118:0/1274685626 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 0x56228fc89f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09d9400640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc7ec0 0x56228fcd64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.298+0000 7f09da800640 1 -- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc7ec0 msgr2=0x56228fcd64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09da800640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc7ec0 0x56228fcd64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09da800640 1 -- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 msgr2=0x56228fc89f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09da800640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 0x56228fc89f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09da800640 1 -- 172.21.15.118:0/1274685626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56228f9032d0 con 0x56228fca8510 2024-03-08T20:29:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 0x56228fc89f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09da800640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09d4089430 tx=0x7f09d4059410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3365665fc23370 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09bb400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-03-08T20:29:32.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d401d030 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f09d4071180 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09cc0159b0 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d4089120 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09e3f6c740 10 client.4422 fetch_fsmap learned FSMap version 7 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56228f9cd6b0 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.299+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc0159b0 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f09d40559c0 con 0x56228fca8510 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 20 client.4422 populate_metadata read hostname 'smithi118' 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fcda070 0x56228fce4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 4 client.4422 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 --> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56228fbfbc30 con 0x56228fcda070 2024-03-08T20:29:32.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.300+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fcda070 0x56228fce4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.301+0000 7f09d9e00640 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fcda070 0x56228fce4dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221c65b5e441ed40 server_cookie=94920558aaf43905 in_seq=0 out_seq=0 2024-03-08T20:29:32.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.301+0000 7f09bb400640 10 client.4422 ms_handle_connect on v2:172.21.15.144:6832/3218952395 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.303+0000 7f09bb400640 1 -- 172.21.15.118:0/1274685626 <== mds.0 v2:172.21.15.144:6832/3218952395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56228fbfbc30 con 0x56228fcda070 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.303+0000 7f09bb400640 10 client.4422 handle_command_reply: tid=0 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.303+0000 7f09e3f6c740 1 client.4422 shutdown 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 msgr2=0x56228fcc1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09d4089430 tx=0x7f09d4059410 comp rx=0 tx=0).stop 2024-03-08T20:29:32.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 shutdown_connections 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fcda070 0x56228fce4dd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fca8510 0x56228fcc1360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc7ec0 0x56228fcd64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09bb400640 0 client.4422 ms_handle_reset on v2:172.21.15.144:6832/3218952395 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/1274685626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fcc4d50 0x56228fc89f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 >> 172.21.15.118:0/1274685626 conn(0x56228fc8b0f0 msgr2=0x56228fcc9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 shutdown_connections 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 1 -- 172.21.15.118:0/1274685626 wait complete. 2024-03-08T20:29:32.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.304+0000 7f09e3f6c740 20 client.4422 trim_cache size 0 max 16384 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.321+0000 7f09e3f6c740 1 Processor -- start 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.321+0000 7f09e3f6c740 1 -- start start 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fc85770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fcaa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1f7b40 con 0x56228fcc7ec0 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1f6f40 con 0x56228fca8510 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1f7540 con 0x56228fcc4d50 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48936/0 (socket says 172.21.15.118:48936) 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 -- 172.21.15.118:0/440983985 learned_addr learned my addr 172.21.15.118:0/440983985 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09d9400640 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fcaa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09d9e00640 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fc85770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 -- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 msgr2=0x56228fcaa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fcaa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 -- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 msgr2=0x56228fc85770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fc85770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.322+0000 7f09da800640 1 -- 172.21.15.118:0/440983985 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56228fc854a0 con 0x56228fcc7ec0 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.323+0000 7f09da800640 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09d4059050 tx=0x7f09d405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d9e142a34436bd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.325+0000 7f09c6000640 1 -- 172.21.15.118:0/440983985 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d401d040 con 0x56228fcc7ec0 2024-03-08T20:29:32.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.325+0000 7f09c6000640 1 -- 172.21.15.118:0/440983985 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d405d1d0 con 0x56228fcc7ec0 2024-03-08T20:29:32.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.325+0000 7f09c6000640 1 -- 172.21.15.118:0/440983985 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40559c0 con 0x56228fcc7ec0 2024-03-08T20:29:32.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 -- 172.21.15.118:0/440983985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 msgr2=0x56228fcaaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09d4059050 tx=0x7f09d405c000 comp rx=0 tx=0).stop 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 -- 172.21.15.118:0/440983985 shutdown_connections 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcaaf20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fcaa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/440983985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fc85770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 -- 172.21.15.118:0/440983985 >> 172.21.15.118:0/440983985 conn(0x56228fc8b0f0 msgr2=0x56228fcd6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 -- 172.21.15.118:0/440983985 shutdown_connections 2024-03-08T20:29:32.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.326+0000 7f09e3f6c740 1 -- 172.21.15.118:0/440983985 wait complete. 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.327+0000 7f09e3f6c740 1 -- start start 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.327+0000 7f09e3f6c740 1 Processor -- start 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fd2e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fce9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fca7fc0 con 0x56228fcc7ec0 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56228fcc32b0 con 0x56228fca8510 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56228fcd6f30 con 0x56228fcc4d50 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09e3f6c740 10 client.0 _ll_register_callbacks cb 0x7f09cc007e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48952/0 (socket says 172.21.15.118:48952) 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 -- 172.21.15.118:0/3869676924 learned_addr learned my addr 172.21.15.118:0/3869676924 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09d9400640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fce9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 -- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 msgr2=0x56228fce9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fce9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 -- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 msgr2=0x56228fd2e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fd2e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.328+0000 7f09da800640 1 -- 172.21.15.118:0/3869676924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56228fcda680 con 0x56228fcc7ec0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09da800640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09d40557b0 tx=0x7f09d405c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1807acc45fa0d89a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d407e070 con 0x56228fcc7ec0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f09d4071180 con 0x56228fcc7ec0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09d405d1d0 con 0x56228fcc7ec0 2024-03-08T20:29:32.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09d40587a0 con 0x56228fcc7ec0 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 10 client.4428 fetch_fsmap learned FSMap version 7 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56228fcbf350 con 0x56228fcc7ec0 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d405d1d0 con 0x56228fcc7ec0 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f09d4058940 con 0x56228fcc7ec0 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 20 client.4428 populate_metadata read hostname 'smithi118' 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fc876f0 0x56228fc87ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 4 client.4428 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T20:29:32.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.329+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 --> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56228fcc3900 con 0x56228fc876f0 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.330+0000 7f09d9e00640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fc876f0 0x56228fc87ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.331+0000 7f09d9e00640 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fc876f0 0x56228fc87ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233bf1fb5c280afe server_cookie=10671064fb2ebeac in_seq=0 out_seq=0 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.331+0000 7f09bb400640 10 client.4428 ms_handle_connect on v2:172.21.15.144:6832/3218952395 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09bb400640 1 -- 172.21.15.118:0/3869676924 <== mds.0 v2:172.21.15.144:6832/3218952395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56228fcc3900 con 0x56228fc876f0 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09bb400640 10 client.4428 handle_command_reply: tid=0 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 client.4428 shutdown 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 msgr2=0x56228fcbabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09d40557b0 tx=0x7f09d405c070 comp rx=0 tx=0).stop 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 shutdown_connections 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x56228fc876f0 0x56228fc87ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56228fcc7ec0 0x56228fcbabf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56228fcc4d50 0x56228fce9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09bb400640 0 client.4428 ms_handle_reset on v2:172.21.15.144:6832/3218952395 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 --2- 172.21.15.118:0/3869676924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56228fca8510 0x56228fd2e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 >> 172.21.15.118:0/3869676924 conn(0x56228fc8b0f0 msgr2=0x56228fc88ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 shutdown_connections 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 1 -- 172.21.15.118:0/3869676924 wait complete. 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.332+0000 7f09e3f6c740 20 client.4428 trim_cache size 0 max 16384 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "ac17b673-6e59-4db3-9519-ba644ea1ee5b", 2024-03-08T20:29:32.334 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4278, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 8.1173115490000001, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 7, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 25, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 25, 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 15.742455055000001 2024-03-08T20:29:32.335 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 msgr2=0x7f09bc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 0x7f09bc06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f09cc004ea0 tx=0x7f09cc009040 comp rx=0 tx=0).stop 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 msgr2=0x7f09dc0ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f09d400cc30 tx=0x7f09d400a5c0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 shutdown_connections 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09bc06bbd0 0x7f09bc06e090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09dc158670 0x7f09dc0ab650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09dc071e70 0x7f09dc14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 --2- 172.21.15.118:0/922963393 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09dc06c4b0 0x7f09dc06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 >> 172.21.15.118:0/922963393 conn(0x7f09dc0a9760 msgr2=0x7f09dc0a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 shutdown_connections 2024-03-08T20:29:32.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.333+0000 7f09e1200640 1 -- 172.21.15.118:0/922963393 wait complete. 2024-03-08T20:29:32.351 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T20:29:32.351 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:32.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T20:29:32.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.549+0000 7fed1b800640 1 Processor -- start 2024-03-08T20:29:32.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.549+0000 7fed1b800640 1 -- start start 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.550+0000 7fed1b800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fed140c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed1b800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed140c3e90 con 0x7fed140aa7e0 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed1b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed140c1210 con 0x7fed14151ce0 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed1b800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c14f0 con 0x7fed1414f210 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fed140aa7e0 0x7fed1406ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33074/0 (socket says 172.21.15.118:33074) 2024-03-08T20:29:32.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13e00640 1 -- 172.21.15.118:0/4229061727 learned_addr learned my addr 172.21.15.118:0/4229061727 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:32.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed18e00640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fed140c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068789434 0 0) 0x7fed140c3e90 con 0x7fed140aa7e0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecfc003520 con 0x7fed140aa7e0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199423082 0 0) 0x7fecfc003520 con 0x7fed140aa7e0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 msgr2=0x7fed140c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fed140c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.551+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 >> v1:172.21.15.144:6789/0 conn(0x7fed14151ce0 legacy=0x7fed14152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140c0cc0 con 0x7fed140aa7e0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fed00001670 con 0x7fed140aa7e0 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 >> v1:172.21.15.118:6789/0 conn(0x7fed140aa7e0 legacy=0x7fed1406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fecfc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc003f60 0x7fecfc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc004d40 0x7fecfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140c14f0 con 0x7fecfc004d40 2024-03-08T20:29:32.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc00bc00 con 0x7fecfc003f60 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc00e010 con 0x7fed1414f210 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc004d40 0x7fecfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed18e00640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fecfc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13e00640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc003f60 0x7fecfc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 -- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 msgr2=0x7fecfc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed1414f210 0x7fecfc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 -- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc003f60 msgr2=0x7fecfc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc003f60 0x7fecfc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed19800640 1 -- 172.21.15.118:0/4229061727 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc003520 con 0x7fecfc004d40 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.552+0000 7fed13e00640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc003f60 0x7fecfc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:32.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.553+0000 7fed19800640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc004d40 0x7fecfc0051c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001e50 tx=0x7fecfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23623bc47efb7be5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c001a70 con 0x7fecfc004d40 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c003b70 con 0x7fecfc004d40 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed13400640 1 -- 172.21.15.118:0/4229061727 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0050d0 con 0x7fecfc004d40 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 -- 172.21.15.118:0/4229061727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc004d40 msgr2=0x7fecfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 --2- 172.21.15.118:0/4229061727 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc004d40 0x7fecfc0051c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001e50 tx=0x7fecfc005830 comp rx=0 tx=0).stop 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed19800640 1 -- 172.21.15.118:0/4229061727 reap_dead start 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 -- 172.21.15.118:0/4229061727 shutdown_connections 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 -- 172.21.15.118:0/4229061727 >> 172.21.15.118:0/4229061727 conn(0x7fed140a84c0 msgr2=0x7fed140a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 -- 172.21.15.118:0/4229061727 shutdown_connections 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.554+0000 7fed1b800640 1 -- 172.21.15.118:0/4229061727 wait complete. 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.556+0000 7fed1b800640 1 Processor -- start 2024-03-08T20:29:32.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.556+0000 7fed1b800640 1 -- start start 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc004d40 0x7fed141ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed140c4be0 0x7fed140c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1406b5a0 con 0x7fed140c5040 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1406b420 con 0x7fecfc004d40 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed1b800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1414f5f0 con 0x7fed140c4be0 2024-03-08T20:29:32.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed19800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed19800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48970/0 (socket says 172.21.15.118:48970) 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.557+0000 7fed19800640 1 -- 172.21.15.118:0/3747906119 learned_addr learned my addr 172.21.15.118:0/3747906119 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed18e00640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc004d40 0x7fed141ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed13e00640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed140c4be0 0x7fed140c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 -- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed140c4be0 msgr2=0x7fed140c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed140c4be0 0x7fed140c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 -- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc004d40 msgr2=0x7fed141ee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc004d40 0x7fed141ee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 -- 172.21.15.118:0/3747906119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140c45d0 con 0x7fed140c5040 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed19800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001f40 tx=0x7fed0c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c007db0 con 0x7fed140c5040 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c003970 con 0x7fed140c5040 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed141eb860 con 0x7fed140c5040 2024-03-08T20:29:32.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.558+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c006d70 con 0x7fed140c5040 2024-03-08T20:29:32.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.559+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed141466e0 con 0x7fed140c5040 2024-03-08T20:29:32.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.560+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed14074a40 con 0x7fed140c5040 2024-03-08T20:29:32.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.561+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fed0c007030 con 0x7fed140c5040 2024-03-08T20:29:32.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.562+0000 7fed10c00640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 0x7fecf406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:32.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.562+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fed0c0abff0 con 0x7fed140c5040 2024-03-08T20:29:32.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.562+0000 7fed18e00640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 0x7fecf406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:32.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.563+0000 7fed18e00640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 0x7fecf406e0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed08009950 tx=0x7fed08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:32.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.567+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fed0c033020 con 0x7fed140c5040 2024-03-08T20:29:32.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.802+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fed1406b720 con 0x7fed140c5040 2024-03-08T20:29:32.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.803+0000 7fed10c00640 1 -- 172.21.15.118:0/3747906119 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fed0c07a830 con 0x7fed140c5040 2024-03-08T20:29:32.802 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.805+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 msgr2=0x7fecf406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.805+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 0x7fecf406e0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed08009950 tx=0x7fed08008040 comp rx=0 tx=0).stop 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.805+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 msgr2=0x7fed140c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.805+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001f40 tx=0x7fed0c0014a0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 shutdown_connections 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecf406bc00 0x7fecf406e0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed140c5040 0x7fed140c6d40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fed140c4be0 0x7fed140c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 --2- 172.21.15.118:0/3747906119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc004d40 0x7fed141ee220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:32.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 >> 172.21.15.118:0/3747906119 conn(0x7fed140a84c0 msgr2=0x7fed140c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:32.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 shutdown_connections 2024-03-08T20:29:32.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:32.806+0000 7fed1b800640 1 -- 172.21.15.118:0/3747906119 wait complete. 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:32.825 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-08T20:29:32.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T20:29:32.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T20:29:32.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-08T20:29:32.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:32.826 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-03-08T20:29:32.876 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T20:29:32.876 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T20:29:32.876 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T20:29:32.876 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:29:32.877 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42569sec preferred_lft 42569sec 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-03-08T20:29:32.878 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:29:32.878 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T20:29:32.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T20:29:32.879 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:29:33.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:33.319 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T20:29:33.393 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-03-08T20:29:33.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:33.397 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-03-08T20:29:33.455 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-03-08T20:29:33.455 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T20:29:33.455 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-08T20:29:33.456 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-08T20:29:33.456 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T20:29:33.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:33.456 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:29:33.456 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:29:33.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-08T20:29:33.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-08T20:29:33.456 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-08T20:29:33.457 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:29:35.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:35.362 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-08T20:29:35.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:35.417 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-03-08T20:29:35.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:35.471 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:29:35.471 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:29:35.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:29:35.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-08T20:29:35.471 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:29:35.611 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-08T20:29:35.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:35.612 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:29:35.612 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:29:35.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-08T20:29:35.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T20:29:35.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-08T20:29:35.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-08T20:29:35.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-08T20:29:35.613 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:29:35.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:35.895 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:29:35.896 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:29:35.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-03-08T20:29:35.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T20:29:35.896 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:29:36.056 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-08T20:29:36.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:29:36.056 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:36.107 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-08T20:29:36.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:29:36.107 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:36.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-08T20:29:36.299 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T20:29:36.347 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-08T20:29:36.347 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-08T20:29:36.347 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-08T20:29:36.347 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-08T20:29:36.347 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-08T20:29:36.348 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:29:36.349 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:29:36.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:36.350 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-08T20:29:36.390 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-08T20:29:36.390 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-08T20:29:36.437 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-08T20:29:36.511 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-08T20:29:36.551 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-08T20:29:36.552 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:29:36.553 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:29:36.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:36.554 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-08T20:29:36.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:2024-03-08T20:29:36.618+0000 7f8b66244480 -1 init, newargv = 0x55df791eb1e0 newargc=15 2024-03-08T20:29:36.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[42189]: starting ceph client 2024-03-08T20:29:36.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[42189]: starting fuse 2024-03-08T20:29:36.636 INFO:teuthology.orchestra.run.smithi118.stdout:42 2024-03-08T20:29:36.636 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-08T20:29:36.636 DEBUG:teuthology.orchestra.run.smithi118:> sudo stdin-killer -- python3 -c ' 2024-03-08T20:29:36.636 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2024-03-08T20:29:36.636 DEBUG:teuthology.orchestra.run.smithi118:> import re 2024-03-08T20:29:36.636 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-03-08T20:29:36.636 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-08T20:29:36.637 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> return f 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.admin")) 2024-03-08T20:29:36.638 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-03-08T20:29:36.835 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.admin.42189.asok 2024-03-08T20:29:36.839 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-08T20:29:36.851 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42189.asok 2024-03-08T20:29:36.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:36.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42189.asok status 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "7d63482aa89628d733e298984a762389b625c761", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.0.0-1965-g7d63482a (7d63482aa89628d733e298984a762389b625c761) squid (dev)", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "admin", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "42189", 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:29:37.091 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4440, 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4440 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3447357676 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:29:37.092 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3447357676 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4440 192.168.0.1:0/3447357676", 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/3447357676", 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 7, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 25, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2024-03-08T20:29:37.093 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:29:37.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:37.106 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2024-03-08T20:29:37.106 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:37.162 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2024-03-08T20:29:37.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:37.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:37.163 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:37.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:37.255 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-08T20:29:37.367 INFO:teuthology.orchestra.run.smithi118.stdout:# file: . 2024-03-08T20:29:37.368 INFO:teuthology.orchestra.run.smithi118.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-08T20:29:37.368 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:37.369 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:37.369 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:29:37.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:37.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.632+0000 7fcf13c00640 1 Processor -- start 2024-03-08T20:29:37.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.632+0000 7fcf13c00640 1 -- start start 2024-03-08T20:29:37.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf0c157ed0 0x7fcf0c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf0c158960 0x7fcf0c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c1582b0 con 0x7fcf0c158960 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c1584d0 con 0x7fcf0c157ed0 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf13c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0c4f80 con 0x7fcf0c0c3710 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf11c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf0c158960 0x7fcf0c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf11c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcf0c158960 0x7fcf0c158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48978/0 (socket says 172.21.15.118:48978) 2024-03-08T20:29:37.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf11c00640 1 -- 172.21.15.118:0/235718589 learned_addr learned my addr 172.21.15.118:0/235718589 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf03e00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.634+0000 7fcf11200640 1 --2- 172.21.15.118:0/235718589 >> v2:172.21.15.144:3300/0 conn(0x7fcf0c157ed0 0x7fcf0c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.635+0000 7fcf11c00640 1 -- 172.21.15.118:0/235718589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 msgr2=0x7fcf0c0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.635+0000 7fcf11c00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.635+0000 7fcf11c00640 1 -- 172.21.15.118:0/235718589 >> v2:172.21.15.144:3300/0 conn(0x7fcf0c157ed0 msgr2=0x7fcf0c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.635+0000 7fcf11c00640 1 --2- 172.21.15.118:0/235718589 >> v2:172.21.15.144:3300/0 conn(0x7fcf0c157ed0 0x7fcf0c0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.635+0000 7fcf11c00640 1 -- 172.21.15.118:0/235718589 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0c5260 con 0x7fcf0c158960 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.636+0000 7fcf11c00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c158df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0c5bc0 tx=0x7fcf0402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed14caec2be7b52 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.636+0000 7fcf0be00640 1 -- 172.21.15.118:0/235718589 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0402c9e0 con 0x7fcf0c158960 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.636+0000 7fcf0be00640 1 -- 172.21.15.118:0/235718589 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0402cb80 con 0x7fcf0c158960 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.636+0000 7fcf0be00640 1 -- 172.21.15.118:0/235718589 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040343f0 con 0x7fcf0c158960 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 -- 172.21.15.118:0/235718589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 msgr2=0x7fcf0c158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c158df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0c5bc0 tx=0x7fcf0402be40 comp rx=0 tx=0).stop 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 -- 172.21.15.118:0/235718589 shutdown_connections 2024-03-08T20:29:37.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c158df0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 --2- 172.21.15.118:0/235718589 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 --2- 172.21.15.118:0/235718589 >> v2:172.21.15.144:3300/0 conn(0x7fcf0c157ed0 0x7fcf0c0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 -- 172.21.15.118:0/235718589 >> 172.21.15.118:0/235718589 conn(0x7fcf0c0aa290 msgr2=0x7fcf0c0aa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 -- 172.21.15.118:0/235718589 shutdown_connections 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.637+0000 7fcf13c00640 1 -- 172.21.15.118:0/235718589 wait complete. 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.639+0000 7fcf13c00640 1 Processor -- start 2024-03-08T20:29:37.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.639+0000 7fcf13c00640 1 -- start start 2024-03-08T20:29:37.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0c157ed0 0x7fcf0c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c159330 con 0x7fcf0c158960 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0c5820 con 0x7fcf0c157ed0 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf13c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0c4c40 con 0x7fcf0c0c3710 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf11c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf11c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48984/0 (socket says 172.21.15.118:48984) 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.640+0000 7fcf11c00640 1 -- 172.21.15.118:0/3983736116 learned_addr learned my addr 172.21.15.118:0/3983736116 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11200640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf03e00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0c157ed0 0x7fcf0c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 -- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 msgr2=0x7fcf0c1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 -- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0c157ed0 msgr2=0x7fcf0c0ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:37.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0c157ed0 0x7fcf0c0ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 -- 172.21.15.118:0/3983736116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c1eba00 con 0x7fcf0c158960 2024-03-08T20:29:37.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf11c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf04036040 tx=0x7fcf04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:37.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04043020 con 0x7fcf0c158960 2024-03-08T20:29:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.641+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0403e450 con 0x7fcf0c158960 2024-03-08T20:29:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.642+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c070b50 con 0x7fcf0c158960 2024-03-08T20:29:37.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.642+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04009510 con 0x7fcf0c158960 2024-03-08T20:29:37.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.642+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c1eb690 con 0x7fcf0c158960 2024-03-08T20:29:37.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.643+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c068420 con 0x7fcf0c158960 2024-03-08T20:29:37.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.644+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcf04046020 con 0x7fcf0c158960 2024-03-08T20:29:37.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.645+0000 7fcf09600640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 0x7fcee806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:37.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.645+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcf040ad340 con 0x7fcf0c158960 2024-03-08T20:29:37.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.645+0000 7fcf11200640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 0x7fcee806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:37.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.646+0000 7fcf11200640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 0x7fcee806e0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcefc006fd0 tx=0x7fcefc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:37.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.649+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fcf0c068420 con 0x7fcf0c158960 2024-03-08T20:29:37.846 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.847+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf0c074a40 con 0x7fcf0c158960 2024-03-08T20:29:37.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.849+0000 7fcf09600640 1 -- 172.21.15.118:0/3983736116 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7fcf0404d070 con 0x7fcf0c158960 2024-03-08T20:29:37.850 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:37.851 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.851+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 msgr2=0x7fcee806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 0x7fcee806e0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcefc006fd0 tx=0x7fcefc008040 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 msgr2=0x7fcf0c06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf04036040 tx=0x7fcf04004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 shutdown_connections 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fcee806bc00 0x7fcee806e0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcf0c158960 0x7fcf0c06ee60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf0c157ed0 0x7fcf0c0ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 --2- 172.21.15.118:0/3983736116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf0c0c3710 0x7fcf0c1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 >> 172.21.15.118:0/3983736116 conn(0x7fcf0c0aa290 msgr2=0x7fcf0c153720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 shutdown_connections 2024-03-08T20:29:37.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:37.852+0000 7fcf13c00640 1 -- 172.21.15.118:0/3983736116 wait complete. 2024-03-08T20:29:37.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:29:37.871 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:29:38.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.084+0000 7f6499000640 1 Processor -- start 2024-03-08T20:29:38.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.085+0000 7f6499000640 1 -- start start 2024-03-08T20:29:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6499000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940c8700 0x7f6494154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6499000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64940bde90 0x7f64941554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6499000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6494159080 con 0x7f6494152570 2024-03-08T20:29:38.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6499000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6494158e30 con 0x7f64940bde90 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6499000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6494159360 con 0x7f64940c8700 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6492800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64940bde90 0x7f64941554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6492800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64940bde90 0x7f64941554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:48990/0 (socket says 172.21.15.118:48990) 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.086+0000 7f6492800640 1 -- 172.21.15.118:0/3468578157 learned_addr learned my addr 172.21.15.118:0/3468578157 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.087+0000 7f6489400640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940c8700 0x7f6494154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.087+0000 7f6492800640 1 -- 172.21.15.118:0/3468578157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940c8700 msgr2=0x7f6494154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.087+0000 7f6492800640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940c8700 0x7f6494154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.087+0000 7f6492800640 1 -- 172.21.15.118:0/3468578157 >> v1:172.21.15.144:6789/0 conn(0x7f6494152570 legacy=0x7f64940caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:38.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.087+0000 7f6492800640 1 -- 172.21.15.118:0/3468578157 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940c52b0 con 0x7f64940bde90 2024-03-08T20:29:38.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.088+0000 7f6492800640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940bde90 0x7f64941554c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f648c009e50 tx=0x7f648c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5da3fccbfbf1ffc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.088+0000 7f6491400640 1 -- 172.21.15.118:0/3468578157 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c02c950 con 0x7f64940bde90 2024-03-08T20:29:38.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.088+0000 7f6491400640 1 -- 172.21.15.118:0/3468578157 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c02caf0 con 0x7f64940bde90 2024-03-08T20:29:38.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.088+0000 7f6491400640 1 -- 172.21.15.118:0/3468578157 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0343f0 con 0x7f64940bde90 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 -- 172.21.15.118:0/3468578157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940bde90 msgr2=0x7f64941554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940bde90 0x7f64941554c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f648c009e50 tx=0x7f648c02bdb0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 -- 172.21.15.118:0/3468578157 shutdown_connections 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940c8700 0x7f6494154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 --2- 172.21.15.118:0/3468578157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940bde90 0x7f64941554c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 -- 172.21.15.118:0/3468578157 >> 172.21.15.118:0/3468578157 conn(0x7f6494072620 msgr2=0x7f6494072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 -- 172.21.15.118:0/3468578157 shutdown_connections 2024-03-08T20:29:38.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.089+0000 7f6499000640 1 -- 172.21.15.118:0/3468578157 wait complete. 2024-03-08T20:29:38.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.091+0000 7f6499000640 1 Processor -- start 2024-03-08T20:29:38.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.091+0000 7f6499000640 1 -- start start 2024-03-08T20:29:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 0x7f64940aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494152570 0x7f6494156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940cb200 con 0x7f64940c8700 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649406dcd0 con 0x7f6494152570 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6499000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940cb380 con 0x7f64940bde90 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49004/0 (socket says 172.21.15.118:49004) 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 -- 172.21.15.118:0/1838714708 learned_addr learned my addr 172.21.15.118:0/1838714708 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6491e00640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 0x7f64940aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 -- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 msgr2=0x7f64940aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6492800640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494152570 0x7f6494156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 0x7f64940aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 -- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494152570 msgr2=0x7f6494156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494152570 0x7f6494156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6489400640 1 -- 172.21.15.118:0/1838714708 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940ad4c0 con 0x7f64940c8700 2024-03-08T20:29:38.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.092+0000 7f6491e00640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 0x7f64940aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f6489400640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c820 tx=0x7f647c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c015070 con 0x7f64940c8700 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c004220 con 0x7f64940c8700 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940b00a0 con 0x7f64940c8700 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00ce10 con 0x7f64940c8700 2024-03-08T20:29:38.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.093+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940b0380 con 0x7f64940c8700 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.094+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6494074a40 con 0x7f64940c8700 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.095+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f647c0077d0 con 0x7f64940c8700 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.096+0000 7f648aa00640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 0x7f647006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.096+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f647c08ae70 con 0x7f64940c8700 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.096+0000 7f6491e00640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 0x7f647006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.097+0000 7f6491e00640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 0x7f647006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64940caf90 tx=0x7f6484008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.102+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f647c0596b0 con 0x7f64940c8700 2024-03-08T20:29:38.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.297+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64940ad9a0 con 0x7f64940c8700 2024-03-08T20:29:38.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.297+0000 7f648aa00640 1 -- 172.21.15.118:0/1838714708 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f647c058fb0 con 0x7f64940c8700 2024-03-08T20:29:38.297 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:29:38.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 msgr2=0x7f647006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 0x7f647006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64940caf90 tx=0x7f6484008040 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 msgr2=0x7f64940af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c820 tx=0x7f647c00cce0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 shutdown_connections 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f647006bbd0 0x7f647006e090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494152570 0x7f6494156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64940c8700 0x7f64940af860 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 --2- 172.21.15.118:0/1838714708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64940bde90 0x7f64940aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 >> 172.21.15.118:0/1838714708 conn(0x7f6494072620 msgr2=0x7f6494072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 shutdown_connections 2024-03-08T20:29:38.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.300+0000 7f6499000640 1 -- 172.21.15.118:0/1838714708 wait complete. 2024-03-08T20:29:38.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:29:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.527+0000 7f599aa00640 1 Processor -- start 2024-03-08T20:29:38.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.527+0000 7f599aa00640 1 -- start start 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.528+0000 7f599aa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5994072f40 0x7f59940c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f599aa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994152820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f599aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59940c6390 con 0x7f59940c5ad0 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f599aa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599406cf90 con 0x7f5994072f40 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f599aa00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994156190 con 0x7f59940c29a0 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5994072f40 0x7f59940c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5994072f40 0x7f59940c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49018/0 (socket says 172.21.15.118:49018) 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 -- 172.21.15.118:0/1480804319 learned_addr learned my addr 172.21.15.118:0/1480804319 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:38.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5998a00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 -- 172.21.15.118:0/1480804319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 msgr2=0x7f5994152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 -- 172.21.15.118:0/1480804319 >> v1:172.21.15.144:6789/0 conn(0x7f59940c5ad0 legacy=0x7f5994152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5993e00640 1 -- 172.21.15.118:0/1480804319 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994155610 con 0x7f5994072f40 2024-03-08T20:29:38.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.529+0000 7f5998a00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.530+0000 7f5993e00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f59940c5590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5984009e50 tx=0x7f598402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32efdbd3770cacd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f5993400640 1 -- 172.21.15.118:0/1480804319 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598402ca80 con 0x7f5994072f40 2024-03-08T20:29:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f5993400640 1 -- 172.21.15.118:0/1480804319 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598402cc20 con 0x7f5994072f40 2024-03-08T20:29:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f5993400640 1 -- 172.21.15.118:0/1480804319 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840343f0 con 0x7f5994072f40 2024-03-08T20:29:38.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f599aa00640 1 -- 172.21.15.118:0/1480804319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 msgr2=0x7f59940c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f599aa00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f59940c5590 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5984009e50 tx=0x7f598402bee0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f599aa00640 1 -- 172.21.15.118:0/1480804319 shutdown_connections 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f599aa00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.531+0000 7f599aa00640 1 --2- 172.21.15.118:0/1480804319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f59940c5590 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.532+0000 7f599aa00640 1 -- 172.21.15.118:0/1480804319 >> 172.21.15.118:0/1480804319 conn(0x7f599406b720 msgr2=0x7f59940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.532+0000 7f599aa00640 1 -- 172.21.15.118:0/1480804319 shutdown_connections 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.532+0000 7f599aa00640 1 -- 172.21.15.118:0/1480804319 wait complete. 2024-03-08T20:29:38.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.533+0000 7f599aa00640 1 Processor -- start 2024-03-08T20:29:38.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.533+0000 7f599aa00640 1 -- start start 2024-03-08T20:29:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59940c5ad0 0x7f59941477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994155eb0 con 0x7f5994072f40 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5994155bd0 con 0x7f59940c5ad0 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f599aa00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994073320 con 0x7f59940c29a0 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.534+0000 7f5993e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49030/0 (socket says 172.21.15.118:49030) 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 -- 172.21.15.118:0/2120247660 learned_addr learned my addr 172.21.15.118:0/2120247660 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f598b400640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5998a00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59940c5ad0 0x7f59941477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.535 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 -- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 msgr2=0x7f5994153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 -- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59940c5ad0 msgr2=0x7f59941477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59940c5ad0 0x7f59941477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 -- 172.21.15.118:0/2120247660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994148960 con 0x7f5994072f40 2024-03-08T20:29:38.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5993e00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5984036040 tx=0x7f5984004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.535+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984043020 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.536+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598403e450 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.536+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598403e840 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.536+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59940aab10 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.536+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599414b1d0 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.537+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599414afc0 con 0x7f5994072f40 2024-03-08T20:29:38.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.538+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5984046020 con 0x7f5994072f40 2024-03-08T20:29:38.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.539+0000 7f5990c00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 0x7f597006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.539+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f59840ad710 con 0x7f5994072f40 2024-03-08T20:29:38.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.539+0000 7f598b400640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 0x7f597006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.539+0000 7f598b400640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 0x7f597006e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.544+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f598404d030 con 0x7f5994072f40 2024-03-08T20:29:38.743 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.743+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5994074a40 con 0x7f5994072f40 2024-03-08T20:29:38.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.744+0000 7f5990c00640 1 -- 172.21.15.118:0/2120247660 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5994148960 con 0x7f5994072f40 2024-03-08T20:29:38.744 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 msgr2=0x7f597006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 0x7f597006e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f597c007fd0 tx=0x7f597c009040 comp rx=0 tx=0).stop 2024-03-08T20:29:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 msgr2=0x7f5994148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5984036040 tx=0x7f5984004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 shutdown_connections 2024-03-08T20:29:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f597006bbd0 0x7f597006e090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59940c5ad0 0x7f59941477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59940c29a0 0x7f5994153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 --2- 172.21.15.118:0/2120247660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5994072f40 0x7f5994148420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 >> 172.21.15.118:0/2120247660 conn(0x7f599406b720 msgr2=0x7f59940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 shutdown_connections 2024-03-08T20:29:38.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.747+0000 7f599aa00640 1 -- 172.21.15.118:0/2120247660 wait complete. 2024-03-08T20:29:38.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:29:38.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.971+0000 7f8dd3600640 1 Processor -- start 2024-03-08T20:29:38.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.971+0000 7f8dd3600640 1 -- start start 2024-03-08T20:29:38.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd3600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc152570 0x7f8dcc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd3600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8dcc0bde90 0x7f8dcc155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd3600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc159080 con 0x7f8dcc0c8700 2024-03-08T20:29:38.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd3600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc158e30 con 0x7f8dcc0bde90 2024-03-08T20:29:38.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd3600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc159360 con 0x7f8dcc152570 2024-03-08T20:29:38.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dcbe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8dcc0c8700 0x7f8dcc154f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33076/0 (socket says 172.21.15.118:33076) 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dcbe00640 1 -- 172.21.15.118:0/451848359 learned_addr learned my addr 172.21.15.118:0/451848359 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd1600640 1 --2- 172.21.15.118:0/451848359 >> v2:172.21.15.118:3300/0 conn(0x7f8dcc0bde90 0x7f8dcc155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.973+0000 7f8dd0c00640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc152570 0x7f8dcc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dcb400640 1 -- 172.21.15.118:0/451848359 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50372311 0 0) 0x7f8dcc159080 con 0x7f8dcc0c8700 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dcb400640 1 -- 172.21.15.118:0/451848359 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003520 con 0x7f8dcc0c8700 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dd1600640 1 -- 172.21.15.118:0/451848359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc152570 msgr2=0x7f8dcc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dd1600640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc152570 0x7f8dcc0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dd1600640 1 -- 172.21.15.118:0/451848359 >> v1:172.21.15.118:6789/0 conn(0x7f8dcc0c8700 legacy=0x7f8dcc154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.974+0000 7f8dd1600640 1 -- 172.21.15.118:0/451848359 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0c52b0 con 0x7f8dcc0bde90 2024-03-08T20:29:38.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.975+0000 7f8dd1600640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0bde90 0x7f8dcc155690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097a0 tx=0x7f8dc402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d462225f1bf7f6cd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.975+0000 7f8dcb400640 1 -- 172.21.15.118:0/451848359 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4038070 con 0x7f8dcc0bde90 2024-03-08T20:29:38.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.975+0000 7f8dcb400640 1 -- 172.21.15.118:0/451848359 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4031700 con 0x7f8dcc0bde90 2024-03-08T20:29:38.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.975+0000 7f8dcb400640 1 -- 172.21.15.118:0/451848359 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031ad0 con 0x7f8dcc0bde90 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 -- 172.21.15.118:0/451848359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0bde90 msgr2=0x7f8dcc155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0bde90 0x7f8dcc155690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097a0 tx=0x7f8dc402b7a0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 -- 172.21.15.118:0/451848359 shutdown_connections 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0bde90 0x7f8dcc155690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 --2- 172.21.15.118:0/451848359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc152570 0x7f8dcc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 -- 172.21.15.118:0/451848359 >> 172.21.15.118:0/451848359 conn(0x7f8dcc072620 msgr2=0x7f8dcc072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 -- 172.21.15.118:0/451848359 shutdown_connections 2024-03-08T20:29:38.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.976+0000 7f8dd3600640 1 -- 172.21.15.118:0/451848359 wait complete. 2024-03-08T20:29:38.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.978+0000 7f8dd3600640 1 Processor -- start 2024-03-08T20:29:38.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.978+0000 7f8dd3600640 1 -- start start 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc0bde90 0x7f8dcc0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 0x7f8dcc147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc06dcd0 con 0x7f8dcc0c8700 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc155bd0 con 0x7f8dcc152570 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd3600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0cb030 con 0x7f8dcc0bde90 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dcbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dcbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49046/0 (socket says 172.21.15.118:49046) 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dcbe00640 1 -- 172.21.15.118:0/1184148707 learned_addr learned my addr 172.21.15.118:0/1184148707 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd0c00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc0bde90 0x7f8dcc0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.979+0000 7f8dd1600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 0x7f8dcc147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 -- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc0bde90 msgr2=0x7f8dcc0ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc0bde90 0x7f8dcc0ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 -- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 msgr2=0x7f8dcc147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 0x7f8dcc147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 -- 172.21.15.118:0/1184148707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0acca0 con 0x7f8dcc0c8700 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dd1600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 0x7f8dcc147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dcbe00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8db400cbb0 tx=0x7f8db400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8dcc0c8700 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.980+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400ad60 con 0x7f8dcc0c8700 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.981+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4012640 con 0x7f8dcc0c8700 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.981+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc0ac6e0 con 0x7f8dcc0c8700 2024-03-08T20:29:38.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.981+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc0c1570 con 0x7f8dcc0c8700 2024-03-08T20:29:38.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.982+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc06d5a0 con 0x7f8dcc0c8700 2024-03-08T20:29:38.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.983+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8db401a070 con 0x7f8dcc0c8700 2024-03-08T20:29:38.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.984+0000 7f8dc8c00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 0x7f8da806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:38.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.984+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8db408aae0 con 0x7f8dcc0c8700 2024-03-08T20:29:38.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.984+0000 7f8dd0c00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 0x7f8da806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:38.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.985+0000 7f8dd0c00640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 0x7f8da806e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009aa0 tx=0x7f8dbc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:38.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:38.988+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8dcc06d5a0 con 0x7f8dcc0c8700 2024-03-08T20:29:39.183 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.184+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dcc151000 con 0x7f8dcc0c8700 2024-03-08T20:29:39.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.184+0000 7f8dc8c00640 1 -- 172.21.15.118:0/1184148707 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8dcc151000 con 0x7f8dcc0c8700 2024-03-08T20:29:39.184 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 msgr2=0x7f8da806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 0x7f8da806e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009aa0 tx=0x7f8dbc009190 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 msgr2=0x7f8dcc1479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8db400cbb0 tx=0x7f8db400a430 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 shutdown_connections 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8da806bbd0 0x7f8da806e090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dcc152570 0x7f8dcc147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dcc0c8700 0x7f8dcc1479e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 --2- 172.21.15.118:0/1184148707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8dcc0bde90 0x7f8dcc0ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.187 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 >> 172.21.15.118:0/1184148707 conn(0x7f8dcc072620 msgr2=0x7f8dcc0c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:39.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 shutdown_connections 2024-03-08T20:29:39.188 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.187+0000 7f8dd3600640 1 -- 172.21.15.118:0/1184148707 wait complete. 2024-03-08T20:29:39.205 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:29:39.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.418+0000 7f1298a00640 1 Processor -- start 2024-03-08T20:29:39.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.418+0000 7f1298a00640 1 -- start start 2024-03-08T20:29:39.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1298a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f1294158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1298a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940c4560 con 0x7f1294152a90 2024-03-08T20:29:39.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1298a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940c4840 con 0x7f12940c5cb0 2024-03-08T20:29:39.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1298a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294159510 con 0x7f12940c0f80 2024-03-08T20:29:39.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1291400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1294152a90 0x7f12941588c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33086/0 (socket says 172.21.15.118:33086) 2024-03-08T20:29:39.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.419+0000 7f1291400640 1 -- 172.21.15.118:0/1817928238 learned_addr learned my addr 172.21.15.118:0/1817928238 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:39.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1292800640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f1294158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913029432 0 0) 0x7f12940c4560 con 0x7f1294152a90 2024-03-08T20:29:39.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1278003520 con 0x7f1294152a90 2024-03-08T20:29:39.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3822117885 0 0) 0x7f1278003520 con 0x7f1294152a90 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 msgr2=0x7f1294158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f1294158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 >> v1:172.21.15.144:6789/0 conn(0x7f12940c5cb0 legacy=0x7f1294152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940c4b20 con 0x7f1294152a90 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f1280001670 con 0x7f1294152a90 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 >> v1:172.21.15.118:6789/0 conn(0x7f1294152a90 legacy=0x7f12941588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f12780039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278003f60 0x7f1278004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1278004d40 0x7f12780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294159510 con 0x7f1278004d40 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127800bc00 con 0x7f1278003f60 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.420+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127800be00 con 0x7f12940c0f80 2024-03-08T20:29:39.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1278004d40 0x7f12780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1291400640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278003f60 0x7f1278004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1291e00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f12780039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 -- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 msgr2=0x7f12780039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12940c0f80 0x7f12780039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 -- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278003f60 msgr2=0x7f1278004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278003f60 0x7f1278004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1292800640 1 -- 172.21.15.118:0/1817928238 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278003520 con 0x7f1278004d40 2024-03-08T20:29:39.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.421+0000 7f1291400640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278003f60 0x7f1278004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.422+0000 7f1292800640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1278004d40 0x7f12780051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f128c009fc0 tx=0x7f1278005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b67d134ac120d17 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.422+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c039070 con 0x7f1278004d40 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c02cc20 con 0x7f1278004d40 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1290a00640 1 -- 172.21.15.118:0/1817928238 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c009c10 con 0x7f1278004d40 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 -- 172.21.15.118:0/1817928238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1278004d40 msgr2=0x7f12780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 --2- 172.21.15.118:0/1817928238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1278004d40 0x7f12780051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f128c009fc0 tx=0x7f1278005830 comp rx=0 tx=0).stop 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1292800640 1 -- 172.21.15.118:0/1817928238 reap_dead start 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 -- 172.21.15.118:0/1817928238 shutdown_connections 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 -- 172.21.15.118:0/1817928238 >> 172.21.15.118:0/1817928238 conn(0x7f129406b720 msgr2=0x7f12940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 -- 172.21.15.118:0/1817928238 shutdown_connections 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.423+0000 7f1298a00640 1 -- 172.21.15.118:0/1817928238 wait complete. 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.425+0000 7f1298a00640 1 Processor -- start 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.425+0000 7f1298a00640 1 -- start start 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278004d40 0x7f12941574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1294145a20 0x7f12940a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c1a70 con 0x7f12940a6ab0 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c50e0 con 0x7f1278004d40 2024-03-08T20:29:39.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1298a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940c1bf0 con 0x7f1294145a20 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1292800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1292800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:49066/0 (socket says 172.21.15.118:49066) 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.426+0000 7f1292800640 1 -- 172.21.15.118:0/3103942438 learned_addr learned my addr 172.21.15.118:0/3103942438 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1291400640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1294145a20 0x7f12940a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1291e00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278004d40 0x7f12941574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 -- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1294145a20 msgr2=0x7f12940a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1294145a20 0x7f12940a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 -- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278004d40 msgr2=0x7f12941574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278004d40 0x7f12941574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 -- 172.21.15.118:0/3103942438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294071ff0 con 0x7f12940a6ab0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1292800640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f128c002230 tx=0x7f128c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c039030 con 0x7f12940a6ab0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c043070 con 0x7f12940a6ab0 2024-03-08T20:29:39.429 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1294073340 con 0x7f12940a6ab0 2024-03-08T20:29:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.427+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c009c10 con 0x7f12940a6ab0 2024-03-08T20:29:39.430 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.428+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1294071d10 con 0x7f12940a6ab0 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.429+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294074a40 con 0x7f12940a6ab0 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.430+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f128c005d10 con 0x7f12940a6ab0 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.430+0000 7f128a000640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 0x7f127406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.430+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f128c0acf60 con 0x7f12940a6ab0 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.431+0000 7f1291e00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 0x7f127406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.431+0000 7f1291e00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 0x7f127406e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f12941586c0 tx=0x7f1284009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.434 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.435+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f128c07b700 con 0x7f12940a6ab0 2024-03-08T20:29:39.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.632+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12940abb10 con 0x7f12940a6ab0 2024-03-08T20:29:39.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.633+0000 7f128a000640 1 -- 172.21.15.118:0/3103942438 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f128c07b000 con 0x7f12940a6ab0 2024-03-08T20:29:39.632 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 msgr2=0x7f127406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 0x7f127406e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f12941586c0 tx=0x7f1284009040 comp rx=0 tx=0).stop 2024-03-08T20:29:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 msgr2=0x7f12941edbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f128c002230 tx=0x7f128c009750 comp rx=0 tx=0).stop 2024-03-08T20:29:39.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 shutdown_connections 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f127406bbd0 0x7f127406e090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.635+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12940a6ab0 0x7f12941edbe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.636+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1294145a20 0x7f12940a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.636+0000 7f1298a00640 1 --2- 172.21.15.118:0/3103942438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1278004d40 0x7f12941574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.636+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 >> 172.21.15.118:0/3103942438 conn(0x7f129406b720 msgr2=0x7f12941587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.636+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 shutdown_connections 2024-03-08T20:29:39.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.636+0000 7f1298a00640 1 -- 172.21.15.118:0/3103942438 wait complete. 2024-03-08T20:29:39.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T20:29:39.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.864+0000 7f2a32200640 1 Processor -- start 2024-03-08T20:29:39.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.864+0000 7f2a32200640 1 -- start start 2024-03-08T20:29:39.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a32200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c3750 0x7f2a2c154110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a32200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c06df10 0x7f2a2c0c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a32200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0c16e0 con 0x7f2a2c0ac0d0 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a32200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0ac4b0 con 0x7f2a2c0c3750 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a32200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06da80 con 0x7f2a2c06df10 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a22a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c3750 0x7f2a2c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a2b400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2a2c0ac0d0 0x7f2a2c1536a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47802/0 (socket says 172.21.15.118:47802) 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a22a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a2c0c3750 0x7f2a2c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59044/0 (socket says 172.21.15.118:59044) 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a2b400640 1 -- 172.21.15.118:0/2158777042 learned_addr learned my addr 172.21.15.118:0/2158777042 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.866+0000 7f2a2be00640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c06df10 0x7f2a2c0c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.867+0000 7f2a22a00640 1 -- 172.21.15.118:0/2158777042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c06df10 msgr2=0x7f2a2c0c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.867+0000 7f2a22a00640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c06df10 0x7f2a2c0c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.867+0000 7f2a22a00640 1 -- 172.21.15.118:0/2158777042 >> v1:172.21.15.118:6789/0 conn(0x7f2a2c0ac0d0 legacy=0x7f2a2c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.867+0000 7f2a22a00640 1 -- 172.21.15.118:0/2158777042 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0c1120 con 0x7f2a2c0c3750 2024-03-08T20:29:39.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.867+0000 7f2a2aa00640 1 -- 172.21.15.118:0/2158777042 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231273151 0 0) 0x7f2a2c0c16e0 con 0x7f2a2c0ac0d0 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a22a00640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c154110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b51b02752c5aa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a2aa00640 1 -- 172.21.15.118:0/2158777042 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14035020 con 0x7f2a2c0c3750 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a2aa00640 1 -- 172.21.15.118:0/2158777042 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14031810 con 0x7f2a2c0c3750 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a2aa00640 1 -- 172.21.15.118:0/2158777042 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14031be0 con 0x7f2a2c0c3750 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a32200640 1 -- 172.21.15.118:0/2158777042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 msgr2=0x7f2a2c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.868+0000 7f2a32200640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c154110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402b8b0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 -- 172.21.15.118:0/2158777042 shutdown_connections 2024-03-08T20:29:39.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c06df10 0x7f2a2c0c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 --2- 172.21.15.118:0/2158777042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c154110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 -- 172.21.15.118:0/2158777042 >> 172.21.15.118:0/2158777042 conn(0x7f2a2c0c6760 msgr2=0x7f2a2c0c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 -- 172.21.15.118:0/2158777042 shutdown_connections 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.869+0000 7f2a32200640 1 -- 172.21.15.118:0/2158777042 wait complete. 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.870+0000 7f2a32200640 1 Processor -- start 2024-03-08T20:29:39.870 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.871+0000 7f2a32200640 1 -- start start 2024-03-08T20:29:39.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.871+0000 7f2a32200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a2c06df10 0x7f2a2c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.871+0000 7f2a32200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 0x7f2a2c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.871+0000 7f2a32200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a32200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06e3a0 con 0x7f2a2c0c3750 2024-03-08T20:29:39.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a32200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06d710 con 0x7f2a2c06df10 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a32200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06e520 con 0x7f2a2c0ac0d0 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59058/0 (socket says 172.21.15.118:59058) 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 -- 172.21.15.118:0/1854665341 learned_addr learned my addr 172.21.15.118:0/1854665341 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2b400640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a2c06df10 0x7f2a2c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a22a00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 0x7f2a2c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 -- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 msgr2=0x7f2a2c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 0x7f2a2c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 -- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a2c06df10 msgr2=0x7f2a2c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a2c06df10 0x7f2a2c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a2be00640 1 -- 172.21.15.118:0/1854665341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0bf530 con 0x7f2a2c0c3750 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.872+0000 7f2a22a00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 0x7f2a2c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:39.874 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a2be00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a24007e60 tx=0x7f2a2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24014420 con 0x7f2a2c0c3750 2024-03-08T20:29:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24019070 con 0x7f2a2c0c3750 2024-03-08T20:29:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24014820 con 0x7f2a2c0c3750 2024-03-08T20:29:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c1eb450 con 0x7f2a2c0c3750 2024-03-08T20:29:39.875 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.873+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c0bb9b0 con 0x7f2a2c0c3750 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.874+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c074a40 con 0x7f2a2c0c3750 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.875+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2a240149c0 con 0x7f2a2c0c3750 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.876+0000 7f2a23e00640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 0x7f2a0806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.876+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2a2408b590 con 0x7f2a2c0c3750 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.876+0000 7f2a2b400640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 0x7f2a0806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:39.876 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.877+0000 7f2a2b400640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 0x7f2a0806e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000f60 tx=0x7f2a1c007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:39.880 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:39.880+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f2a24059dd0 con 0x7f2a2c0c3750 2024-03-08T20:29:40.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.090+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a2c06ea40 con 0x7f2a2c0c3750 2024-03-08T20:29:40.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.091+0000 7f2a23e00640 1 -- 172.21.15.118:0/1854665341 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a240596d0 con 0x7f2a2c0c3750 2024-03-08T20:29:40.090 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 msgr2=0x7f2a0806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 0x7f2a0806e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000f60 tx=0x7f2a1c007b70 comp rx=0 tx=0).stop 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 msgr2=0x7f2a2c0a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2a24007e60 tx=0x7f2a2400e4b0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 shutdown_connections 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f2a0806bbd0 0x7f2a0806e090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a2c0c3750 0x7f2a2c0a6610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a2c0ac0d0 0x7f2a2c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 --2- 172.21.15.118:0/1854665341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a2c06df10 0x7f2a2c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.093+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 >> 172.21.15.118:0/1854665341 conn(0x7f2a2c0c6760 msgr2=0x7f2a2c0c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:40.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.094+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 shutdown_connections 2024-03-08T20:29:40.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.094+0000 7f2a32200640 1 -- 172.21.15.118:0/1854665341 wait complete. 2024-03-08T20:29:40.111 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:29:40.111 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:29:40.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.411+0000 7f1158200640 1 Processor -- start 2024-03-08T20:29:40.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.411+0000 7f1158200640 1 -- start start 2024-03-08T20:29:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1158200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f115006af80 0x7f115006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1158200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f11501505e0 0x7f1150152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1158200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500aa980 con 0x7f115006ebd0 2024-03-08T20:29:40.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1158200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500aac60 con 0x7f11501505e0 2024-03-08T20:29:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1158200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500aaf40 con 0x7f115006af80 2024-03-08T20:29:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f11501505e0 0x7f1150152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f11501505e0 0x7f1150152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59064/0 (socket says 172.21.15.118:59064) 2024-03-08T20:29:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 -- 172.21.15.118:0/905150900 learned_addr learned my addr 172.21.15.118:0/905150900 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:40.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1155800640 1 --2- 172.21.15.118:0/905150900 >> v2:172.21.15.144:3300/0 conn(0x7f115006af80 0x7f115006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 -- 172.21.15.118:0/905150900 >> v2:172.21.15.144:3300/0 conn(0x7f115006af80 msgr2=0x7f115006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 --2- 172.21.15.118:0/905150900 >> v2:172.21.15.144:3300/0 conn(0x7f115006af80 0x7f115006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.413+0000 7f1156200640 1 -- 172.21.15.118:0/905150900 >> v1:172.21.15.118:6789/0 conn(0x7f115006ebd0 legacy=0x7f115014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.414+0000 7f1156200640 1 -- 172.21.15.118:0/905150900 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500ab220 con 0x7f11501505e0 2024-03-08T20:29:40.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.414+0000 7f114fe00640 1 -- 172.21.15.118:0/905150900 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47914795 0 0) 0x7f11500aa980 con 0x7f115006ebd0 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f1156200640 1 --2- 172.21.15.118:0/905150900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f1150152e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11500732d0 tx=0x7f114802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44586a0e7fd56065 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f114fe00640 1 -- 172.21.15.118:0/905150900 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114802ca80 con 0x7f11501505e0 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f114fe00640 1 -- 172.21.15.118:0/905150900 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114802cc20 con 0x7f11501505e0 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f114fe00640 1 -- 172.21.15.118:0/905150900 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480343f0 con 0x7f11501505e0 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f1158200640 1 -- 172.21.15.118:0/905150900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 msgr2=0x7f1150152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.415+0000 7f1158200640 1 --2- 172.21.15.118:0/905150900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f1150152e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11500732d0 tx=0x7f114802bee0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 -- 172.21.15.118:0/905150900 shutdown_connections 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 --2- 172.21.15.118:0/905150900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f1150152e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 --2- 172.21.15.118:0/905150900 >> v2:172.21.15.144:3300/0 conn(0x7f115006af80 0x7f115006e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 -- 172.21.15.118:0/905150900 >> 172.21.15.118:0/905150900 conn(0x7f11500a84c0 msgr2=0x7f11500a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 -- 172.21.15.118:0/905150900 shutdown_connections 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.416+0000 7f1158200640 1 -- 172.21.15.118:0/905150900 wait complete. 2024-03-08T20:29:40.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.417+0000 7f1158200640 1 Processor -- start 2024-03-08T20:29:40.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.417+0000 7f1158200640 1 -- start start 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f115006af80 0x7f115014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 0x7f11501d9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115006b4e0 con 0x7f11501505e0 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115006b360 con 0x7f115006ebd0 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.418+0000 7f1158200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1150153350 con 0x7f115006af80 2024-03-08T20:29:40.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59076/0 (socket says 172.21.15.118:59076) 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 -- 172.21.15.118:0/2352663845 learned_addr learned my addr 172.21.15.118:0/2352663845 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1154e00640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 0x7f11501d9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1155800640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f115006af80 0x7f115014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 -- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f115006af80 msgr2=0x7f115014e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f115006af80 0x7f115014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 -- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 msgr2=0x7f11501d9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 0x7f11501d9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 -- 172.21.15.118:0/2352663845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11501e8310 con 0x7f11501505e0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1154e00640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 0x7f11501d9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.419+0000 7f1156200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1148009f40 tx=0x7f1148004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.420+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148043020 con 0x7f11501505e0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.420+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114803e450 con 0x7f11501505e0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.420+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148009510 con 0x7f11501505e0 2024-03-08T20:29:40.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.420+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11500c53a0 con 0x7f11501505e0 2024-03-08T20:29:40.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.420+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11500c5960 con 0x7f11501505e0 2024-03-08T20:29:40.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.421+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1150074a40 con 0x7f11501505e0 2024-03-08T20:29:40.421 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.422+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1148046020 con 0x7f11501505e0 2024-03-08T20:29:40.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.423+0000 7f114d600640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 0x7f113006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.423+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f11480ad680 con 0x7f11501505e0 2024-03-08T20:29:40.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.423+0000 7f1155800640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 0x7f113006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.423+0000 7f1155800640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 0x7f113006e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1144006fd0 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.426 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.427+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f114804d030 con 0x7f11501505e0 2024-03-08T20:29:40.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.625+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11501de060 con 0x7f11501505e0 2024-03-08T20:29:40.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.628+0000 7f114d600640 1 -- 172.21.15.118:0/2352663845 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f114807be20 con 0x7f11501505e0 2024-03-08T20:29:40.628 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:40.628 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 msgr2=0x7f113006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 0x7f113006e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1144006fd0 tx=0x7f1144008040 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 msgr2=0x7f11501d9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1148009f40 tx=0x7f1148004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 shutdown_connections 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f113006bbd0 0x7f113006e090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11501505e0 0x7f11501d9550 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115006ebd0 0x7f11501d9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 --2- 172.21.15.118:0/2352663845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f115006af80 0x7f115014e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 >> 172.21.15.118:0/2352663845 conn(0x7f11500a84c0 msgr2=0x7f11501484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 shutdown_connections 2024-03-08T20:29:40.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.631+0000 7f1158200640 1 -- 172.21.15.118:0/2352663845 wait complete. 2024-03-08T20:29:40.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:29:40.650 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:29:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.850+0000 7f244d800640 1 Processor -- start 2024-03-08T20:29:40.850 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.850+0000 7f244d800640 1 -- start start 2024-03-08T20:29:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.851+0000 7f244d800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.851+0000 7f244d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24480c5ad0 0x7f2448152110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.851+0000 7f244d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24480c6390 con 0x7f24480c29a0 2024-03-08T20:29:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.851+0000 7f244d800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244806cf90 con 0x7f24480c5ad0 2024-03-08T20:29:40.851 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.851+0000 7f244d800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2448156190 con 0x7f2448072f40 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.852+0000 7f2446a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.852+0000 7f2446a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:46720/0 (socket says 172.21.15.118:46720) 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.852+0000 7f2446a00640 1 -- 172.21.15.118:0/684346880 learned_addr learned my addr 172.21.15.118:0/684346880 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.852+0000 7f2446000640 1 --2- 172.21.15.118:0/684346880 >> v2:172.21.15.144:3300/0 conn(0x7f24480c5ad0 0x7f2448152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.853+0000 7f2446a00640 1 -- 172.21.15.118:0/684346880 >> v2:172.21.15.144:3300/0 conn(0x7f24480c5ad0 msgr2=0x7f2448152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.853+0000 7f2446a00640 1 --2- 172.21.15.118:0/684346880 >> v2:172.21.15.144:3300/0 conn(0x7f24480c5ad0 0x7f2448152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.853+0000 7f2446a00640 1 -- 172.21.15.118:0/684346880 >> v1:172.21.15.144:6789/0 conn(0x7f24480c29a0 legacy=0x7f2448152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.852 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.853+0000 7f2446a00640 1 -- 172.21.15.118:0/684346880 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448155610 con 0x7f2448072f40 2024-03-08T20:29:40.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.854+0000 7f2446a00640 1 --2- 172.21.15.118:0/684346880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2438009870 tx=0x7f243802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab5e8356e6b3c43 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.854+0000 7f2445600640 1 -- 172.21.15.118:0/684346880 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438034070 con 0x7f2448072f40 2024-03-08T20:29:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.854+0000 7f2445600640 1 -- 172.21.15.118:0/684346880 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438030840 con 0x7f2448072f40 2024-03-08T20:29:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.854+0000 7f2445600640 1 -- 172.21.15.118:0/684346880 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438030c10 con 0x7f2448072f40 2024-03-08T20:29:40.854 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 -- 172.21.15.118:0/684346880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 msgr2=0x7f24480c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 --2- 172.21.15.118:0/684346880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2438009870 tx=0x7f243802b980 comp rx=0 tx=0).stop 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 -- 172.21.15.118:0/684346880 shutdown_connections 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 --2- 172.21.15.118:0/684346880 >> v2:172.21.15.144:3300/0 conn(0x7f24480c5ad0 0x7f2448152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 --2- 172.21.15.118:0/684346880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2448072f40 0x7f24480c5590 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 -- 172.21.15.118:0/684346880 >> 172.21.15.118:0/684346880 conn(0x7f244806b720 msgr2=0x7f24480c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 -- 172.21.15.118:0/684346880 shutdown_connections 2024-03-08T20:29:40.855 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.855+0000 7f244d800640 1 -- 172.21.15.118:0/684346880 wait complete. 2024-03-08T20:29:40.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.857+0000 7f244d800640 1 Processor -- start 2024-03-08T20:29:40.856 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.857+0000 7f244d800640 1 -- start start 2024-03-08T20:29:40.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24480c29a0 0x7f244814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24480c5ad0 0x7f244814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448155eb0 con 0x7f2448072f40 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448155bd0 con 0x7f24480c5ad0 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f244d800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2448073320 con 0x7f24480c29a0 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f2446a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f2446a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59080/0 (socket says 172.21.15.118:59080) 2024-03-08T20:29:40.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.858+0000 7f2446a00640 1 -- 172.21.15.118:0/3786578878 learned_addr learned my addr 172.21.15.118:0/3786578878 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446000640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24480c29a0 0x7f244814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2447400640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24480c5ad0 0x7f244814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 -- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24480c29a0 msgr2=0x7f244814adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24480c29a0 0x7f244814adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 -- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24480c5ad0 msgr2=0x7f244814b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24480c5ad0 0x7f244814b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 -- 172.21.15.118:0/3786578878 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480a6440 con 0x7f2448072f40 2024-03-08T20:29:40.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f2446a00640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f243802b9c0 tx=0x7f24380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438034040 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438039d90 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438043630 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.859+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24481e6cc0 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.860+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24480a8970 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.861+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24480c6090 con 0x7f2448072f40 2024-03-08T20:29:40.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.862+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2438037070 con 0x7f2448072f40 2024-03-08T20:29:40.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.862+0000 7f243ea00640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 0x7f242806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:40.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.863+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24380accb0 con 0x7f2448072f40 2024-03-08T20:29:40.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.863+0000 7f2446000640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 0x7f242806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:40.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.863+0000 7f2446000640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 0x7f242806e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24480c07c0 tx=0x7f2434008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:40.866 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:40.867+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f24480c6090 con 0x7f2448072f40 2024-03-08T20:29:41.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.062+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24481527d0 con 0x7f2448072f40 2024-03-08T20:29:41.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.062+0000 7f243ea00640 1 -- 172.21.15.118:0/3786578878 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24481527d0 con 0x7f2448072f40 2024-03-08T20:29:41.062 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 msgr2=0x7f242806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 0x7f242806e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24480c07c0 tx=0x7f2434008040 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 msgr2=0x7f24480a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f243802b9c0 tx=0x7f24380046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 shutdown_connections 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f242806bbd0 0x7f242806e090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24480c5ad0 0x7f244814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24480c29a0 0x7f244814adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 --2- 172.21.15.118:0/3786578878 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2448072f40 0x7f24480a8430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 >> 172.21.15.118:0/3786578878 conn(0x7f244806b720 msgr2=0x7f24480c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 shutdown_connections 2024-03-08T20:29:41.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.065+0000 7f244d800640 1 -- 172.21.15.118:0/3786578878 wait complete. 2024-03-08T20:29:41.083 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:29:41.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.293+0000 7fadd2400640 1 Processor -- start 2024-03-08T20:29:41.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.293+0000 7fadd2400640 1 -- start start 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.294+0000 7fadd2400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadcc0c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.294+0000 7fadd2400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc1550f0 con 0x7fadcc0c2390 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.294+0000 7fadd2400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc1553d0 con 0x7fadcc151be0 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.294+0000 7fadd2400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1556b0 con 0x7fadcc14f230 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcbe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fadcc0c2390 0x7fadcc0c1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47816/0 (socket says 172.21.15.118:47816) 2024-03-08T20:29:41.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcbe00640 1 -- 172.21.15.118:0/891481690 learned_addr learned my addr 172.21.15.118:0/891481690 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:41.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadd1000640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadcc0c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845165286 0 0) 0x7fadcc1550f0 con 0x7fadcc0c2390 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb4003520 con 0x7fadcc0c2390 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481334525 0 0) 0x7fadb4003520 con 0x7fadcc0c2390 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 msgr2=0x7fadcc0c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadcc0c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 >> v1:172.21.15.144:6789/0 conn(0x7fadcc151be0 legacy=0x7fadcc152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc155990 con 0x7fadcc0c2390 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.295+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fadb8001670 con 0x7fadcc0c2390 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 >> v1:172.21.15.118:6789/0 conn(0x7fadcc0c2390 legacy=0x7fadcc0c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadb40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadb4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb4004d40 0x7fadb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1556b0 con 0x7fadb4003fb0 2024-03-08T20:29:41.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb400dda0 con 0x7fadb4004d40 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb400dfa0 con 0x7fadcc14f230 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadb4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadd1000640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadb40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadd1a00640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb4004d40 0x7fadb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 -- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 msgr2=0x7fadb40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc14f230 0x7fadb40039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 -- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb4004d40 msgr2=0x7fadb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb4004d40 0x7fadb40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.296+0000 7fadcbe00640 1 -- 172.21.15.118:0/891481690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4003520 con 0x7fadb4003fb0 2024-03-08T20:29:41.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.297+0000 7fadcbe00640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadb4004800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c0e0 tx=0x7fadb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200c9883b5b004af server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007c20 con 0x7fadb4003fb0 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8030070 con 0x7fadb4003fb0 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadcb400640 1 -- 172.21.15.118:0/891481690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8005d30 con 0x7fadb4003fb0 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 -- 172.21.15.118:0/891481690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 msgr2=0x7fadb4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 --2- 172.21.15.118:0/891481690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadb4004800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c0e0 tx=0x7fadb4005830 comp rx=0 tx=0).stop 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd1a00640 1 -- 172.21.15.118:0/891481690 reap_dead start 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 -- 172.21.15.118:0/891481690 shutdown_connections 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 -- 172.21.15.118:0/891481690 >> 172.21.15.118:0/891481690 conn(0x7fadcc0c6480 msgr2=0x7fadcc0c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 -- 172.21.15.118:0/891481690 shutdown_connections 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.298+0000 7fadd2400640 1 -- 172.21.15.118:0/891481690 wait complete. 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.300+0000 7fadd2400640 1 Processor -- start 2024-03-08T20:29:41.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.300+0000 7fadd2400640 1 -- start start 2024-03-08T20:29:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadcc151330 0x7fadcc147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc147c80 0x7fadcc1eaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc1528d0 con 0x7fadb4003fb0 2024-03-08T20:29:41.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc152750 con 0x7fadcc151330 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd2400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0aa720 con 0x7fadcc147c80 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd1000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd1000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59090/0 (socket says 172.21.15.118:59090) 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.301+0000 7fadd1000640 1 -- 172.21.15.118:0/3968157679 learned_addr learned my addr 172.21.15.118:0/3968157679 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 -- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc147c80 msgr2=0x7fadcc1eaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc147c80 0x7fadcc1eaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 -- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadcc151330 msgr2=0x7fadcc147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadcc151330 0x7fadcc147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 -- 172.21.15.118:0/3968157679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0c4110 con 0x7fadb4003fb0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd1000640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fadc0010860 tx=0x7fadc0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000f040 con 0x7fadb4003fb0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000eb00 con 0x7fadb4003fb0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001c400 con 0x7fadb4003fb0 2024-03-08T20:29:41.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc1ea7a0 con 0x7fadb4003fb0 2024-03-08T20:29:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.302+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc0c4690 con 0x7fadb4003fb0 2024-03-08T20:29:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.303+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc1480a0 con 0x7fadb4003fb0 2024-03-08T20:29:41.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.304+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fadc001c5a0 con 0x7fadb4003fb0 2024-03-08T20:29:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.305+0000 7fadc8c00640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 0x7fadac06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.305+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fadc008b340 con 0x7fadb4003fb0 2024-03-08T20:29:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.305+0000 7fadcbe00640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 0x7fadac06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.305 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.306+0000 7fadcbe00640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 0x7fadac06e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb8034000 tx=0x7fadb8039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.310+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fadc0018030 con 0x7fadb4003fb0 2024-03-08T20:29:41.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.511+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fadcc0c4860 con 0x7fadb4003fb0 2024-03-08T20:29:41.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.512+0000 7fadc8c00640 1 -- 172.21.15.118:0/3968157679 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadc0059490 con 0x7fadb4003fb0 2024-03-08T20:29:41.511 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 msgr2=0x7fadac06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 0x7fadac06e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadb8034000 tx=0x7fadb8039040 comp rx=0 tx=0).stop 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 msgr2=0x7fadcc150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fadc0010860 tx=0x7fadc0010d20 comp rx=0 tx=0).stop 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 shutdown_connections 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fadac06bc00 0x7fadac06e0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadcc147c80 0x7fadcc1eaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadcc151330 0x7fadcc147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 --2- 172.21.15.118:0/3968157679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadb4003fb0 0x7fadcc150190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.514+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 >> 172.21.15.118:0/3968157679 conn(0x7fadcc0c6480 msgr2=0x7fadcc0c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.515+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 shutdown_connections 2024-03-08T20:29:41.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.515+0000 7fadd2400640 1 -- 172.21.15.118:0/3968157679 wait complete. 2024-03-08T20:29:41.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:29:41.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.744+0000 7f26fee00640 1 Processor -- start 2024-03-08T20:29:41.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.744+0000 7f26fee00640 1 -- start start 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.745+0000 7f26fee00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fee00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26f80bde90 0x7f26f8155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f8159080 con 0x7f26f80c8700 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fee00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f8158e30 con 0x7f26f80bde90 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fee00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8159360 con 0x7f26f8152570 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26f80bde90 0x7f26f8155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f26f80bde90 0x7f26f8155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59098/0 (socket says 172.21.15.118:59098) 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 -- 172.21.15.118:0/582685143 learned_addr learned my addr 172.21.15.118:0/582685143 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26f7e00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 -- 172.21.15.118:0/582685143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 msgr2=0x7f26f80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f80caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.746+0000 7f26fce00640 1 -- 172.21.15.118:0/582685143 >> v1:172.21.15.144:6789/0 conn(0x7f26f80c8700 legacy=0x7f26f8154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.747+0000 7f26fce00640 1 -- 172.21.15.118:0/582685143 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80c52b0 con 0x7f26f80bde90 2024-03-08T20:29:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.748+0000 7f26fce00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f8155690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009870 tx=0x7f26f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6353ba2e8ea6e35 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.748+0000 7f26f6a00640 1 -- 172.21.15.118:0/582685143 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00317c0 con 0x7f26f80bde90 2024-03-08T20:29:41.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.748+0000 7f26f6a00640 1 -- 172.21.15.118:0/582685143 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0037070 con 0x7f26f80bde90 2024-03-08T20:29:41.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.748+0000 7f26f6a00640 1 -- 172.21.15.118:0/582685143 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0031b80 con 0x7f26f80bde90 2024-03-08T20:29:41.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 -- 172.21.15.118:0/582685143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 msgr2=0x7f26f8155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f8155690 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009870 tx=0x7f26f002b860 comp rx=0 tx=0).stop 2024-03-08T20:29:41.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 -- 172.21.15.118:0/582685143 shutdown_connections 2024-03-08T20:29:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f8155690 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 --2- 172.21.15.118:0/582685143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 -- 172.21.15.118:0/582685143 >> 172.21.15.118:0/582685143 conn(0x7f26f8072620 msgr2=0x7f26f8072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 -- 172.21.15.118:0/582685143 shutdown_connections 2024-03-08T20:29:41.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.749+0000 7f26fee00640 1 -- 172.21.15.118:0/582685143 wait complete. 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.750+0000 7f26fee00640 1 Processor -- start 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.750+0000 7f26fee00640 1 -- start start 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26f80c8700 0x7f26f81eaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f81eb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f806dcd0 con 0x7f26f80bde90 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8155bd0 con 0x7f26f80c8700 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26fee00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80cb030 con 0x7f26f8152570 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.751+0000 7f26f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59114/0 (socket says 172.21.15.118:59114) 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 -- 172.21.15.118:0/3976474640 learned_addr learned my addr 172.21.15.118:0/3976474640 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7400640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26f80c8700 0x7f26f81eaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26fce00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f81eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 -- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 msgr2=0x7f26f81eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f81eb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 -- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26f80c8700 msgr2=0x7f26f81eaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26f80c8700 0x7f26f81eaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 -- 172.21.15.118:0/3976474640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f81eaa90 con 0x7f26f80bde90 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.752+0000 7f26f7e00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26e800d5d0 tx=0x7f26e800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.753+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80125f0 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.753+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e8019070 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.753+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f81eb9d0 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.753+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80129f0 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.753+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f80ac890 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.754+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f80c5870 con 0x7f26f80bde90 2024-03-08T20:29:41.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.755+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f26e8012b90 con 0x7f26f80bde90 2024-03-08T20:29:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.756+0000 7f26efe00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 0x7f26d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.756+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f26e808b1e0 con 0x7f26f80bde90 2024-03-08T20:29:41.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.756+0000 7f26f7400640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 0x7f26d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:41.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.756+0000 7f26f7400640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 0x7f26d406e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26e0007fd0 tx=0x7f26e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:41.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.760+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f26f80c5870 con 0x7f26f80bde90 2024-03-08T20:29:41.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.955+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26f81ee000 con 0x7f26f80bde90 2024-03-08T20:29:41.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.956+0000 7f26efe00640 1 -- 172.21.15.118:0/3976474640 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26e8059980 con 0x7f26f80bde90 2024-03-08T20:29:41.956 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 msgr2=0x7f26d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 0x7f26d406e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26e0007fd0 tx=0x7f26e0009040 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 msgr2=0x7f26f80bf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f26e800d5d0 tx=0x7f26e800da90 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 shutdown_connections 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f26d406bbd0 0x7f26d406e090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26f8152570 0x7f26f81eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26f80c8700 0x7f26f81eaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 --2- 172.21.15.118:0/3976474640 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26f80bde90 0x7f26f80bf930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 >> 172.21.15.118:0/3976474640 conn(0x7f26f8072620 msgr2=0x7f26f8072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 shutdown_connections 2024-03-08T20:29:41.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:41.959+0000 7f26fee00640 1 -- 172.21.15.118:0/3976474640 wait complete. 2024-03-08T20:29:41.978 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:29:42.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.191+0000 7f7abc800640 1 Processor -- start 2024-03-08T20:29:42.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.192+0000 7f7abc800640 1 -- start start 2024-03-08T20:29:42.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7abc800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7ab414cfb0 0x7f7ab4070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7abc800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab40c77b0 0x7f7ab41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7abc800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab4152d00 con 0x7f7ab40c8e50 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7abc800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab4152fc0 con 0x7f7ab414cfb0 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7abc800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41532a0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7ab9e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7ab40c8e50 0x7f7ab414c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47824/0 (socket says 172.21.15.118:47824) 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7ab9e00640 1 -- 172.21.15.118:0/1906233726 learned_addr learned my addr 172.21.15.118:0/1906233726 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:42.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7ab9400640 1 --2- 172.21.15.118:0/1906233726 >> v2:172.21.15.118:3300/0 conn(0x7f7ab414cfb0 0x7f7ab4070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.193+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596805872 0 0) 0x7f7ab4152d00 con 0x7f7ab40c8e50 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7aba800640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab40c77b0 0x7f7ab41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa0003520 con 0x7f7ab40c8e50 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab9400640 1 -- 172.21.15.118:0/1906233726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab40c77b0 msgr2=0x7f7ab41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab9400640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab40c77b0 0x7f7ab41564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879703137 0 0) 0x7f7aa0003520 con 0x7f7ab40c8e50 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab9400640 1 -- 172.21.15.118:0/1906233726 >> v1:172.21.15.118:6789/0 conn(0x7f7ab40c8e50 legacy=0x7f7ab414c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.194+0000 7f7ab9400640 1 -- 172.21.15.118:0/1906233726 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4153580 con 0x7f7ab414cfb0 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.195+0000 7f7ab9400640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab414cfb0 0x7f7ab4070ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff5a57850b1e423 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.195+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4037070 con 0x7f7ab414cfb0 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.195+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4030510 con 0x7f7ab414cfb0 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.195+0000 7f7ab8a00640 1 -- 172.21.15.118:0/1906233726 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa402be60 con 0x7f7ab414cfb0 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 -- 172.21.15.118:0/1906233726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab414cfb0 msgr2=0x7f7ab4070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab414cfb0 0x7f7ab4070ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b660 comp rx=0 tx=0).stop 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 -- 172.21.15.118:0/1906233726 shutdown_connections 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab40c77b0 0x7f7ab41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 --2- 172.21.15.118:0/1906233726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab414cfb0 0x7f7ab4070ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 -- 172.21.15.118:0/1906233726 >> 172.21.15.118:0/1906233726 conn(0x7f7ab4066e40 msgr2=0x7f7ab4067250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 -- 172.21.15.118:0/1906233726 shutdown_connections 2024-03-08T20:29:42.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.196+0000 7f7abc800640 1 -- 172.21.15.118:0/1906233726 wait complete. 2024-03-08T20:29:42.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.198+0000 7f7abc800640 1 Processor -- start 2024-03-08T20:29:42.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.198+0000 7f7abc800640 1 -- start start 2024-03-08T20:29:42.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab40c8e50 0x7f7ab406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab414cfb0 0x7f7ab41ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c93b0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c9230 con 0x7f7ab40c8e50 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7abc800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41569e0 con 0x7f7ab414cfb0 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59134/0 (socket says 172.21.15.118:59134) 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 -- 172.21.15.118:0/3106233571 learned_addr learned my addr 172.21.15.118:0/3106233571 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7aba800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab414cfb0 0x7f7ab41ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 -- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab414cfb0 msgr2=0x7f7ab41ee2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9400640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab40c8e50 0x7f7ab406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab414cfb0 0x7f7ab41ee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 -- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab40c8e50 msgr2=0x7f7ab406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab40c8e50 0x7f7ab406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.199+0000 7f7ab9e00640 1 -- 172.21.15.118:0/3106233571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab41eb310 con 0x7f7ab40c77b0 2024-03-08T20:29:42.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7ab9e00640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7aac002180 tx=0x7f7aac00a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac012600 con 0x7f7ab40c77b0 2024-03-08T20:29:42.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0127c0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac012bb0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab4155c90 con 0x7f7ab40c77b0 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.200+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab41edaf0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.201+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4074a40 con 0x7f7ab40c77b0 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.202+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7aac01b400 con 0x7f7ab40c77b0 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.203+0000 7f7aaa000640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 0x7f7a9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.203+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7aac08b780 con 0x7f7ab40c77b0 2024-03-08T20:29:42.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.203+0000 7f7ab9400640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 0x7f7a9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.204+0000 7f7ab9400640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 0x7f7a9806e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4034000 tx=0x7f7aa4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.208+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7aac059970 con 0x7f7ab40c77b0 2024-03-08T20:29:42.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.405+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7ab40c80b0 con 0x7f7ab40c77b0 2024-03-08T20:29:42.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.405+0000 7f7aaa000640 1 -- 172.21.15.118:0/3106233571 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7aac05da10 con 0x7f7ab40c77b0 2024-03-08T20:29:42.405 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 msgr2=0x7f7a9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 0x7f7a9806e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4034000 tx=0x7f7aa4008030 comp rx=0 tx=0).stop 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 msgr2=0x7f7ab41eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7aac002180 tx=0x7f7aac00a4f0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 shutdown_connections 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7a9806bbd0 0x7f7a9806e090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ab414cfb0 0x7f7ab41ee2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ab40c8e50 0x7f7ab406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 --2- 172.21.15.118:0/3106233571 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ab40c77b0 0x7f7ab41eadd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 >> 172.21.15.118:0/3106233571 conn(0x7f7ab4066e40 msgr2=0x7f7ab414c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 shutdown_connections 2024-03-08T20:29:42.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.408+0000 7f7abc800640 1 -- 172.21.15.118:0/3106233571 wait complete. 2024-03-08T20:29:42.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T20:29:42.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.633+0000 7fc083800640 1 Processor -- start 2024-03-08T20:29:42.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.633+0000 7fc083800640 1 -- start start 2024-03-08T20:29:42.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc083800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc07c0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc083800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c155d20 con 0x7fc07c06e6a0 2024-03-08T20:29:42.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc083800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c156000 con 0x7fc07c0c3970 2024-03-08T20:29:42.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc083800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c34e0 con 0x7fc07c0c2750 2024-03-08T20:29:42.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc081800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fc07c06e6a0 0x7fc07c155250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47838/0 (socket says 172.21.15.118:47838) 2024-03-08T20:29:42.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc081800640 1 -- 172.21.15.118:0/4163303971 learned_addr learned my addr 172.21.15.118:0/4163303971 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.635+0000 7fc080e00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc07c0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300784734 0 0) 0x7fc07c155d20 con 0x7fc07c06e6a0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc060003520 con 0x7fc07c06e6a0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142113946 0 0) 0x7fc060003520 con 0x7fc07c06e6a0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 msgr2=0x7fc07c0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc07c0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 >> v1:172.21.15.144:6789/0 conn(0x7fc07c0c3970 legacy=0x7fc07c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0c3170 con 0x7fc07c06e6a0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fc0740019f0 con 0x7fc07c06e6a0 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 >> v1:172.21.15.118:6789/0 conn(0x7fc07c06e6a0 legacy=0x7fc07c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0600039e0 0x7fc060003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc060004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc0600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c34e0 con 0x7fc060004d40 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06000dcb0 con 0x7fc0600039e0 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06000deb0 con 0x7fc07c0c2750 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.636+0000 7fc081800640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc0600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc073e00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc060004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc080e00640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0600039e0 0x7fc060003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc081800640 1 -- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 msgr2=0x7fc060004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc081800640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c0c2750 0x7fc060004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc081800640 1 -- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0600039e0 msgr2=0x7fc060003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc081800640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0600039e0 0x7fc060003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.637+0000 7fc081800640 1 -- 172.21.15.118:0/4163303971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc060003520 con 0x7fc060004d40 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.638+0000 7fc081800640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc0600051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a780 tx=0x7fc060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0742d4e14c75872 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.638+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400a3d0 con 0x7fc060004d40 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.638+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074034630 con 0x7fc060004d40 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.638+0000 7fc07be00640 1 -- 172.21.15.118:0/4163303971 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074034a60 con 0x7fc060004d40 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 -- 172.21.15.118:0/4163303971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 msgr2=0x7fc0600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 --2- 172.21.15.118:0/4163303971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc0600051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a780 tx=0x7fc060005830 comp rx=0 tx=0).stop 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc081800640 1 -- 172.21.15.118:0/4163303971 reap_dead start 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 -- 172.21.15.118:0/4163303971 shutdown_connections 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 -- 172.21.15.118:0/4163303971 >> 172.21.15.118:0/4163303971 conn(0x7fc07c0c6760 msgr2=0x7fc07c0c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 -- 172.21.15.118:0/4163303971 shutdown_connections 2024-03-08T20:29:42.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.639+0000 7fc083800640 1 -- 172.21.15.118:0/4163303971 wait complete. 2024-03-08T20:29:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.641+0000 7fc083800640 1 Processor -- start 2024-03-08T20:29:42.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.641+0000 7fc083800640 1 -- start start 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc07c14baa0 0x7fc07c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c155000 0x7fc07c0aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c155ae0 con 0x7fc060004d40 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c155960 con 0x7fc07c14baa0 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc083800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c151e10 con 0x7fc07c155000 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc080e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc080e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59156/0 (socket says 172.21.15.118:59156) 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.642+0000 7fc080e00640 1 -- 172.21.15.118:0/2296167769 learned_addr learned my addr 172.21.15.118:0/2296167769 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc073e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc07c14baa0 0x7fc07c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc081800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c155000 0x7fc07c0aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 -- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c155000 msgr2=0x7fc07c0aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c155000 0x7fc07c0aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 -- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc07c14baa0 msgr2=0x7fc07c150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc07c14baa0 0x7fc07c150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 -- 172.21.15.118:0/2296167769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c1ea150 con 0x7fc060004d40 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc080e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc06c011600 tx=0x7fc06c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00f920 con 0x7fc060004d40 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00fac0 con 0x7fc060004d40 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00fe70 con 0x7fc060004d40 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.643+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c1ea6b0 con 0x7fc060004d40 2024-03-08T20:29:42.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.644+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c0aa340 con 0x7fc060004d40 2024-03-08T20:29:42.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.645+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c074a40 con 0x7fc060004d40 2024-03-08T20:29:42.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.646+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc06c015460 con 0x7fc060004d40 2024-03-08T20:29:42.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.647+0000 7fc079600640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 0x7fc05806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:42.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.647+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc06c08b360 con 0x7fc060004d40 2024-03-08T20:29:42.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.647+0000 7fc073e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 0x7fc05806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:42.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.648+0000 7fc073e00640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 0x7fc05806e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc064007fd0 tx=0x7fc064009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:42.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.651+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc07c1ea150 con 0x7fc060004d40 2024-03-08T20:29:42.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.860+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc07c0a9ff0 con 0x7fc060004d40 2024-03-08T20:29:42.860 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.860+0000 7fc079600640 1 -- 172.21.15.118:0/2296167769 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc06c019030 con 0x7fc060004d40 2024-03-08T20:29:42.860 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 msgr2=0x7fc05806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 0x7fc05806e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc064007fd0 tx=0x7fc064009040 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 msgr2=0x7fc07c14b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc06c011600 tx=0x7fc06c011ac0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 shutdown_connections 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc05806bbd0 0x7fc05806e090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc07c155000 0x7fc07c0aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc07c14baa0 0x7fc07c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 --2- 172.21.15.118:0/2296167769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc060004d40 0x7fc07c14b560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:42.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 >> 172.21.15.118:0/2296167769 conn(0x7fc07c0c6760 msgr2=0x7fc07c0c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:42.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 shutdown_connections 2024-03-08T20:29:42.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:42.863+0000 7fc083800640 1 -- 172.21.15.118:0/2296167769 wait complete. 2024-03-08T20:29:42.883 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2024-03-08T20:29:42.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:42.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-08T20:29:42.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi118.stderr:ceph-fuse[42189]: fuse finished with error 0 and tester_r 0 2024-03-08T20:29:42.976 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:29:43.009 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:29:43.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:29:43.009 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-08T20:29:43.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.357+0000 7f1531800640 1 Processor -- start 2024-03-08T20:29:43.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.357+0000 7f1531800640 1 -- start start 2024-03-08T20:29:43.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1525b0 0x7f152c0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 0x7f152c06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f152c1555c0 0x7f152c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c155f50 con 0x7f152c1555c0 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c06e0d0 con 0x7f152c06e750 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.358+0000 7f1531800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0c0340 con 0x7f152c1525b0 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f152c1555c0 0x7f152c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f152c1555c0 0x7f152c155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59158/0 (socket says 172.21.15.118:59158) 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 -- 172.21.15.118:0/4285556852 learned_addr learned my addr 172.21.15.118:0/4285556852 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152aa00640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1525b0 0x7f152c0c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f1522000640 1 --2- 172.21.15.118:0/4285556852 >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 0x7f152c06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 -- 172.21.15.118:0/4285556852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1525b0 msgr2=0x7f152c0c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:43.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1525b0 0x7f152c0c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 -- 172.21.15.118:0/4285556852 >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 msgr2=0x7f152c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:43.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 --2- 172.21.15.118:0/4285556852 >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 0x7f152c06ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f152b400640 1 -- 172.21.15.118:0/4285556852 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0c0620 con 0x7f152c1555c0 2024-03-08T20:29:43.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.359+0000 7f1522000640 1 --2- 172.21.15.118:0/4285556852 >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 0x7f152c06ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.360+0000 7f152b400640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1555c0 0x7f152c155a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f152c0a93e0 tx=0x7f152402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e34747b52eda28 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.360+0000 7f152a000640 1 -- 172.21.15.118:0/4285556852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152402c9e0 con 0x7f152c1555c0 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f152a000640 1 -- 172.21.15.118:0/4285556852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152402cb80 con 0x7f152c1555c0 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f152a000640 1 -- 172.21.15.118:0/4285556852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240343f0 con 0x7f152c1555c0 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 -- 172.21.15.118:0/4285556852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1555c0 msgr2=0x7f152c155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1555c0 0x7f152c155a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f152c0a93e0 tx=0x7f152402be40 comp rx=0 tx=0).stop 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 -- 172.21.15.118:0/4285556852 shutdown_connections 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c1555c0 0x7f152c155a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 --2- 172.21.15.118:0/4285556852 >> v2:172.21.15.144:3300/0 conn(0x7f152c06e750 0x7f152c06ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 --2- 172.21.15.118:0/4285556852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1525b0 0x7f152c0c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 -- 172.21.15.118:0/4285556852 >> 172.21.15.118:0/4285556852 conn(0x7f152c0a84c0 msgr2=0x7f152c0a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 -- 172.21.15.118:0/4285556852 shutdown_connections 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.361+0000 7f1531800640 1 -- 172.21.15.118:0/4285556852 wait complete. 2024-03-08T20:29:43.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.363+0000 7f1531800640 1 Processor -- start 2024-03-08T20:29:43.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.363+0000 7f1531800640 1 -- start start 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 0x7f152c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 0x7f152c141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c152990 con 0x7f152c06e750 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1550a0 con 0x7f152c1525b0 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1531800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0bfff0 con 0x7f152c1555c0 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f152aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f152aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59174/0 (socket says 172.21.15.118:59174) 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f152aa00640 1 -- 172.21.15.118:0/2608185118 learned_addr learned my addr 172.21.15.118:0/2608185118 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f152b400640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 0x7f152c141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.364+0000 7f1522000640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 0x7f152c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 -- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 msgr2=0x7f152c141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 0x7f152c141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 -- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 msgr2=0x7f152c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 0x7f152c153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 -- 172.21.15.118:0/2608185118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c1e8200 con 0x7f152c06e750 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152b400640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 0x7f152c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1522000640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 0x7f152c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f152aa00640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d800 tx=0x7f151c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00b6c0 con 0x7f152c06e750 2024-03-08T20:29:43.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c019070 con 0x7f152c06e750 2024-03-08T20:29:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ba80 con 0x7f152c06e750 2024-03-08T20:29:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c071e20 con 0x7f152c06e750 2024-03-08T20:29:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.365+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c0723e0 con 0x7f152c06e750 2024-03-08T20:29:43.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.366+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c074a40 con 0x7f152c06e750 2024-03-08T20:29:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.367+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f151c00bc20 con 0x7f152c06e750 2024-03-08T20:29:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.368+0000 7f1523400640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 0x7f150806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.368+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f151c08b1e0 con 0x7f152c06e750 2024-03-08T20:29:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.369+0000 7f1522000640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 0x7f150806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.369+0000 7f1522000640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 0x7f150806e0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f152c06af30 tx=0x7f1514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.373+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f151c01c360 con 0x7f152c06e750 2024-03-08T20:29:43.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.576+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f152c0c37a0 con 0x7f152c06e750 2024-03-08T20:29:43.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.578+0000 7f1523400640 1 -- 172.21.15.118:0/2608185118 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f151c059a20 con 0x7f152c06e750 2024-03-08T20:29:43.577 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:43.578 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:43.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 msgr2=0x7f150806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 0x7f150806e0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f152c06af30 tx=0x7f1514008040 comp rx=0 tx=0).stop 2024-03-08T20:29:43.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 msgr2=0x7f152c1eafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d800 tx=0x7f151c00dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 shutdown_connections 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f150806bc00 0x7f150806e0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f152c1555c0 0x7f152c141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f152c1525b0 0x7f152c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 --2- 172.21.15.118:0/2608185118 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f152c06e750 0x7f152c1eafe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.580+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 >> 172.21.15.118:0/2608185118 conn(0x7f152c0a84c0 msgr2=0x7f152c154920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.581+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 shutdown_connections 2024-03-08T20:29:43.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.581+0000 7f1531800640 1 -- 172.21.15.118:0/2608185118 wait complete. 2024-03-08T20:29:43.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:43.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.803+0000 7f7265e00640 1 Processor -- start 2024-03-08T20:29:43.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.803+0000 7f7265e00640 1 -- start start 2024-03-08T20:29:43.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f7265e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7260151620 0x7f72600c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f7265e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726006e3d0 0x7f7260151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f7265e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7260072c20 con 0x7f72600c1090 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f7265e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7260151f40 con 0x7f7260151620 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f7265e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7260072f00 con 0x7f726006e3d0 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.804+0000 7f725ea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7260151620 0x7f72600c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7260151620 0x7f72600c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59176/0 (socket says 172.21.15.118:59176) 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 -- 172.21.15.118:0/964323420 learned_addr learned my addr 172.21.15.118:0/964323420 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725e000640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726006e3d0 0x7f7260151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 -- 172.21.15.118:0/964323420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726006e3d0 msgr2=0x7f7260151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726006e3d0 0x7f7260151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 -- 172.21.15.118:0/964323420 >> v1:172.21.15.144:6789/0 conn(0x7f72600c1090 legacy=0x7f72601549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:43.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.805+0000 7f725ea00640 1 -- 172.21.15.118:0/964323420 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7260152180 con 0x7f7260151620 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.806+0000 7f725ea00640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72600c2a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7250009870 tx=0x7f725002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584ab901c246e1be server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.806+0000 7f725d600640 1 -- 172.21.15.118:0/964323420 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250035020 con 0x7f7260151620 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.806+0000 7f725d600640 1 -- 172.21.15.118:0/964323420 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250031640 con 0x7f7260151620 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.806+0000 7f725d600640 1 -- 172.21.15.118:0/964323420 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725002d040 con 0x7f7260151620 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 -- 172.21.15.118:0/964323420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 msgr2=0x7f72600c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72600c2a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7250009870 tx=0x7f725002b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 -- 172.21.15.118:0/964323420 shutdown_connections 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726006e3d0 0x7f7260151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 --2- 172.21.15.118:0/964323420 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72600c2a60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 -- 172.21.15.118:0/964323420 >> 172.21.15.118:0/964323420 conn(0x7f72600a84c0 msgr2=0x7f72600a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 -- 172.21.15.118:0/964323420 shutdown_connections 2024-03-08T20:29:43.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.807+0000 7f7265e00640 1 -- 172.21.15.118:0/964323420 wait complete. 2024-03-08T20:29:43.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.809+0000 7f7265e00640 1 Processor -- start 2024-03-08T20:29:43.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.809+0000 7f7265e00640 1 -- start start 2024-03-08T20:29:43.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726006e3d0 0x7f726015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72600c1090 0x7f72601ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601550e0 con 0x7f7260151620 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c1520 con 0x7f726006e3d0 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f7265e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600c6690 con 0x7f72600c1090 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59186/0 (socket says 172.21.15.118:59186) 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 -- 172.21.15.118:0/1484533409 learned_addr learned my addr 172.21.15.118:0/1484533409 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725ea00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726006e3d0 0x7f726015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725e000640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72600c1090 0x7f72601ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 -- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72600c1090 msgr2=0x7f72601ee320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72600c1090 0x7f72601ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 -- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726006e3d0 msgr2=0x7f726015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726006e3d0 0x7f726015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.810+0000 7f725f400640 1 -- 172.21.15.118:0/1484533409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72601eefd0 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f725f400640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f725800c780 tx=0x7f725800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258004b60 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258004d00 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725800aa90 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7260156e20 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.811+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72600ab8a0 con 0x7f7260151620 2024-03-08T20:29:43.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.812+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260074a40 con 0x7f7260151620 2024-03-08T20:29:43.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.813+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f725800ac30 con 0x7f7260151620 2024-03-08T20:29:43.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.814+0000 7f7257400640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 0x7f724006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:43.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.814+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f725808b140 con 0x7f7260151620 2024-03-08T20:29:43.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.814+0000 7f725ea00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 0x7f724006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:43.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.815+0000 7f725ea00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 0x7f724006e0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:43.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:43.819+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7258020070 con 0x7f7260151620 2024-03-08T20:29:44.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.018+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726015cb90 con 0x7f7260151620 2024-03-08T20:29:44.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.021+0000 7f7257400640 1 -- 172.21.15.118:0/1484533409 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f72580597c0 con 0x7f7260151620 2024-03-08T20:29:44.021 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:44.021 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 msgr2=0x7f724006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 0x7f724006e0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7250036000 tx=0x7f725003c040 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 msgr2=0x7f72601ec020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f725800c780 tx=0x7f725800cc40 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 shutdown_connections 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f724006bc00 0x7f724006e0c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7260151620 0x7f72601ec020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72600c1090 0x7f72601ee320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 --2- 172.21.15.118:0/1484533409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726006e3d0 0x7f726015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 >> 172.21.15.118:0/1484533409 conn(0x7f72600a84c0 msgr2=0x7f726014fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:44.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 shutdown_connections 2024-03-08T20:29:44.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.025+0000 7f7265e00640 1 -- 172.21.15.118:0/1484533409 wait complete. 2024-03-08T20:29:44.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-08T20:29:44.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.255+0000 7fc874600640 1 Processor -- start 2024-03-08T20:29:44.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.256+0000 7fc874600640 1 -- start start 2024-03-08T20:29:44.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc874600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc86c0bde90 0x7fc86c155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc874600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c159080 con 0x7fc86c0c8700 2024-03-08T20:29:44.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc874600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c0c52b0 con 0x7fc86c152570 2024-03-08T20:29:44.256 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc874600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c158e30 con 0x7fc86c0bde90 2024-03-08T20:29:44.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc871c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc86c152570 0x7fc86c0caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:46970/0 (socket says 172.21.15.118:46970) 2024-03-08T20:29:44.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc871c00640 1 -- 172.21.15.118:0/3939955377 learned_addr learned my addr 172.21.15.118:0/3939955377 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:44.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.257+0000 7fc872600640 1 --2- 172.21.15.118:0/3939955377 >> v2:172.21.15.144:3300/0 conn(0x7fc86c0bde90 0x7fc86c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259582459 0 0) 0x7fc86c159080 con 0x7fc86c0c8700 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc854003520 con 0x7fc86c0c8700 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 411302278 0 0) 0x7fc854003520 con 0x7fc86c0c8700 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 >> v2:172.21.15.144:3300/0 conn(0x7fc86c0bde90 msgr2=0x7fc86c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 --2- 172.21.15.118:0/3939955377 >> v2:172.21.15.144:3300/0 conn(0x7fc86c0bde90 0x7fc86c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 >> v1:172.21.15.144:6789/0 conn(0x7fc86c152570 legacy=0x7fc86c0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0c5590 con 0x7fc86c0c8700 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fc858001670 con 0x7fc86c0c8700 2024-03-08T20:29:44.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 >> v1:172.21.15.118:6789/0 conn(0x7fc86c0c8700 legacy=0x7fc86c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8540039b0 0x7fc854003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.258+0000 7fc86be00640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 0x7fc854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc86be00640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc854005210 0x7fc85400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c158e30 con 0x7fc854004800 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85400c140 con 0x7fc854005210 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85400c340 con 0x7fc8540039b0 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 0x7fc854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc872600640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc854005210 0x7fc85400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871c00640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8540039b0 0x7fc854003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 -- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8540039b0 msgr2=0x7fc854003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8540039b0 0x7fc854003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 -- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc854005210 msgr2=0x7fc85400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:44.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc854005210 0x7fc85400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc871200640 1 -- 172.21.15.118:0/3939955377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854003520 con 0x7fc854004800 2024-03-08T20:29:44.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.259+0000 7fc872600640 1 -- 172.21.15.118:0/3939955377 reap_dead start 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.261+0000 7fc871200640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 0x7fc854004c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c160 tx=0x7fc854005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354a9a0394610979 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.261+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858007c60 con 0x7fc854004800 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.261+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858030070 con 0x7fc854004800 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.261+0000 7fc86be00640 1 -- 172.21.15.118:0/3939955377 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858007490 con 0x7fc854004800 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 -- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 msgr2=0x7fc854004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 0x7fc854004c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c160 tx=0x7fc854005830 comp rx=0 tx=0).stop 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 -- 172.21.15.118:0/3939955377 shutdown_connections 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 --2- 172.21.15.118:0/3939955377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc854004800 0x7fc854004c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 -- 172.21.15.118:0/3939955377 >> 172.21.15.118:0/3939955377 conn(0x7fc86c072620 msgr2=0x7fc86c072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 -- 172.21.15.118:0/3939955377 shutdown_connections 2024-03-08T20:29:44.262 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.262+0000 7fc874600640 1 -- 172.21.15.118:0/3939955377 wait complete. 2024-03-08T20:29:44.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.263+0000 7fc874600640 1 Processor -- start 2024-03-08T20:29:44.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.264+0000 7fc874600640 1 -- start start 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc854004800 0x7fc86c0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c14f8c0 0x7fc86c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0caaf0 con 0x7fc86c1eb460 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c159360 con 0x7fc86c14f8c0 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc874600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c0cac70 con 0x7fc854004800 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59206/0 (socket says 172.21.15.118:59206) 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 -- 172.21.15.118:0/104433425 learned_addr learned my addr 172.21.15.118:0/104433425 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:44.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc871c00640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc854004800 0x7fc86c0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc871200640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c14f8c0 0x7fc86c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 -- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc854004800 msgr2=0x7fc86c0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc854004800 0x7fc86c0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 -- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c14f8c0 msgr2=0x7fc86c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c14f8c0 0x7fc86c147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.265+0000 7fc872600640 1 -- 172.21.15.118:0/104433425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c1eaca0 con 0x7fc86c1eb460 2024-03-08T20:29:44.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc872600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0aa270 tx=0x7fc864011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864019020 con 0x7fc86c1eb460 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864003610 con 0x7fc86c1eb460 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864003a00 con 0x7fc86c1eb460 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86c1eecb0 con 0x7fc86c1eb460 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.266+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c151770 con 0x7fc86c1eb460 2024-03-08T20:29:44.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.267+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c158fe0 con 0x7fc86c1eb460 2024-03-08T20:29:44.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.268+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc86401c020 con 0x7fc86c1eb460 2024-03-08T20:29:44.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.269+0000 7fc869600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 0x7fc84c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:44.268 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.269+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc86408b050 con 0x7fc86c1eb460 2024-03-08T20:29:44.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.269+0000 7fc871c00640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 0x7fc84c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:44.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.270+0000 7fc871c00640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 0x7fc84c06e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc860001940 tx=0x7fc860009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:44.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.276+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc86c158fe0 con 0x7fc86c1eb460 2024-03-08T20:29:44.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:44.514+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc86c074a40 con 0x7fc86c1eb460 2024-03-08T20:29:45.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.394+0000 7fc869600640 1 -- 172.21.15.118:0/104433425 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc864023030 con 0x7fc86c1eb460 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.397+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 msgr2=0x7fc84c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.397+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 0x7fc84c06e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc860001940 tx=0x7fc860009040 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.397+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 msgr2=0x7fc86c14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.397+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0aa270 tx=0x7fc864011920 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 shutdown_connections 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc84c06bbd0 0x7fc84c06e090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc86c1eb460 0x7fc86c14ab30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc86c14f8c0 0x7fc86c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 --2- 172.21.15.118:0/104433425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc854004800 0x7fc86c0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 >> 172.21.15.118:0/104433425 conn(0x7fc86c072620 msgr2=0x7fc86c0c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 shutdown_connections 2024-03-08T20:29:45.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.398+0000 7fc874600640 1 -- 172.21.15.118:0/104433425 wait complete. 2024-03-08T20:29:45.420 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-03-08T20:29:45.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-08T20:29:45.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.635+0000 7f6efe400640 1 Processor -- start 2024-03-08T20:29:45.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.636+0000 7f6efe400640 1 -- start start 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6efe400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6ef80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6efe400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ef80c29a0 0x7f6ef8152820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6efe400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef80c6390 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6efe400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef806cf90 con 0x7f6ef80c29a0 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6efe400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8156190 con 0x7f6ef8072f40 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6eeea00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6ef80c5ad0 0x7f6ef8152110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47870/0 (socket says 172.21.15.118:47870) 2024-03-08T20:29:45.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.637+0000 7f6eeea00640 1 -- 172.21.15.118:0/3048423124 learned_addr learned my addr 172.21.15.118:0/3048423124 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/3048423124 >> v2:172.21.15.144:3300/0 conn(0x7f6ef80c29a0 0x7f6ef8152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef7400640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6ef80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357517824 0 0) 0x7f6ef80c6390 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6edc003520 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287733610 0 0) 0x7f6edc003520 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 msgr2=0x7f6ef80c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:45.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6ef80c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 >> v2:172.21.15.144:3300/0 conn(0x7f6ef80c29a0 msgr2=0x7f6ef8152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 --2- 172.21.15.118:0/3048423124 >> v2:172.21.15.144:3300/0 conn(0x7f6ef80c29a0 0x7f6ef8152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8155610 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f6ee0001670 con 0x7f6ef80c5ad0 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 >> v1:172.21.15.118:6789/0 conn(0x7f6ef80c5ad0 legacy=0x7f6ef8152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6edc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc003f30 0x7f6edc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc004d40 0x7f6edc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8156190 con 0x7f6edc003f30 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc00b9c0 con 0x7f6edc004d40 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.638+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc00bb40 con 0x7f6ef8072f40 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc003f30 0x7f6edc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6ef7400640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6edc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 -- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 msgr2=0x7f6edc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc004d40 0x7f6edc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef8072f40 0x7f6edc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 -- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc004d40 msgr2=0x7f6edc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc004d40 0x7f6edc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6eeea00640 1 -- 172.21.15.118:0/3048423124 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc003520 con 0x7f6edc003f30 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.639+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc004d40 0x7f6edc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:45.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.640+0000 7f6eeea00640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc003f30 0x7f6edc004800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c290 tx=0x7f6edc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918879f567de424a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:45.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.640+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0007d50 con 0x7f6edc003f30 2024-03-08T20:29:45.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0030070 con 0x7f6edc003f30 2024-03-08T20:29:45.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6ef6a00640 1 -- 172.21.15.118:0/3048423124 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee002cdb0 con 0x7f6edc003f30 2024-03-08T20:29:45.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 -- 172.21.15.118:0/3048423124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc003f30 msgr2=0x7f6edc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 --2- 172.21.15.118:0/3048423124 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6edc003f30 0x7f6edc004800 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c290 tx=0x7f6edc005830 comp rx=0 tx=0).stop 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6ef7e00640 1 -- 172.21.15.118:0/3048423124 reap_dead start 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 -- 172.21.15.118:0/3048423124 shutdown_connections 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 -- 172.21.15.118:0/3048423124 >> 172.21.15.118:0/3048423124 conn(0x7f6ef806b720 msgr2=0x7f6ef80c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 -- 172.21.15.118:0/3048423124 shutdown_connections 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.641+0000 7f6efe400640 1 -- 172.21.15.118:0/3048423124 wait complete. 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.643+0000 7f6efe400640 1 Processor -- start 2024-03-08T20:29:45.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.643+0000 7f6efe400640 1 -- start start 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc003f30 0x7f6ef8151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef80aacf0 0x7f6ef814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8155eb0 con 0x7f6ef814b870 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8155bd0 con 0x7f6edc003f30 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6efe400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8073320 con 0x7f6ef80aacf0 2024-03-08T20:29:45.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59224/0 (socket says 172.21.15.118:59224) 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.644+0000 7f6ef7e00640 1 -- 172.21.15.118:0/2664504312 learned_addr learned my addr 172.21.15.118:0/2664504312 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc003f30 0x7f6ef8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6eeea00640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef80aacf0 0x7f6ef814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 -- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef80aacf0 msgr2=0x7f6ef814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef80aacf0 0x7f6ef814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 -- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc003f30 msgr2=0x7f6ef8151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc003f30 0x7f6ef8151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 -- 172.21.15.118:0/2664504312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80aa810 con 0x7f6ef814b870 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6ef7e00640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009fd0 tx=0x7f6ef000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0016620 con 0x7f6ef814b870 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef001b070 con 0x7f6ef814b870 2024-03-08T20:29:45.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00169e0 con 0x7f6ef814b870 2024-03-08T20:29:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.645+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef81ee9e0 con 0x7f6ef814b870 2024-03-08T20:29:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.646+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef81eecc0 con 0x7f6ef814b870 2024-03-08T20:29:45.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.647+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8074a40 con 0x7f6ef814b870 2024-03-08T20:29:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.648+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6ef0005d10 con 0x7f6ef814b870 2024-03-08T20:29:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.648+0000 7f6eefe00640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 0x7f6ed406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.649+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6ef008b910 con 0x7f6ef814b870 2024-03-08T20:29:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.649+0000 7f6ef7400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 0x7f6ed406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:45.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.649+0000 7f6ef7400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 0x7f6ed406e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098b0 tx=0x7f6ee8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:45.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.653+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f6ef0025020 con 0x7f6ef814b870 2024-03-08T20:29:45.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:45.886+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6ef80c1370 con 0x7f6ef814b870 2024-03-08T20:29:46.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.404+0000 7f6eefe00640 1 -- 172.21.15.118:0/2664504312 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ef005a0b0 con 0x7f6ef814b870 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 msgr2=0x7f6ed406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 0x7f6ed406e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80098b0 tx=0x7f6ee8008040 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 msgr2=0x7f6ef81eaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009fd0 tx=0x7f6ef000f520 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 shutdown_connections 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6ed406bc00 0x7f6ed406e0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ef814b870 0x7f6ef81eaf60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ef80aacf0 0x7f6ef814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 --2- 172.21.15.118:0/2664504312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6edc003f30 0x7f6ef8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 >> 172.21.15.118:0/2664504312 conn(0x7f6ef806b720 msgr2=0x7f6ef806cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:46.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 shutdown_connections 2024-03-08T20:29:46.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.408+0000 7f6efe400640 1 -- 172.21.15.118:0/2664504312 wait complete. 2024-03-08T20:29:46.429 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-08T20:29:46.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:46.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.636+0000 7fa6e5400640 1 Processor -- start 2024-03-08T20:29:46.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.636+0000 7fa6e5400640 1 -- start start 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 0x7fa6e00c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 0x7fa6e006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6e01555c0 0x7fa6e0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e0155f50 con 0x7fa6e01555c0 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e006e0d0 con 0x7fa6e01525b0 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.637+0000 7fa6e5400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00c0340 con 0x7fa6e006e750 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6e01555c0 0x7fa6e0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa6e01555c0 0x7fa6e0155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59238/0 (socket says 172.21.15.118:59238) 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 -- 172.21.15.118:0/556031721 learned_addr learned my addr 172.21.15.118:0/556031721 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:46.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6d7e00640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 0x7fa6e006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6de800640 1 --2- 172.21.15.118:0/556031721 >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 0x7fa6e00c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 -- 172.21.15.118:0/556031721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 msgr2=0x7fa6e006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 0x7fa6e006ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 -- 172.21.15.118:0/556031721 >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 msgr2=0x7fa6e00c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 --2- 172.21.15.118:0/556031721 >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 0x7fa6e00c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6df200640 1 -- 172.21.15.118:0/556031721 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00c0620 con 0x7fa6e01555c0 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6d7e00640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 0x7fa6e006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:46.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.638+0000 7fa6de800640 1 --2- 172.21.15.118:0/556031721 >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 0x7fa6e00c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.639+0000 7fa6df200640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e01555c0 0x7fa6e0155a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00c7700 tx=0x7fa6d802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5524c574edad50c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6dde00640 1 -- 172.21.15.118:0/556031721 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d802c9f0 con 0x7fa6e01555c0 2024-03-08T20:29:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6dde00640 1 -- 172.21.15.118:0/556031721 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d802cb90 con 0x7fa6e01555c0 2024-03-08T20:29:46.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6dde00640 1 -- 172.21.15.118:0/556031721 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80343f0 con 0x7fa6e01555c0 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6e5400640 1 -- 172.21.15.118:0/556031721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e01555c0 msgr2=0x7fa6e0155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6e5400640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e01555c0 0x7fa6e0155a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00c7700 tx=0x7fa6d802be50 comp rx=0 tx=0).stop 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6e5400640 1 -- 172.21.15.118:0/556031721 shutdown_connections 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.640+0000 7fa6e5400640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e01555c0 0x7fa6e0155a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.641+0000 7fa6e5400640 1 --2- 172.21.15.118:0/556031721 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e006e750 0x7fa6e006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.641+0000 7fa6e5400640 1 --2- 172.21.15.118:0/556031721 >> v2:172.21.15.144:3300/0 conn(0x7fa6e01525b0 0x7fa6e00c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.641+0000 7fa6e5400640 1 -- 172.21.15.118:0/556031721 >> 172.21.15.118:0/556031721 conn(0x7fa6e00a84c0 msgr2=0x7fa6e00a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.641+0000 7fa6e5400640 1 -- 172.21.15.118:0/556031721 shutdown_connections 2024-03-08T20:29:46.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.641+0000 7fa6e5400640 1 -- 172.21.15.118:0/556031721 wait complete. 2024-03-08T20:29:46.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.642+0000 7fa6e5400640 1 Processor -- start 2024-03-08T20:29:46.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.642+0000 7fa6e5400640 1 -- start start 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e01525b0 0x7fa6e00c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e01555c0 0x7fa6e01e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0152990 con 0x7fa6e006e750 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e01550a0 con 0x7fa6e01555c0 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.643+0000 7fa6e5400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00bfff0 con 0x7fa6e01525b0 2024-03-08T20:29:46.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59254/0 (socket says 172.21.15.118:59254) 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 -- 172.21.15.118:0/2546170822 learned_addr learned my addr 172.21.15.118:0/2546170822 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 -- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e01525b0 msgr2=0x7fa6e00c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e01525b0 0x7fa6e00c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 -- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e01555c0 msgr2=0x7fa6e01e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6df200640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e01555c0 0x7fa6e01e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e01555c0 0x7fa6e01e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 -- 172.21.15.118:0/2546170822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e01eeb50 con 0x7fa6e006e750 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.644+0000 7fa6de800640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c7f0 tx=0x7fa6d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.645+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0015070 con 0x7fa6e006e750 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.645+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0007a30 con 0x7fa6e006e750 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.645+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007e00 con 0x7fa6e006e750 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.645+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e0155af0 con 0x7fa6e006e750 2024-03-08T20:29:46.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.645+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0072c30 con 0x7fa6e006e750 2024-03-08T20:29:46.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.646+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e0074a40 con 0x7fa6e006e750 2024-03-08T20:29:46.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.647+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa6d0018070 con 0x7fa6e006e750 2024-03-08T20:29:46.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.648+0000 7fa6d6a00640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 0x7fa6bc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:46.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.648+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa6d008ad70 con 0x7fa6e006e750 2024-03-08T20:29:46.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.648+0000 7fa6d7e00640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 0x7fa6bc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:46.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.649+0000 7fa6d7e00640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 0x7fa6bc06e0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8006b10 tx=0x7fa6c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:46.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.652+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa6d0059510 con 0x7fa6e006e750 2024-03-08T20:29:46.883 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.884+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6e0150fc0 con 0x7fa6e006e750 2024-03-08T20:29:46.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.885+0000 7fa6d6a00640 1 -- 172.21.15.118:0/2546170822 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fa6d0058e10 con 0x7fa6e006e750 2024-03-08T20:29:46.885 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:46.885 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:29:46.885 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 msgr2=0x7fa6bc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 0x7fa6bc06e0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8006b10 tx=0x7fa6c8008040 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 msgr2=0x7fa6e01ee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c7f0 tx=0x7fa6d000cbf0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 shutdown_connections 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa6bc06bc00 0x7fa6bc06e0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e01555c0 0x7fa6e01e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6e01525b0 0x7fa6e00c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 --2- 172.21.15.118:0/2546170822 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa6e006e750 0x7fa6e01ee610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 >> 172.21.15.118:0/2546170822 conn(0x7fa6e00a84c0 msgr2=0x7fa6e00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 shutdown_connections 2024-03-08T20:29:46.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:46.888+0000 7fa6e5400640 1 -- 172.21.15.118:0/2546170822 wait complete. 2024-03-08T20:29:46.907 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.117+0000 7f8e49800640 1 Processor -- start 2024-03-08T20:29:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.117+0000 7f8e49800640 1 -- start start 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e49800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e49800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 0x7f8e441532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e49800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e440aa980 con 0x7f8e4406af80 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e49800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e44150870 con 0x7f8e44152e10 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e49800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440aac60 con 0x7f8e4414fed0 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e43400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 0x7f8e441532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e3be00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e3be00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:46940/0 (socket says 172.21.15.118:46940) 2024-03-08T20:29:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e43400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 0x7f8e441532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:53114/0 (socket says 172.21.15.118:53114) 2024-03-08T20:29:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.119+0000 7f8e3be00640 1 -- 172.21.15.118:0/2874111471 learned_addr learned my addr 172.21.15.118:0/2874111471 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.120+0000 7f8e3be00640 1 -- 172.21.15.118:0/2874111471 >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 msgr2=0x7f8e441532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.120+0000 7f8e3be00640 1 --2- 172.21.15.118:0/2874111471 >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 0x7f8e441532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.120+0000 7f8e3be00640 1 -- 172.21.15.118:0/2874111471 >> v1:172.21.15.144:6789/0 conn(0x7f8e4406af80 legacy=0x7f8e4406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.120+0000 7f8e3be00640 1 -- 172.21.15.118:0/2874111471 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440aaf40 con 0x7f8e4414fed0 2024-03-08T20:29:47.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.121+0000 7f8e3be00640 1 --2- 172.21.15.118:0/2874111471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009870 tx=0x7f8e2c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d32397863f88c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.122+0000 7f8e42000640 1 -- 172.21.15.118:0/2874111471 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c035020 con 0x7f8e4414fed0 2024-03-08T20:29:47.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.122+0000 7f8e42000640 1 -- 172.21.15.118:0/2874111471 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c031640 con 0x7f8e4414fed0 2024-03-08T20:29:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.122+0000 7f8e42000640 1 -- 172.21.15.118:0/2874111471 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c02d040 con 0x7f8e4414fed0 2024-03-08T20:29:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 -- 172.21.15.118:0/2874111471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 msgr2=0x7f8e44150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 --2- 172.21.15.118:0/2874111471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009870 tx=0x7f8e2c02b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 -- 172.21.15.118:0/2874111471 shutdown_connections 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 --2- 172.21.15.118:0/2874111471 >> v2:172.21.15.144:3300/0 conn(0x7f8e44152e10 0x7f8e441532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 --2- 172.21.15.118:0/2874111471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e4414fed0 0x7f8e44150330 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 -- 172.21.15.118:0/2874111471 >> 172.21.15.118:0/2874111471 conn(0x7f8e440a84c0 msgr2=0x7f8e440a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 -- 172.21.15.118:0/2874111471 shutdown_connections 2024-03-08T20:29:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.123+0000 7f8e49800640 1 -- 172.21.15.118:0/2874111471 wait complete. 2024-03-08T20:29:47.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.125+0000 7f8e49800640 1 Processor -- start 2024-03-08T20:29:47.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.125+0000 7f8e49800640 1 -- start start 2024-03-08T20:29:47.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 0x7f8e440a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e44152e10 0x7f8e44141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440c3f90 con 0x7f8e4414fed0 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440c3e10 con 0x7f8e4406af80 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e49800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4406eda0 con 0x7f8e44152e10 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59258/0 (socket says 172.21.15.118:59258) 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 -- 172.21.15.118:0/1627228577 learned_addr learned my addr 172.21.15.118:0/1627228577 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e43400640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e44152e10 0x7f8e44141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e42a00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 0x7f8e440a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 -- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e44152e10 msgr2=0x7f8e44141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e44152e10 0x7f8e44141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 -- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 msgr2=0x7f8e440a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 0x7f8e440a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e3be00640 1 -- 172.21.15.118:0/1627228577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e441d9740 con 0x7f8e4414fed0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.126+0000 7f8e42a00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 0x7f8e440a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e3be00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02b930 tx=0x7f8e2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c040070 con 0x7f8e4414fed0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c03e070 con 0x7f8e4414fed0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e441edf20 con 0x7f8e4414fed0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c035040 con 0x7f8e4414fed0 2024-03-08T20:29:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.127+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e441ee4e0 con 0x7f8e4414fed0 2024-03-08T20:29:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.128+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e44150690 con 0x7f8e4414fed0 2024-03-08T20:29:47.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.129+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8e2c038020 con 0x7f8e4414fed0 2024-03-08T20:29:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.130+0000 7f8e3aa00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 0x7f8e2006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.130+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8e2c0ac770 con 0x7f8e4414fed0 2024-03-08T20:29:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.130+0000 7f8e42a00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 0x7f8e2006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.131+0000 7f8e42a00640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 0x7f8e2006e0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001680 tx=0x7f8e34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.135+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8e44150690 con 0x7f8e4414fed0 2024-03-08T20:29:47.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.333+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e44074a40 con 0x7f8e4414fed0 2024-03-08T20:29:47.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.336+0000 7f8e3aa00640 1 -- 172.21.15.118:0/1627228577 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f8e2c07af10 con 0x7f8e4414fed0 2024-03-08T20:29:47.336 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:47.336 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 msgr2=0x7f8e2006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 0x7f8e2006e0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e34001680 tx=0x7f8e34009040 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 msgr2=0x7f8e44140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02b930 tx=0x7f8e2c0046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 shutdown_connections 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8e2006bc00 0x7f8e2006e0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e44152e10 0x7f8e44141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e4414fed0 0x7f8e44140e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 --2- 172.21.15.118:0/1627228577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e4406af80 0x7f8e440a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 >> 172.21.15.118:0/1627228577 conn(0x7f8e440a84c0 msgr2=0x7f8e440a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:47.339 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 shutdown_connections 2024-03-08T20:29:47.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.339+0000 7f8e49800640 1 -- 172.21.15.118:0/1627228577 wait complete. 2024-03-08T20:29:47.355 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-08T20:29:47.356 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:29:47.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.557+0000 7efd8ae00640 1 Processor -- start 2024-03-08T20:29:47.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.557+0000 7efd8ae00640 1 -- start start 2024-03-08T20:29:47.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd8ae00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd8406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd8ae00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840aa980 con 0x7efd841505e0 2024-03-08T20:29:47.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd8ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840aac60 con 0x7efd8406ebd0 2024-03-08T20:29:47.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd8ae00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840aaf40 con 0x7efd8406af80 2024-03-08T20:29:47.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd88e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efd841505e0 0x7efd84152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47886/0 (socket says 172.21.15.118:47886) 2024-03-08T20:29:47.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.558+0000 7efd88e00640 1 -- 172.21.15.118:0/3885733951 learned_addr learned my addr 172.21.15.118:0/3885733951 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd83e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd8406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640120787 0 0) 0x7efd840aa980 con 0x7efd841505e0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd68003520 con 0x7efd841505e0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101185208 0 0) 0x7efd68003520 con 0x7efd841505e0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 msgr2=0x7efd8406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd8406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 >> v1:172.21.15.144:6789/0 conn(0x7efd8406ebd0 legacy=0x7efd8414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840ab220 con 0x7efd841505e0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7efd7c001670 con 0x7efd841505e0 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 >> v1:172.21.15.118:6789/0 conn(0x7efd841505e0 legacy=0x7efd84152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd680039e0 0x7efd68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd68004d40 0x7efd680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.559+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840aaf40 con 0x7efd68004d40 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6800baf0 con 0x7efd680039e0 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6800bcf0 con 0x7efd8406af80 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd68004d40 0x7efd680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd83e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd680039e0 0x7efd68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd83400640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 -- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 msgr2=0x7efd68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 -- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd680039e0 msgr2=0x7efd68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd680039e0 0x7efd68003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd88e00640 1 -- 172.21.15.118:0/3885733951 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68003520 con 0x7efd68004d40 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd83400640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd8406af80 0x7efd68004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.560+0000 7efd83e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd680039e0 0x7efd68003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.561+0000 7efd88e00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd68004d40 0x7efd680051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3c3737d9ad002c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.561+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c007cf0 con 0x7efd68004d40 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.561+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c030070 con 0x7efd68004d40 2024-03-08T20:29:47.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.561+0000 7efd82a00640 1 -- 172.21.15.118:0/3885733951 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c005d30 con 0x7efd68004d40 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 -- 172.21.15.118:0/3885733951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd68004d40 msgr2=0x7efd680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 --2- 172.21.15.118:0/3885733951 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd68004d40 0x7efd680051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd68005830 comp rx=0 tx=0).stop 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd88e00640 1 -- 172.21.15.118:0/3885733951 reap_dead start 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 -- 172.21.15.118:0/3885733951 shutdown_connections 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 -- 172.21.15.118:0/3885733951 >> 172.21.15.118:0/3885733951 conn(0x7efd840a84c0 msgr2=0x7efd840a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 -- 172.21.15.118:0/3885733951 shutdown_connections 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.562+0000 7efd8ae00640 1 -- 172.21.15.118:0/3885733951 wait complete. 2024-03-08T20:29:47.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.564+0000 7efd8ae00640 1 Processor -- start 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.564+0000 7efd8ae00640 1 -- start start 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd68004d40 0x7efd840c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd84153830 0x7efd841484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8406b4e0 con 0x7efd84148a00 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8406b360 con 0x7efd84153830 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd8ae00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8406e690 con 0x7efd68004d40 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd88e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd88e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59282/0 (socket says 172.21.15.118:59282) 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd88e00640 1 -- 172.21.15.118:0/2023510693 learned_addr learned my addr 172.21.15.118:0/2023510693 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd83e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd68004d40 0x7efd840c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.565+0000 7efd83400640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd84153830 0x7efd841484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 -- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd68004d40 msgr2=0x7efd840c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd68004d40 0x7efd840c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 -- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd84153830 msgr2=0x7efd841484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd84153830 0x7efd841484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 -- 172.21.15.118:0/2023510693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84141bc0 con 0x7efd84148a00 2024-03-08T20:29:47.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd88e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c360 tx=0x7efd840aab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c007cf0 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c0049f0 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd841e7220 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c001c30 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.566+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8414cd90 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.568+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd84074a40 con 0x7efd84148a00 2024-03-08T20:29:47.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.568+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efd7c007070 con 0x7efd84148a00 2024-03-08T20:29:47.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.570+0000 7efd7be00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 0x7efd6406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:47.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.570+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efd7c0abff0 con 0x7efd84148a00 2024-03-08T20:29:47.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.570+0000 7efd83e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 0x7efd6406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:47.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.570+0000 7efd83e00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 0x7efd6406e0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd74009fd0 tx=0x7efd7400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:47.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.574+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7efd7c07a7f0 con 0x7efd84148a00 2024-03-08T20:29:47.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.767+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd8414f630 con 0x7efd6406bc00 2024-03-08T20:29:47.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.797+0000 7efd7be00640 1 -- 172.21.15.118:0/2023510693 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332651 (secure 0 0 0) 0x7efd8414f630 con 0x7efd6406bc00 2024-03-08T20:29:47.802 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:47.804 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:29:47.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.804+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 msgr2=0x7efd6406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.804+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 0x7efd6406e0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd74009fd0 tx=0x7efd7400b040 comp rx=0 tx=0).stop 2024-03-08T20:29:47.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.804+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 msgr2=0x7efd841e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:47.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.804+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c360 tx=0x7efd840aab50 comp rx=0 tx=0).stop 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 shutdown_connections 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efd6406bc00 0x7efd6406e0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd84148a00 0x7efd841e9b10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd84153830 0x7efd841484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 --2- 172.21.15.118:0/2023510693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd68004d40 0x7efd840c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 >> 172.21.15.118:0/2023510693 conn(0x7efd840a84c0 msgr2=0x7efd84142120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 shutdown_connections 2024-03-08T20:29:47.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:47.805+0000 7efd8ae00640 1 -- 172.21.15.118:0/2023510693 wait complete. 2024-03-08T20:29:47.827 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-08T20:29:47.520992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222588,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752132,"statfs":{"total":773094113280,"available":772866183168,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004203"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693297+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:29:29.693297+0000","last_peered":"2024-03-08T20:29:29.693297+0000","last_clean":"2024-03-08T20:29:29.693297+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:29:29.693297+0000","last_undegraded":"2024-03-08T20:29:29.693297+0000","last_fullsized":"2024-03-08T20:29:29.693297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324902+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:29:29.324902+0000","last_peered":"2024-03-08T20:29:29.324902+0000","last_clean":"2024-03-08T20:29:29.324902+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:29:29.324902+0000","last_undegraded":"2024-03-08T20:29:29.324902+0000","last_fullsized":"2024-03-08T20:29:29.324902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323005+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:29:29.323005+0000","last_peered":"2024-03-08T20:29:29.323005+0000","last_clean":"2024-03-08T20:29:29.323005+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:29:29.323005+0000","last_undegraded":"2024-03-08T20:29:29.323005+0000","last_fullsized":"2024-03-08T20:29:29.323005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324958+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:29:29.324958+0000","last_peered":"2024-03-08T20:29:29.324958+0000","last_clean":"2024-03-08T20:29:29.324958+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:29:29.324958+0000","last_undegraded":"2024-03-08T20:29:29.324958+0000","last_fullsized":"2024-03-08T20:29:29.324958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693020+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:29:29.693020+0000","last_peered":"2024-03-08T20:29:29.693020+0000","last_clean":"2024-03-08T20:29:29.693020+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:29:29.693020+0000","last_undegraded":"2024-03-08T20:29:29.693020+0000","last_fullsized":"2024-03-08T20:29:29.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326542+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:29:29.326542+0000","last_peered":"2024-03-08T20:29:29.326542+0000","last_clean":"2024-03-08T20:29:29.326542+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:29:29.326542+0000","last_undegraded":"2024-03-08T20:29:29.326542+0000","last_fullsized":"2024-03-08T20:29:29.326542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695864+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:29:29.695864+0000","last_peered":"2024-03-08T20:29:29.695864+0000","last_clean":"2024-03-08T20:29:29.695864+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:29:29.695864+0000","last_undegraded":"2024-03-08T20:29:29.695864+0000","last_fullsized":"2024-03-08T20:29:29.695864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327934+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:29:29.327934+0000","last_peered":"2024-03-08T20:29:29.327934+0000","last_clean":"2024-03-08T20:29:29.327934+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:29:29.327934+0000","last_undegraded":"2024-03-08T20:29:29.327934+0000","last_fullsized":"2024-03-08T20:29:29.327934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329741+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:29:29.329741+0000","last_peered":"2024-03-08T20:29:29.329741+0000","last_clean":"2024-03-08T20:29:29.329741+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:29:29.329741+0000","last_undegraded":"2024-03-08T20:29:29.329741+0000","last_fullsized":"2024-03-08T20:29:29.329741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695025+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:29:29.695025+0000","last_peered":"2024-03-08T20:29:29.695025+0000","last_clean":"2024-03-08T20:29:29.695025+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:29:29.695025+0000","last_undegraded":"2024-03-08T20:29:29.695025+0000","last_fullsized":"2024-03-08T20:29:29.695025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327560+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:29:29.327560+0000","last_peered":"2024-03-08T20:29:29.327560+0000","last_clean":"2024-03-08T20:29:29.327560+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:29:29.327560+0000","last_undegraded":"2024-03-08T20:29:29.327560+0000","last_fullsized":"2024-03-08T20:29:29.327560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328809+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:29:29.328809+0000","last_peered":"2024-03-08T20:29:29.328809+0000","last_clean":"2024-03-08T20:29:29.328809+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:29:29.328809+0000","last_undegraded":"2024-03-08T20:29:29.328809+0000","last_fullsized":"2024-03-08T20:29:29.328809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693380+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:29:29.693380+0000","last_peered":"2024-03-08T20:29:29.693380+0000","last_clean":"2024-03-08T20:29:29.693380+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:29:29.693380+0000","last_undegraded":"2024-03-08T20:29:29.693380+0000","last_fullsized":"2024-03-08T20:29:29.693380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694568+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:29:29.694568+0000","last_peered":"2024-03-08T20:29:29.694568+0000","last_clean":"2024-03-08T20:29:29.694568+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:29:29.694568+0000","last_undegraded":"2024-03-08T20:29:29.694568+0000","last_fullsized":"2024-03-08T20:29:29.694568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330807+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:29:29.330807+0000","last_peered":"2024-03-08T20:29:29.330807+0000","last_clean":"2024-03-08T20:29:29.330807+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:29:29.330807+0000","last_undegraded":"2024-03-08T20:29:29.330807+0000","last_fullsized":"2024-03-08T20:29:29.330807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323615+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:29:29.323615+0000","last_peered":"2024-03-08T20:29:29.323615+0000","last_clean":"2024-03-08T20:29:29.323615+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:29:29.323615+0000","last_undegraded":"2024-03-08T20:29:29.323615+0000","last_fullsized":"2024-03-08T20:29:29.323615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604207+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:29:29.604207+0000","last_peered":"2024-03-08T20:29:29.604207+0000","last_clean":"2024-03-08T20:29:29.604207+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:29:29.604207+0000","last_undegraded":"2024-03-08T20:29:29.604207+0000","last_fullsized":"2024-03-08T20:29:29.604207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329605+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:29:29.329605+0000","last_peered":"2024-03-08T20:29:29.329605+0000","last_clean":"2024-03-08T20:29:29.329605+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:29:29.329605+0000","last_undegraded":"2024-03-08T20:29:29.329605+0000","last_fullsized":"2024-03-08T20:29:29.329605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323007+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:29:29.323007+0000","last_peered":"2024-03-08T20:29:29.323007+0000","last_clean":"2024-03-08T20:29:29.323007+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:29:29.323007+0000","last_undegraded":"2024-03-08T20:29:29.323007+0000","last_fullsized":"2024-03-08T20:29:29.323007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603803+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:29:29.603803+0000","last_peered":"2024-03-08T20:29:29.603803+0000","last_clean":"2024-03-08T20:29:29.603803+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:29:29.603803+0000","last_undegraded":"2024-03-08T20:29:29.603803+0000","last_fullsized":"2024-03-08T20:29:29.603803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605139+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:29:29.605139+0000","last_peered":"2024-03-08T20:29:29.605139+0000","last_clean":"2024-03-08T20:29:29.605139+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:29:29.605139+0000","last_undegraded":"2024-03-08T20:29:29.605139+0000","last_fullsized":"2024-03-08T20:29:29.605139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327305+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:29:29.327305+0000","last_peered":"2024-03-08T20:29:29.327305+0000","last_clean":"2024-03-08T20:29:29.327305+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:29:29.327305+0000","last_undegraded":"2024-03-08T20:29:29.327305+0000","last_fullsized":"2024-03-08T20:29:29.327305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693787+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:29:29.693787+0000","last_peered":"2024-03-08T20:29:29.693787+0000","last_clean":"2024-03-08T20:29:29.693787+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:29:29.693787+0000","last_undegraded":"2024-03-08T20:29:29.693787+0000","last_fullsized":"2024-03-08T20:29:29.693787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330826+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:29:29.330826+0000","last_peered":"2024-03-08T20:29:29.330826+0000","last_clean":"2024-03-08T20:29:29.330826+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:29:29.330826+0000","last_undegraded":"2024-03-08T20:29:29.330826+0000","last_fullsized":"2024-03-08T20:29:29.330826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693630+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:29:29.693630+0000","last_peered":"2024-03-08T20:29:29.693630+0000","last_clean":"2024-03-08T20:29:29.693630+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:29:29.693630+0000","last_undegraded":"2024-03-08T20:29:29.693630+0000","last_fullsized":"2024-03-08T20:29:29.693630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697621+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:29:29.697621+0000","last_peered":"2024-03-08T20:29:29.697621+0000","last_clean":"2024-03-08T20:29:29.697621+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:29:29.697621+0000","last_undegraded":"2024-03-08T20:29:29.697621+0000","last_fullsized":"2024-03-08T20:29:29.697621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326730+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:29:29.326730+0000","last_peered":"2024-03-08T20:29:29.326730+0000","last_clean":"2024-03-08T20:29:29.326730+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:29:29.326730+0000","last_undegraded":"2024-03-08T20:29:29.326730+0000","last_fullsized":"2024-03-08T20:29:29.326730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325381+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:29:29.325381+0000","last_peered":"2024-03-08T20:29:29.325381+0000","last_clean":"2024-03-08T20:29:29.325381+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:29:29.325381+0000","last_undegraded":"2024-03-08T20:29:29.325381+0000","last_fullsized":"2024-03-08T20:29:29.325381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605003+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:29:29.605003+0000","last_peered":"2024-03-08T20:29:29.605003+0000","last_clean":"2024-03-08T20:29:29.605003+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:29:29.605003+0000","last_undegraded":"2024-03-08T20:29:29.605003+0000","last_fullsized":"2024-03-08T20:29:29.605003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322436+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.322436+0000","last_peered":"2024-03-08T20:29:29.322436+0000","last_clean":"2024-03-08T20:29:29.322436+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:29:29.322436+0000","last_undegraded":"2024-03-08T20:29:29.322436+0000","last_fullsized":"2024-03-08T20:29:29.322436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604521+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:29:29.604521+0000","last_peered":"2024-03-08T20:29:29.604521+0000","last_clean":"2024-03-08T20:29:29.604521+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:29:29.604521+0000","last_undegraded":"2024-03-08T20:29:29.604521+0000","last_fullsized":"2024-03-08T20:29:29.604521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696204+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:29:29.696204+0000","last_peered":"2024-03-08T20:29:29.696204+0000","last_clean":"2024-03-08T20:29:29.696204+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:29:29.696204+0000","last_undegraded":"2024-03-08T20:29:29.696204+0000","last_fullsized":"2024-03-08T20:29:29.696204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692264+0000","last_change":"2024-03-08T20:29:28.297105+0000","last_active":"2024-03-08T20:29:29.692264+0000","last_peered":"2024-03-08T20:29:29.692264+0000","last_clean":"2024-03-08T20:29:29.692264+0000","last_became_active":"2024-03-08T20:29:28.296730+0000","last_became_peered":"2024-03-08T20:29:28.296730+0000","last_unstale":"2024-03-08T20:29:29.692264+0000","last_undegraded":"2024-03-08T20:29:29.692264+0000","last_fullsized":"2024-03-08T20:29:29.692264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327764+0000","last_change":"2024-03-08T20:29:24.251656+0000","last_active":"2024-03-08T20:29:29.327764+0000","last_peered":"2024-03-08T20:29:29.327764+0000","last_clean":"2024-03-08T20:29:29.327764+0000","last_became_active":"2024-03-08T20:29:24.251207+0000","last_became_peered":"2024-03-08T20:29:24.251207+0000","last_unstale":"2024-03-08T20:29:29.327764+0000","last_undegraded":"2024-03-08T20:29:29.327764+0000","last_fullsized":"2024-03-08T20:29:29.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604653+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:29:29.604653+0000","last_peered":"2024-03-08T20:29:29.604653+0000","last_clean":"2024-03-08T20:29:29.604653+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:29:29.604653+0000","last_undegraded":"2024-03-08T20:29:29.604653+0000","last_fullsized":"2024-03-08T20:29:29.604653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604080+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:29:29.604080+0000","last_peered":"2024-03-08T20:29:29.604080+0000","last_clean":"2024-03-08T20:29:29.604080+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:29:29.604080+0000","last_undegraded":"2024-03-08T20:29:29.604080+0000","last_fullsized":"2024-03-08T20:29:29.604080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330165+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:29:29.330165+0000","last_peered":"2024-03-08T20:29:29.330165+0000","last_clean":"2024-03-08T20:29:29.330165+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:29:29.330165+0000","last_undegraded":"2024-03-08T20:29:29.330165+0000","last_fullsized":"2024-03-08T20:29:29.330165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327392+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:29:29.327392+0000","last_peered":"2024-03-08T20:29:29.327392+0000","last_clean":"2024-03-08T20:29:29.327392+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:29:29.327392+0000","last_undegraded":"2024-03-08T20:29:29.327392+0000","last_fullsized":"2024-03-08T20:29:29.327392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604568+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:29:29.604568+0000","last_peered":"2024-03-08T20:29:29.604568+0000","last_clean":"2024-03-08T20:29:29.604568+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:29:29.604568+0000","last_undegraded":"2024-03-08T20:29:29.604568+0000","last_fullsized":"2024-03-08T20:29:29.604568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603861+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:29:29.603861+0000","last_peered":"2024-03-08T20:29:29.603861+0000","last_clean":"2024-03-08T20:29:29.603861+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:29:29.603861+0000","last_undegraded":"2024-03-08T20:29:29.603861+0000","last_fullsized":"2024-03-08T20:29:29.603861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629162+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:29:29.629162+0000","last_peered":"2024-03-08T20:29:29.629162+0000","last_clean":"2024-03-08T20:29:29.629162+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:29:29.629162+0000","last_undegraded":"2024-03-08T20:29:29.629162+0000","last_fullsized":"2024-03-08T20:29:29.629162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605161+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:29:29.605161+0000","last_peered":"2024-03-08T20:29:29.605161+0000","last_clean":"2024-03-08T20:29:29.605161+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:29:29.605161+0000","last_undegraded":"2024-03-08T20:29:29.605161+0000","last_fullsized":"2024-03-08T20:29:29.605161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.691864+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:29:29.691864+0000","last_peered":"2024-03-08T20:29:29.691864+0000","last_clean":"2024-03-08T20:29:29.691864+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:29:29.691864+0000","last_undegraded":"2024-03-08T20:29:29.691864+0000","last_fullsized":"2024-03-08T20:29:29.691864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694114+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:29:29.694114+0000","last_peered":"2024-03-08T20:29:29.694114+0000","last_clean":"2024-03-08T20:29:29.694114+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:29:29.694114+0000","last_undegraded":"2024-03-08T20:29:29.694114+0000","last_fullsized":"2024-03-08T20:29:29.694114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693453+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:29:29.693453+0000","last_peered":"2024-03-08T20:29:29.693453+0000","last_clean":"2024-03-08T20:29:29.693453+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:29:29.693453+0000","last_undegraded":"2024-03-08T20:29:29.693453+0000","last_fullsized":"2024-03-08T20:29:29.693453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323324+0000","last_change":"2024-03-08T20:29:24.260255+0000","last_active":"2024-03-08T20:29:29.323324+0000","last_peered":"2024-03-08T20:29:29.323324+0000","last_clean":"2024-03-08T20:29:29.323324+0000","last_became_active":"2024-03-08T20:29:24.259145+0000","last_became_peered":"2024-03-08T20:29:24.259145+0000","last_unstale":"2024-03-08T20:29:29.323324+0000","last_undegraded":"2024-03-08T20:29:29.323324+0000","last_fullsized":"2024-03-08T20:29:29.323324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325886+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:29:29.325886+0000","last_peered":"2024-03-08T20:29:29.325886+0000","last_clean":"2024-03-08T20:29:29.325886+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:29:29.325886+0000","last_undegraded":"2024-03-08T20:29:29.325886+0000","last_fullsized":"2024-03-08T20:29:29.325886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694395+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:29:29.694395+0000","last_peered":"2024-03-08T20:29:29.694395+0000","last_clean":"2024-03-08T20:29:29.694395+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:29:29.694395+0000","last_undegraded":"2024-03-08T20:29:29.694395+0000","last_fullsized":"2024-03-08T20:29:29.694395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:29:29.695250+0000","last_peered":"2024-03-08T20:29:29.695250+0000","last_clean":"2024-03-08T20:29:29.695250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:29:29.695250+0000","last_undegraded":"2024-03-08T20:29:29.695250+0000","last_fullsized":"2024-03-08T20:29:29.695250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695382+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:29:29.695382+0000","last_peered":"2024-03-08T20:29:29.695382+0000","last_clean":"2024-03-08T20:29:29.695382+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:29:29.695382+0000","last_undegraded":"2024-03-08T20:29:29.695382+0000","last_fullsized":"2024-03-08T20:29:29.695382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629459+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:29:29.629459+0000","last_peered":"2024-03-08T20:29:29.629459+0000","last_clean":"2024-03-08T20:29:29.629459+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:29:29.629459+0000","last_undegraded":"2024-03-08T20:29:29.629459+0000","last_fullsized":"2024-03-08T20:29:29.629459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694813+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:29:29.694813+0000","last_peered":"2024-03-08T20:29:29.694813+0000","last_clean":"2024-03-08T20:29:29.694813+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:29:29.694813+0000","last_undegraded":"2024-03-08T20:29:29.694813+0000","last_fullsized":"2024-03-08T20:29:29.694813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328751+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:29:29.328751+0000","last_peered":"2024-03-08T20:29:29.328751+0000","last_clean":"2024-03-08T20:29:29.328751+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:29:29.328751+0000","last_undegraded":"2024-03-08T20:29:29.328751+0000","last_fullsized":"2024-03-08T20:29:29.328751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604775+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:29:29.604775+0000","last_peered":"2024-03-08T20:29:29.604775+0000","last_clean":"2024-03-08T20:29:29.604775+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:29:29.604775+0000","last_undegraded":"2024-03-08T20:29:29.604775+0000","last_fullsized":"2024-03-08T20:29:29.604775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692533+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:29:29.692533+0000","last_peered":"2024-03-08T20:29:29.692533+0000","last_clean":"2024-03-08T20:29:29.692533+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:29:29.692533+0000","last_undegraded":"2024-03-08T20:29:29.692533+0000","last_fullsized":"2024-03-08T20:29:29.692533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696871+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:29:29.696871+0000","last_peered":"2024-03-08T20:29:29.696871+0000","last_clean":"2024-03-08T20:29:29.696871+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:29:29.696871+0000","last_undegraded":"2024-03-08T20:29:29.696871+0000","last_fullsized":"2024-03-08T20:29:29.696871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629717+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:29:29.629717+0000","last_peered":"2024-03-08T20:29:29.629717+0000","last_clean":"2024-03-08T20:29:29.629717+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:29:29.629717+0000","last_undegraded":"2024-03-08T20:29:29.629717+0000","last_fullsized":"2024-03-08T20:29:29.629717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328240+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.328240+0000","last_peered":"2024-03-08T20:29:29.328240+0000","last_clean":"2024-03-08T20:29:29.328240+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:29:29.328240+0000","last_undegraded":"2024-03-08T20:29:29.328240+0000","last_fullsized":"2024-03-08T20:29:29.328240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696081+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:29:29.696081+0000","last_peered":"2024-03-08T20:29:29.696081+0000","last_clean":"2024-03-08T20:29:29.696081+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:29:29.696081+0000","last_undegraded":"2024-03-08T20:29:29.696081+0000","last_fullsized":"2024-03-08T20:29:29.696081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.331585+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:29:29.331585+0000","last_peered":"2024-03-08T20:29:29.331585+0000","last_clean":"2024-03-08T20:29:29.331585+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:29:29.331585+0000","last_undegraded":"2024-03-08T20:29:29.331585+0000","last_fullsized":"2024-03-08T20:29:29.331585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326308+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:29:29.326308+0000","last_peered":"2024-03-08T20:29:29.326308+0000","last_clean":"2024-03-08T20:29:29.326308+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:29:29.326308+0000","last_undegraded":"2024-03-08T20:29:29.326308+0000","last_fullsized":"2024-03-08T20:29:29.326308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694312+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:29:29.694312+0000","last_peered":"2024-03-08T20:29:29.694312+0000","last_clean":"2024-03-08T20:29:29.694312+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:29:29.694312+0000","last_undegraded":"2024-03-08T20:29:29.694312+0000","last_fullsized":"2024-03-08T20:29:29.694312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.628871+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:29:29.628871+0000","last_peered":"2024-03-08T20:29:29.628871+0000","last_clean":"2024-03-08T20:29:29.628871+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:29:29.628871+0000","last_undegraded":"2024-03-08T20:29:29.628871+0000","last_fullsized":"2024-03-08T20:29:29.628871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693296+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:29:29.693296+0000","last_peered":"2024-03-08T20:29:29.693296+0000","last_clean":"2024-03-08T20:29:29.693296+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:29:29.693296+0000","last_undegraded":"2024-03-08T20:29:29.693296+0000","last_fullsized":"2024-03-08T20:29:29.693296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693106+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:29:29.693106+0000","last_peered":"2024-03-08T20:29:29.693106+0000","last_clean":"2024-03-08T20:29:29.693106+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:29:29.693106+0000","last_undegraded":"2024-03-08T20:29:29.693106+0000","last_fullsized":"2024-03-08T20:29:29.693106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693542+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:29:29.693542+0000","last_peered":"2024-03-08T20:29:29.693542+0000","last_clean":"2024-03-08T20:29:29.693542+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:29:29.693542+0000","last_undegraded":"2024-03-08T20:29:29.693542+0000","last_fullsized":"2024-03-08T20:29:29.693542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325186+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:29:29.325186+0000","last_peered":"2024-03-08T20:29:29.325186+0000","last_clean":"2024-03-08T20:29:29.325186+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:29:29.325186+0000","last_undegraded":"2024-03-08T20:29:29.325186+0000","last_fullsized":"2024-03-08T20:29:29.325186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694546+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:29:29.694546+0000","last_peered":"2024-03-08T20:29:29.694546+0000","last_clean":"2024-03-08T20:29:29.694546+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:29:29.694546+0000","last_undegraded":"2024-03-08T20:29:29.694546+0000","last_fullsized":"2024-03-08T20:29:29.694546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327131+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:29:29.327131+0000","last_peered":"2024-03-08T20:29:29.327131+0000","last_clean":"2024-03-08T20:29:29.327131+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:29:29.327131+0000","last_undegraded":"2024-03-08T20:29:29.327131+0000","last_fullsized":"2024-03-08T20:29:29.327131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324284+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:29:29.324284+0000","last_peered":"2024-03-08T20:29:29.324284+0000","last_clean":"2024-03-08T20:29:29.324284+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:29:29.324284+0000","last_undegraded":"2024-03-08T20:29:29.324284+0000","last_fullsized":"2024-03-08T20:29:29.324284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692438+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692438+0000","last_peered":"2024-03-08T20:29:29.692438+0000","last_clean":"2024-03-08T20:29:29.692438+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:29:29.692438+0000","last_undegraded":"2024-03-08T20:29:29.692438+0000","last_fullsized":"2024-03-08T20:29:29.692438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692729+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:29:29.692729+0000","last_peered":"2024-03-08T20:29:29.692729+0000","last_clean":"2024-03-08T20:29:29.692729+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:29:29.692729+0000","last_undegraded":"2024-03-08T20:29:29.692729+0000","last_fullsized":"2024-03-08T20:29:29.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327436+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:29:29.327436+0000","last_peered":"2024-03-08T20:29:29.327436+0000","last_clean":"2024-03-08T20:29:29.327436+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:29:29.327436+0000","last_undegraded":"2024-03-08T20:29:29.327436+0000","last_fullsized":"2024-03-08T20:29:29.327436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695853+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:29:29.695853+0000","last_peered":"2024-03-08T20:29:29.695853+0000","last_clean":"2024-03-08T20:29:29.695853+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:29:29.695853+0000","last_undegraded":"2024-03-08T20:29:29.695853+0000","last_fullsized":"2024-03-08T20:29:29.695853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:42.977992+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:29:42.977992+0000","last_peered":"2024-03-08T20:29:42.977992+0000","last_clean":"2024-03-08T20:29:42.977992+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:29:42.977992+0000","last_undegraded":"2024-03-08T20:29:42.977992+0000","last_fullsized":"2024-03-08T20:29:42.977992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604126+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:29:29.604126+0000","last_peered":"2024-03-08T20:29:29.604126+0000","last_clean":"2024-03-08T20:29:29.604126+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:29:29.604126+0000","last_undegraded":"2024-03-08T20:29:29.604126+0000","last_fullsized":"2024-03-08T20:29:29.604126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330303+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:29:29.330303+0000","last_peered":"2024-03-08T20:29:29.330303+0000","last_clean":"2024-03-08T20:29:29.330303+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:29:29.330303+0000","last_undegraded":"2024-03-08T20:29:29.330303+0000","last_fullsized":"2024-03-08T20:29:29.330303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604749+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:29:29.604749+0000","last_peered":"2024-03-08T20:29:29.604749+0000","last_clean":"2024-03-08T20:29:29.604749+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:29:29.604749+0000","last_undegraded":"2024-03-08T20:29:29.604749+0000","last_fullsized":"2024-03-08T20:29:29.604749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329992+0000","last_change":"2024-03-08T20:29:28.284054+0000","last_active":"2024-03-08T20:29:29.329992+0000","last_peered":"2024-03-08T20:29:29.329992+0000","last_clean":"2024-03-08T20:29:29.329992+0000","last_became_active":"2024-03-08T20:29:28.282361+0000","last_became_peered":"2024-03-08T20:29:28.282361+0000","last_unstale":"2024-03-08T20:29:29.329992+0000","last_undegraded":"2024-03-08T20:29:29.329992+0000","last_fullsized":"2024-03-08T20:29:29.329992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693127+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:29:29.693127+0000","last_peered":"2024-03-08T20:29:29.693127+0000","last_clean":"2024-03-08T20:29:29.693127+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:29:29.693127+0000","last_undegraded":"2024-03-08T20:29:29.693127+0000","last_fullsized":"2024-03-08T20:29:29.693127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328317+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:29:29.328317+0000","last_peered":"2024-03-08T20:29:29.328317+0000","last_clean":"2024-03-08T20:29:29.328317+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:29:29.328317+0000","last_undegraded":"2024-03-08T20:29:29.328317+0000","last_fullsized":"2024-03-08T20:29:29.328317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322805+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:29:29.322805+0000","last_peered":"2024-03-08T20:29:29.322805+0000","last_clean":"2024-03-08T20:29:29.322805+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:29:29.322805+0000","last_undegraded":"2024-03-08T20:29:29.322805+0000","last_fullsized":"2024-03-08T20:29:29.322805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328142+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:29:29.328142+0000","last_peered":"2024-03-08T20:29:29.328142+0000","last_clean":"2024-03-08T20:29:29.328142+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:29:29.328142+0000","last_undegraded":"2024-03-08T20:29:29.328142+0000","last_fullsized":"2024-03-08T20:29:29.328142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697363+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:29:29.697363+0000","last_peered":"2024-03-08T20:29:29.697363+0000","last_clean":"2024-03-08T20:29:29.697363+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:29:29.697363+0000","last_undegraded":"2024-03-08T20:29:29.697363+0000","last_fullsized":"2024-03-08T20:29:29.697363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322850+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:29:29.322850+0000","last_peered":"2024-03-08T20:29:29.322850+0000","last_clean":"2024-03-08T20:29:29.322850+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:29:29.322850+0000","last_undegraded":"2024-03-08T20:29:29.322850+0000","last_fullsized":"2024-03-08T20:29:29.322850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692999+0000","last_change":"2024-03-08T20:29:28.304811+0000","last_active":"2024-03-08T20:29:29.692999+0000","last_peered":"2024-03-08T20:29:29.692999+0000","last_clean":"2024-03-08T20:29:29.692999+0000","last_became_active":"2024-03-08T20:29:28.304218+0000","last_became_peered":"2024-03-08T20:29:28.304218+0000","last_unstale":"2024-03-08T20:29:29.692999+0000","last_undegraded":"2024-03-08T20:29:29.692999+0000","last_fullsized":"2024-03-08T20:29:29.692999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603670+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:29:29.603670+0000","last_peered":"2024-03-08T20:29:29.603670+0000","last_clean":"2024-03-08T20:29:29.603670+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:29:29.603670+0000","last_undegraded":"2024-03-08T20:29:29.603670+0000","last_fullsized":"2024-03-08T20:29:29.603670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325365+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:29:29.325365+0000","last_peered":"2024-03-08T20:29:29.325365+0000","last_clean":"2024-03-08T20:29:29.325365+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:29:29.325365+0000","last_undegraded":"2024-03-08T20:29:29.325365+0000","last_fullsized":"2024-03-08T20:29:29.325365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697547+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:29:29.697547+0000","last_peered":"2024-03-08T20:29:29.697547+0000","last_clean":"2024-03-08T20:29:29.697547+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:29:29.697547+0000","last_undegraded":"2024-03-08T20:29:29.697547+0000","last_fullsized":"2024-03-08T20:29:29.697547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322791+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:29:29.322791+0000","last_peered":"2024-03-08T20:29:29.322791+0000","last_clean":"2024-03-08T20:29:29.322791+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:29:29.322791+0000","last_undegraded":"2024-03-08T20:29:29.322791+0000","last_fullsized":"2024-03-08T20:29:29.322791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323271+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:29:29.323271+0000","last_peered":"2024-03-08T20:29:29.323271+0000","last_clean":"2024-03-08T20:29:29.323271+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:29:29.323271+0000","last_undegraded":"2024-03-08T20:29:29.323271+0000","last_fullsized":"2024-03-08T20:29:29.323271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695741+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:29:29.695741+0000","last_peered":"2024-03-08T20:29:29.695741+0000","last_clean":"2024-03-08T20:29:29.695741+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:29:29.695741+0000","last_undegraded":"2024-03-08T20:29:29.695741+0000","last_fullsized":"2024-03-08T20:29:29.695741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692624+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:29:29.692624+0000","last_peered":"2024-03-08T20:29:29.692624+0000","last_clean":"2024-03-08T20:29:29.692624+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:29:29.692624+0000","last_undegraded":"2024-03-08T20:29:29.692624+0000","last_fullsized":"2024-03-08T20:29:29.692624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629301+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:29:29.629301+0000","last_peered":"2024-03-08T20:29:29.629301+0000","last_clean":"2024-03-08T20:29:29.629301+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:29:29.629301+0000","last_undegraded":"2024-03-08T20:29:29.629301+0000","last_fullsized":"2024-03-08T20:29:29.629301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323851+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:29:29.323851+0000","last_peered":"2024-03-08T20:29:29.323851+0000","last_clean":"2024-03-08T20:29:29.323851+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:29:29.323851+0000","last_undegraded":"2024-03-08T20:29:29.323851+0000","last_fullsized":"2024-03-08T20:29:29.323851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329117+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:29:29.329117+0000","last_peered":"2024-03-08T20:29:29.329117+0000","last_clean":"2024-03-08T20:29:29.329117+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:29:29.329117+0000","last_undegraded":"2024-03-08T20:29:29.329117+0000","last_fullsized":"2024-03-08T20:29:29.329117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324482+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:29:29.324482+0000","last_peered":"2024-03-08T20:29:29.324482+0000","last_clean":"2024-03-08T20:29:29.324482+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:29:29.324482+0000","last_undegraded":"2024-03-08T20:29:29.324482+0000","last_fullsized":"2024-03-08T20:29:29.324482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692905+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:29:29.692905+0000","last_peered":"2024-03-08T20:29:29.692905+0000","last_clean":"2024-03-08T20:29:29.692905+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:29:29.692905+0000","last_undegraded":"2024-03-08T20:29:29.692905+0000","last_fullsized":"2024-03-08T20:29:29.692905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629275+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:29:29.629275+0000","last_peered":"2024-03-08T20:29:29.629275+0000","last_clean":"2024-03-08T20:29:29.629275+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:29:29.629275+0000","last_undegraded":"2024-03-08T20:29:29.629275+0000","last_fullsized":"2024-03-08T20:29:29.629275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326896+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:29:29.326896+0000","last_peered":"2024-03-08T20:29:29.326896+0000","last_clean":"2024-03-08T20:29:29.326896+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:29:29.326896+0000","last_undegraded":"2024-03-08T20:29:29.326896+0000","last_fullsized":"2024-03-08T20:29:29.326896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692632+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:29:29.692632+0000","last_peered":"2024-03-08T20:29:29.692632+0000","last_clean":"2024-03-08T20:29:29.692632+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:29:29.692632+0000","last_undegraded":"2024-03-08T20:29:29.692632+0000","last_fullsized":"2024-03-08T20:29:29.692632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324493+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:29:29.324493+0000","last_peered":"2024-03-08T20:29:29.324493+0000","last_clean":"2024-03-08T20:29:29.324493+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:29:29.324493+0000","last_undegraded":"2024-03-08T20:29:29.324493+0000","last_fullsized":"2024-03-08T20:29:29.324493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604628+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:29:29.604628+0000","last_peered":"2024-03-08T20:29:29.604628+0000","last_clean":"2024-03-08T20:29:29.604628+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:29:29.604628+0000","last_undegraded":"2024-03-08T20:29:29.604628+0000","last_fullsized":"2024-03-08T20:29:29.604628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696589+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:29:29.696589+0000","last_peered":"2024-03-08T20:29:29.696589+0000","last_clean":"2024-03-08T20:29:29.696589+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:29:29.696589+0000","last_undegraded":"2024-03-08T20:29:29.696589+0000","last_fullsized":"2024-03-08T20:29:29.696589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325184+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:29:29.325184+0000","last_peered":"2024-03-08T20:29:29.325184+0000","last_clean":"2024-03-08T20:29:29.325184+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:29:29.325184+0000","last_undegraded":"2024-03-08T20:29:29.325184+0000","last_fullsized":"2024-03-08T20:29:29.325184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325117+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:29:29.325117+0000","last_peered":"2024-03-08T20:29:29.325117+0000","last_clean":"2024-03-08T20:29:29.325117+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:29:29.325117+0000","last_undegraded":"2024-03-08T20:29:29.325117+0000","last_fullsized":"2024-03-08T20:29:29.325117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323214+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:29:29.323214+0000","last_peered":"2024-03-08T20:29:29.323214+0000","last_clean":"2024-03-08T20:29:29.323214+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:29:29.323214+0000","last_undegraded":"2024-03-08T20:29:29.323214+0000","last_fullsized":"2024-03-08T20:29:29.323214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326675+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:29:29.326675+0000","last_peered":"2024-03-08T20:29:29.326675+0000","last_clean":"2024-03-08T20:29:29.326675+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:29:29.326675+0000","last_undegraded":"2024-03-08T20:29:29.326675+0000","last_fullsized":"2024-03-08T20:29:29.326675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692321+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692321+0000","last_peered":"2024-03-08T20:29:29.692321+0000","last_clean":"2024-03-08T20:29:29.692321+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:29:29.692321+0000","last_undegraded":"2024-03-08T20:29:29.692321+0000","last_fullsized":"2024-03-08T20:29:29.692321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695239+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:29:29.695239+0000","last_peered":"2024-03-08T20:29:29.695239+0000","last_clean":"2024-03-08T20:29:29.695239+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:29:29.695239+0000","last_undegraded":"2024-03-08T20:29:29.695239+0000","last_fullsized":"2024-03-08T20:29:29.695239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696160+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:29:29.696160+0000","last_peered":"2024-03-08T20:29:29.696160+0000","last_clean":"2024-03-08T20:29:29.696160+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:29:29.696160+0000","last_undegraded":"2024-03-08T20:29:29.696160+0000","last_fullsized":"2024-03-08T20:29:29.696160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629573+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:29:29.629573+0000","last_peered":"2024-03-08T20:29:29.629573+0000","last_clean":"2024-03-08T20:29:29.629573+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:29:29.629573+0000","last_undegraded":"2024-03-08T20:29:29.629573+0000","last_fullsized":"2024-03-08T20:29:29.629573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328419+0000","last_change":"2024-03-08T20:29:24.269658+0000","last_active":"2024-03-08T20:29:29.328419+0000","last_peered":"2024-03-08T20:29:29.328419+0000","last_clean":"2024-03-08T20:29:29.328419+0000","last_became_active":"2024-03-08T20:29:24.268813+0000","last_became_peered":"2024-03-08T20:29:24.268813+0000","last_unstale":"2024-03-08T20:29:29.328419+0000","last_undegraded":"2024-03-08T20:29:29.328419+0000","last_fullsized":"2024-03-08T20:29:29.328419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324804+0000","last_change":"2024-03-08T20:29:24.244300+0000","last_active":"2024-03-08T20:29:29.324804+0000","last_peered":"2024-03-08T20:29:29.324804+0000","last_clean":"2024-03-08T20:29:29.324804+0000","last_became_active":"2024-03-08T20:29:24.243929+0000","last_became_peered":"2024-03-08T20:29:24.243929+0000","last_unstale":"2024-03-08T20:29:29.324804+0000","last_undegraded":"2024-03-08T20:29:29.324804+0000","last_fullsized":"2024-03-08T20:29:29.324804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603720+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:29:29.603720+0000","last_peered":"2024-03-08T20:29:29.603720+0000","last_clean":"2024-03-08T20:29:29.603720+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:29:29.603720+0000","last_undegraded":"2024-03-08T20:29:29.603720+0000","last_fullsized":"2024-03-08T20:29:29.603720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692350+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:29:29.692350+0000","last_peered":"2024-03-08T20:29:29.692350+0000","last_clean":"2024-03-08T20:29:29.692350+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:29:29.692350+0000","last_undegraded":"2024-03-08T20:29:29.692350+0000","last_fullsized":"2024-03-08T20:29:29.692350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323559+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:29:29.323559+0000","last_peered":"2024-03-08T20:29:29.323559+0000","last_clean":"2024-03-08T20:29:29.323559+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:29:29.323559+0000","last_undegraded":"2024-03-08T20:29:29.323559+0000","last_fullsized":"2024-03-08T20:29:29.323559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330666+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:29:29.330666+0000","last_peered":"2024-03-08T20:29:29.330666+0000","last_clean":"2024-03-08T20:29:29.330666+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:29:29.330666+0000","last_undegraded":"2024-03-08T20:29:29.330666+0000","last_fullsized":"2024-03-08T20:29:29.330666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695621+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:29:29.695621+0000","last_peered":"2024-03-08T20:29:29.695621+0000","last_clean":"2024-03-08T20:29:29.695621+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:29:29.695621+0000","last_undegraded":"2024-03-08T20:29:29.695621+0000","last_fullsized":"2024-03-08T20:29:29.695621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696357+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:29:29.696357+0000","last_peered":"2024-03-08T20:29:29.696357+0000","last_clean":"2024-03-08T20:29:29.696357+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:29:29.696357+0000","last_undegraded":"2024-03-08T20:29:29.696357+0000","last_fullsized":"2024-03-08T20:29:29.696357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696755+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:29:29.696755+0000","last_peered":"2024-03-08T20:29:29.696755+0000","last_clean":"2024-03-08T20:29:29.696755+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:29:29.696755+0000","last_undegraded":"2024-03-08T20:29:29.696755+0000","last_fullsized":"2024-03-08T20:29:29.696755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322453+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:29:29.322453+0000","last_peered":"2024-03-08T20:29:29.322453+0000","last_clean":"2024-03-08T20:29:29.322453+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:29:29.322453+0000","last_undegraded":"2024-03-08T20:29:29.322453+0000","last_fullsized":"2024-03-08T20:29:29.322453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694028+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:29:29.694028+0000","last_peered":"2024-03-08T20:29:29.694028+0000","last_clean":"2024-03-08T20:29:29.694028+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:29:29.694028+0000","last_undegraded":"2024-03-08T20:29:29.694028+0000","last_fullsized":"2024-03-08T20:29:29.694028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326448+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:29:29.326448+0000","last_peered":"2024-03-08T20:29:29.326448+0000","last_clean":"2024-03-08T20:29:29.326448+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:29:29.326448+0000","last_undegraded":"2024-03-08T20:29:29.326448+0000","last_fullsized":"2024-03-08T20:29:29.326448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694256+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:29:29.694256+0000","last_peered":"2024-03-08T20:29:29.694256+0000","last_clean":"2024-03-08T20:29:29.694256+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:29:29.694256+0000","last_undegraded":"2024-03-08T20:29:29.694256+0000","last_fullsized":"2024-03-08T20:29:29.694256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327678+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:29:29.327678+0000","last_peered":"2024-03-08T20:29:29.327678+0000","last_clean":"2024-03-08T20:29:29.327678+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:29:29.327678+0000","last_undegraded":"2024-03-08T20:29:29.327678+0000","last_fullsized":"2024-03-08T20:29:29.327678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692705+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:29:29.692705+0000","last_peered":"2024-03-08T20:29:29.692705+0000","last_clean":"2024-03-08T20:29:29.692705+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:29:29.692705+0000","last_undegraded":"2024-03-08T20:29:29.692705+0000","last_fullsized":"2024-03-08T20:29:29.692705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605002+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:29:29.605002+0000","last_peered":"2024-03-08T20:29:29.605002+0000","last_clean":"2024-03-08T20:29:29.605002+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:29:29.605002+0000","last_undegraded":"2024-03-08T20:29:29.605002+0000","last_fullsized":"2024-03-08T20:29:29.605002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696518+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:29:29.696518+0000","last_peered":"2024-03-08T20:29:29.696518+0000","last_clean":"2024-03-08T20:29:29.696518+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:29:29.696518+0000","last_undegraded":"2024-03-08T20:29:29.696518+0000","last_fullsized":"2024-03-08T20:29:29.696518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:29:47.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:29:48.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.080+0000 7f820c800640 1 Processor -- start 2024-03-08T20:29:48.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.080+0000 7f820c800640 1 -- start start 2024-03-08T20:29:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.081+0000 7f820c800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f820414fed0 0x7f8204150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.081+0000 7f820c800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040aa980 con 0x7f8204152e10 2024-03-08T20:29:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.081+0000 7f820c800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040aac60 con 0x7f820406af80 2024-03-08T20:29:48.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.081+0000 7f820c800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8204150870 con 0x7f820414fed0 2024-03-08T20:29:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f8209400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f820414fed0 0x7f8204150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f820a800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8204152e10 0x7f82041532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47894/0 (socket says 172.21.15.118:47894) 2024-03-08T20:29:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f820a800640 1 -- 172.21.15.118:0/2779421901 learned_addr learned my addr 172.21.15.118:0/2779421901 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:48.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f8209400640 1 -- 172.21.15.118:0/2779421901 >> v1:172.21.15.144:6789/0 conn(0x7f820406af80 legacy=0x7f820406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f8209400640 1 -- 172.21.15.118:0/2779421901 >> v1:172.21.15.118:6789/0 conn(0x7f8204152e10 legacy=0x7f82041532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.082+0000 7f8209400640 1 -- 172.21.15.118:0/2779421901 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82040aaf40 con 0x7f820414fed0 2024-03-08T20:29:48.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.083+0000 7f8209400640 1 --2- 172.21.15.118:0/2779421901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820414fed0 0x7f8204150330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81f40097a0 tx=0x7f81f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0aae18302da08c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.084+0000 7f8208a00640 1 -- 172.21.15.118:0/2779421901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4035020 con 0x7f820414fed0 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.084+0000 7f8208a00640 1 -- 172.21.15.118:0/2779421901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4031830 con 0x7f820414fed0 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.084+0000 7f8208a00640 1 -- 172.21.15.118:0/2779421901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4031c00 con 0x7f820414fed0 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.084+0000 7f820c800640 1 -- 172.21.15.118:0/2779421901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820414fed0 msgr2=0x7f8204150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.084+0000 7f820c800640 1 --2- 172.21.15.118:0/2779421901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820414fed0 0x7f8204150330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81f40097a0 tx=0x7f81f402b8d0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.085+0000 7f820c800640 1 -- 172.21.15.118:0/2779421901 shutdown_connections 2024-03-08T20:29:48.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.085+0000 7f820c800640 1 --2- 172.21.15.118:0/2779421901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820414fed0 0x7f8204150330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.085+0000 7f820c800640 1 -- 172.21.15.118:0/2779421901 >> 172.21.15.118:0/2779421901 conn(0x7f82040a84c0 msgr2=0x7f82040a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.085+0000 7f820c800640 1 -- 172.21.15.118:0/2779421901 shutdown_connections 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.085+0000 7f820c800640 1 -- 172.21.15.118:0/2779421901 wait complete. 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.086+0000 7f820c800640 1 Processor -- start 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.086+0000 7f820c800640 1 -- start start 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f820414fed0 0x7f8204142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8204152e10 0x7f820414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c3e10 con 0x7f820406af80 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82041539b0 con 0x7f820414fed0 2024-03-08T20:29:48.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f820c800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c3f90 con 0x7f8204152e10 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.087+0000 7f8209e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59312/0 (socket says 172.21.15.118:59312) 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 -- 172.21.15.118:0/3670861745 learned_addr learned my addr 172.21.15.118:0/3670861745 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 -- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8204152e10 msgr2=0x7f820414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8204152e10 0x7f820414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 -- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f820414fed0 msgr2=0x7f8204142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f820414fed0 0x7f8204142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 -- 172.21.15.118:0/3670861745 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82041421b0 con 0x7f820406af80 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f8209e00640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c430 tx=0x7f81f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80052d0 con 0x7f820406af80 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8005490 con 0x7f820406af80 2024-03-08T20:29:48.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82041e9360 con 0x7f820406af80 2024-03-08T20:29:48.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.088+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8007260 con 0x7f820406af80 2024-03-08T20:29:48.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.089+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820414f700 con 0x7f820406af80 2024-03-08T20:29:48.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.090+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820414d470 con 0x7f820406af80 2024-03-08T20:29:48.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.091+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f81f8007400 con 0x7f820406af80 2024-03-08T20:29:48.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.091+0000 7f81fe000640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 0x7f81e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.092+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f81f808a260 con 0x7f820406af80 2024-03-08T20:29:48.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.092+0000 7f8209400640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 0x7f81e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.092+0000 7f8209400640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 0x7f81e806e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81f4036000 tx=0x7f81f4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.096+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f820414d470 con 0x7f820406af80 2024-03-08T20:29:48.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.290+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f820414c8e0 con 0x7f81e806bbd0 2024-03-08T20:29:48.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.302+0000 7f81fe000640 1 -- 172.21.15.118:0/3670861745 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332651 (secure 0 0 0) 0x7f820414c8e0 con 0x7f81e806bbd0 2024-03-08T20:29:48.306 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:48.308 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:29:48.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 msgr2=0x7f81e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 0x7f81e806e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81f4036000 tx=0x7f81f4030000 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 msgr2=0x7f82040c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c430 tx=0x7f81f800c8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 shutdown_connections 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f81e806bbd0 0x7f81e806e090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8204152e10 0x7f820414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f820414fed0 0x7f8204142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 --2- 172.21.15.118:0/3670861745 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f820406af80 0x7f82040c4260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 >> 172.21.15.118:0/3670861745 conn(0x7f82040a84c0 msgr2=0x7f82040a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 shutdown_connections 2024-03-08T20:29:48.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.308+0000 7f820c800640 1 -- 172.21.15.118:0/3670861745 wait complete. 2024-03-08T20:29:48.325 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-08T20:29:47.520992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222588,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752132,"statfs":{"total":773094113280,"available":772866183168,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004203"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693297+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:29:29.693297+0000","last_peered":"2024-03-08T20:29:29.693297+0000","last_clean":"2024-03-08T20:29:29.693297+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:29:29.693297+0000","last_undegraded":"2024-03-08T20:29:29.693297+0000","last_fullsized":"2024-03-08T20:29:29.693297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324902+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:29:29.324902+0000","last_peered":"2024-03-08T20:29:29.324902+0000","last_clean":"2024-03-08T20:29:29.324902+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:29:29.324902+0000","last_undegraded":"2024-03-08T20:29:29.324902+0000","last_fullsized":"2024-03-08T20:29:29.324902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323005+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:29:29.323005+0000","last_peered":"2024-03-08T20:29:29.323005+0000","last_clean":"2024-03-08T20:29:29.323005+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:29:29.323005+0000","last_undegraded":"2024-03-08T20:29:29.323005+0000","last_fullsized":"2024-03-08T20:29:29.323005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324958+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:29:29.324958+0000","last_peered":"2024-03-08T20:29:29.324958+0000","last_clean":"2024-03-08T20:29:29.324958+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:29:29.324958+0000","last_undegraded":"2024-03-08T20:29:29.324958+0000","last_fullsized":"2024-03-08T20:29:29.324958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693020+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:29:29.693020+0000","last_peered":"2024-03-08T20:29:29.693020+0000","last_clean":"2024-03-08T20:29:29.693020+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:29:29.693020+0000","last_undegraded":"2024-03-08T20:29:29.693020+0000","last_fullsized":"2024-03-08T20:29:29.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326542+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:29:29.326542+0000","last_peered":"2024-03-08T20:29:29.326542+0000","last_clean":"2024-03-08T20:29:29.326542+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:29:29.326542+0000","last_undegraded":"2024-03-08T20:29:29.326542+0000","last_fullsized":"2024-03-08T20:29:29.326542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695864+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:29:29.695864+0000","last_peered":"2024-03-08T20:29:29.695864+0000","last_clean":"2024-03-08T20:29:29.695864+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:29:29.695864+0000","last_undegraded":"2024-03-08T20:29:29.695864+0000","last_fullsized":"2024-03-08T20:29:29.695864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327934+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:29:29.327934+0000","last_peered":"2024-03-08T20:29:29.327934+0000","last_clean":"2024-03-08T20:29:29.327934+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:29:29.327934+0000","last_undegraded":"2024-03-08T20:29:29.327934+0000","last_fullsized":"2024-03-08T20:29:29.327934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329741+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:29:29.329741+0000","last_peered":"2024-03-08T20:29:29.329741+0000","last_clean":"2024-03-08T20:29:29.329741+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:29:29.329741+0000","last_undegraded":"2024-03-08T20:29:29.329741+0000","last_fullsized":"2024-03-08T20:29:29.329741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695025+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:29:29.695025+0000","last_peered":"2024-03-08T20:29:29.695025+0000","last_clean":"2024-03-08T20:29:29.695025+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:29:29.695025+0000","last_undegraded":"2024-03-08T20:29:29.695025+0000","last_fullsized":"2024-03-08T20:29:29.695025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327560+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:29:29.327560+0000","last_peered":"2024-03-08T20:29:29.327560+0000","last_clean":"2024-03-08T20:29:29.327560+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:29:29.327560+0000","last_undegraded":"2024-03-08T20:29:29.327560+0000","last_fullsized":"2024-03-08T20:29:29.327560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328809+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:29:29.328809+0000","last_peered":"2024-03-08T20:29:29.328809+0000","last_clean":"2024-03-08T20:29:29.328809+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:29:29.328809+0000","last_undegraded":"2024-03-08T20:29:29.328809+0000","last_fullsized":"2024-03-08T20:29:29.328809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693380+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:29:29.693380+0000","last_peered":"2024-03-08T20:29:29.693380+0000","last_clean":"2024-03-08T20:29:29.693380+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:29:29.693380+0000","last_undegraded":"2024-03-08T20:29:29.693380+0000","last_fullsized":"2024-03-08T20:29:29.693380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694568+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:29:29.694568+0000","last_peered":"2024-03-08T20:29:29.694568+0000","last_clean":"2024-03-08T20:29:29.694568+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:29:29.694568+0000","last_undegraded":"2024-03-08T20:29:29.694568+0000","last_fullsized":"2024-03-08T20:29:29.694568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330807+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:29:29.330807+0000","last_peered":"2024-03-08T20:29:29.330807+0000","last_clean":"2024-03-08T20:29:29.330807+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:29:29.330807+0000","last_undegraded":"2024-03-08T20:29:29.330807+0000","last_fullsized":"2024-03-08T20:29:29.330807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323615+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:29:29.323615+0000","last_peered":"2024-03-08T20:29:29.323615+0000","last_clean":"2024-03-08T20:29:29.323615+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:29:29.323615+0000","last_undegraded":"2024-03-08T20:29:29.323615+0000","last_fullsized":"2024-03-08T20:29:29.323615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604207+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:29:29.604207+0000","last_peered":"2024-03-08T20:29:29.604207+0000","last_clean":"2024-03-08T20:29:29.604207+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:29:29.604207+0000","last_undegraded":"2024-03-08T20:29:29.604207+0000","last_fullsized":"2024-03-08T20:29:29.604207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329605+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:29:29.329605+0000","last_peered":"2024-03-08T20:29:29.329605+0000","last_clean":"2024-03-08T20:29:29.329605+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:29:29.329605+0000","last_undegraded":"2024-03-08T20:29:29.329605+0000","last_fullsized":"2024-03-08T20:29:29.329605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323007+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:29:29.323007+0000","last_peered":"2024-03-08T20:29:29.323007+0000","last_clean":"2024-03-08T20:29:29.323007+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:29:29.323007+0000","last_undegraded":"2024-03-08T20:29:29.323007+0000","last_fullsized":"2024-03-08T20:29:29.323007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603803+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:29:29.603803+0000","last_peered":"2024-03-08T20:29:29.603803+0000","last_clean":"2024-03-08T20:29:29.603803+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:29:29.603803+0000","last_undegraded":"2024-03-08T20:29:29.603803+0000","last_fullsized":"2024-03-08T20:29:29.603803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605139+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:29:29.605139+0000","last_peered":"2024-03-08T20:29:29.605139+0000","last_clean":"2024-03-08T20:29:29.605139+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:29:29.605139+0000","last_undegraded":"2024-03-08T20:29:29.605139+0000","last_fullsized":"2024-03-08T20:29:29.605139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327305+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:29:29.327305+0000","last_peered":"2024-03-08T20:29:29.327305+0000","last_clean":"2024-03-08T20:29:29.327305+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:29:29.327305+0000","last_undegraded":"2024-03-08T20:29:29.327305+0000","last_fullsized":"2024-03-08T20:29:29.327305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693787+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:29:29.693787+0000","last_peered":"2024-03-08T20:29:29.693787+0000","last_clean":"2024-03-08T20:29:29.693787+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:29:29.693787+0000","last_undegraded":"2024-03-08T20:29:29.693787+0000","last_fullsized":"2024-03-08T20:29:29.693787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330826+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:29:29.330826+0000","last_peered":"2024-03-08T20:29:29.330826+0000","last_clean":"2024-03-08T20:29:29.330826+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:29:29.330826+0000","last_undegraded":"2024-03-08T20:29:29.330826+0000","last_fullsized":"2024-03-08T20:29:29.330826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693630+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:29:29.693630+0000","last_peered":"2024-03-08T20:29:29.693630+0000","last_clean":"2024-03-08T20:29:29.693630+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:29:29.693630+0000","last_undegraded":"2024-03-08T20:29:29.693630+0000","last_fullsized":"2024-03-08T20:29:29.693630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697621+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:29:29.697621+0000","last_peered":"2024-03-08T20:29:29.697621+0000","last_clean":"2024-03-08T20:29:29.697621+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:29:29.697621+0000","last_undegraded":"2024-03-08T20:29:29.697621+0000","last_fullsized":"2024-03-08T20:29:29.697621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326730+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:29:29.326730+0000","last_peered":"2024-03-08T20:29:29.326730+0000","last_clean":"2024-03-08T20:29:29.326730+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:29:29.326730+0000","last_undegraded":"2024-03-08T20:29:29.326730+0000","last_fullsized":"2024-03-08T20:29:29.326730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325381+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:29:29.325381+0000","last_peered":"2024-03-08T20:29:29.325381+0000","last_clean":"2024-03-08T20:29:29.325381+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:29:29.325381+0000","last_undegraded":"2024-03-08T20:29:29.325381+0000","last_fullsized":"2024-03-08T20:29:29.325381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605003+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:29:29.605003+0000","last_peered":"2024-03-08T20:29:29.605003+0000","last_clean":"2024-03-08T20:29:29.605003+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:29:29.605003+0000","last_undegraded":"2024-03-08T20:29:29.605003+0000","last_fullsized":"2024-03-08T20:29:29.605003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322436+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.322436+0000","last_peered":"2024-03-08T20:29:29.322436+0000","last_clean":"2024-03-08T20:29:29.322436+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:29:29.322436+0000","last_undegraded":"2024-03-08T20:29:29.322436+0000","last_fullsized":"2024-03-08T20:29:29.322436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604521+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:29:29.604521+0000","last_peered":"2024-03-08T20:29:29.604521+0000","last_clean":"2024-03-08T20:29:29.604521+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:29:29.604521+0000","last_undegraded":"2024-03-08T20:29:29.604521+0000","last_fullsized":"2024-03-08T20:29:29.604521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696204+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:29:29.696204+0000","last_peered":"2024-03-08T20:29:29.696204+0000","last_clean":"2024-03-08T20:29:29.696204+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:29:29.696204+0000","last_undegraded":"2024-03-08T20:29:29.696204+0000","last_fullsized":"2024-03-08T20:29:29.696204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692264+0000","last_change":"2024-03-08T20:29:28.297105+0000","last_active":"2024-03-08T20:29:29.692264+0000","last_peered":"2024-03-08T20:29:29.692264+0000","last_clean":"2024-03-08T20:29:29.692264+0000","last_became_active":"2024-03-08T20:29:28.296730+0000","last_became_peered":"2024-03-08T20:29:28.296730+0000","last_unstale":"2024-03-08T20:29:29.692264+0000","last_undegraded":"2024-03-08T20:29:29.692264+0000","last_fullsized":"2024-03-08T20:29:29.692264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327764+0000","last_change":"2024-03-08T20:29:24.251656+0000","last_active":"2024-03-08T20:29:29.327764+0000","last_peered":"2024-03-08T20:29:29.327764+0000","last_clean":"2024-03-08T20:29:29.327764+0000","last_became_active":"2024-03-08T20:29:24.251207+0000","last_became_peered":"2024-03-08T20:29:24.251207+0000","last_unstale":"2024-03-08T20:29:29.327764+0000","last_undegraded":"2024-03-08T20:29:29.327764+0000","last_fullsized":"2024-03-08T20:29:29.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604653+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:29:29.604653+0000","last_peered":"2024-03-08T20:29:29.604653+0000","last_clean":"2024-03-08T20:29:29.604653+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:29:29.604653+0000","last_undegraded":"2024-03-08T20:29:29.604653+0000","last_fullsized":"2024-03-08T20:29:29.604653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604080+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:29:29.604080+0000","last_peered":"2024-03-08T20:29:29.604080+0000","last_clean":"2024-03-08T20:29:29.604080+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:29:29.604080+0000","last_undegraded":"2024-03-08T20:29:29.604080+0000","last_fullsized":"2024-03-08T20:29:29.604080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330165+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:29:29.330165+0000","last_peered":"2024-03-08T20:29:29.330165+0000","last_clean":"2024-03-08T20:29:29.330165+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:29:29.330165+0000","last_undegraded":"2024-03-08T20:29:29.330165+0000","last_fullsized":"2024-03-08T20:29:29.330165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327392+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:29:29.327392+0000","last_peered":"2024-03-08T20:29:29.327392+0000","last_clean":"2024-03-08T20:29:29.327392+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:29:29.327392+0000","last_undegraded":"2024-03-08T20:29:29.327392+0000","last_fullsized":"2024-03-08T20:29:29.327392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604568+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:29:29.604568+0000","last_peered":"2024-03-08T20:29:29.604568+0000","last_clean":"2024-03-08T20:29:29.604568+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:29:29.604568+0000","last_undegraded":"2024-03-08T20:29:29.604568+0000","last_fullsized":"2024-03-08T20:29:29.604568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603861+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:29:29.603861+0000","last_peered":"2024-03-08T20:29:29.603861+0000","last_clean":"2024-03-08T20:29:29.603861+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:29:29.603861+0000","last_undegraded":"2024-03-08T20:29:29.603861+0000","last_fullsized":"2024-03-08T20:29:29.603861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629162+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:29:29.629162+0000","last_peered":"2024-03-08T20:29:29.629162+0000","last_clean":"2024-03-08T20:29:29.629162+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:29:29.629162+0000","last_undegraded":"2024-03-08T20:29:29.629162+0000","last_fullsized":"2024-03-08T20:29:29.629162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605161+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:29:29.605161+0000","last_peered":"2024-03-08T20:29:29.605161+0000","last_clean":"2024-03-08T20:29:29.605161+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:29:29.605161+0000","last_undegraded":"2024-03-08T20:29:29.605161+0000","last_fullsized":"2024-03-08T20:29:29.605161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.691864+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:29:29.691864+0000","last_peered":"2024-03-08T20:29:29.691864+0000","last_clean":"2024-03-08T20:29:29.691864+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:29:29.691864+0000","last_undegraded":"2024-03-08T20:29:29.691864+0000","last_fullsized":"2024-03-08T20:29:29.691864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694114+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:29:29.694114+0000","last_peered":"2024-03-08T20:29:29.694114+0000","last_clean":"2024-03-08T20:29:29.694114+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:29:29.694114+0000","last_undegraded":"2024-03-08T20:29:29.694114+0000","last_fullsized":"2024-03-08T20:29:29.694114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693453+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:29:29.693453+0000","last_peered":"2024-03-08T20:29:29.693453+0000","last_clean":"2024-03-08T20:29:29.693453+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:29:29.693453+0000","last_undegraded":"2024-03-08T20:29:29.693453+0000","last_fullsized":"2024-03-08T20:29:29.693453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323324+0000","last_change":"2024-03-08T20:29:24.260255+0000","last_active":"2024-03-08T20:29:29.323324+0000","last_peered":"2024-03-08T20:29:29.323324+0000","last_clean":"2024-03-08T20:29:29.323324+0000","last_became_active":"2024-03-08T20:29:24.259145+0000","last_became_peered":"2024-03-08T20:29:24.259145+0000","last_unstale":"2024-03-08T20:29:29.323324+0000","last_undegraded":"2024-03-08T20:29:29.323324+0000","last_fullsized":"2024-03-08T20:29:29.323324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325886+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:29:29.325886+0000","last_peered":"2024-03-08T20:29:29.325886+0000","last_clean":"2024-03-08T20:29:29.325886+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:29:29.325886+0000","last_undegraded":"2024-03-08T20:29:29.325886+0000","last_fullsized":"2024-03-08T20:29:29.325886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694395+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:29:29.694395+0000","last_peered":"2024-03-08T20:29:29.694395+0000","last_clean":"2024-03-08T20:29:29.694395+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:29:29.694395+0000","last_undegraded":"2024-03-08T20:29:29.694395+0000","last_fullsized":"2024-03-08T20:29:29.694395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:29:29.695250+0000","last_peered":"2024-03-08T20:29:29.695250+0000","last_clean":"2024-03-08T20:29:29.695250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:29:29.695250+0000","last_undegraded":"2024-03-08T20:29:29.695250+0000","last_fullsized":"2024-03-08T20:29:29.695250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695382+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:29:29.695382+0000","last_peered":"2024-03-08T20:29:29.695382+0000","last_clean":"2024-03-08T20:29:29.695382+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:29:29.695382+0000","last_undegraded":"2024-03-08T20:29:29.695382+0000","last_fullsized":"2024-03-08T20:29:29.695382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629459+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:29:29.629459+0000","last_peered":"2024-03-08T20:29:29.629459+0000","last_clean":"2024-03-08T20:29:29.629459+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:29:29.629459+0000","last_undegraded":"2024-03-08T20:29:29.629459+0000","last_fullsized":"2024-03-08T20:29:29.629459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694813+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:29:29.694813+0000","last_peered":"2024-03-08T20:29:29.694813+0000","last_clean":"2024-03-08T20:29:29.694813+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:29:29.694813+0000","last_undegraded":"2024-03-08T20:29:29.694813+0000","last_fullsized":"2024-03-08T20:29:29.694813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328751+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:29:29.328751+0000","last_peered":"2024-03-08T20:29:29.328751+0000","last_clean":"2024-03-08T20:29:29.328751+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:29:29.328751+0000","last_undegraded":"2024-03-08T20:29:29.328751+0000","last_fullsized":"2024-03-08T20:29:29.328751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604775+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:29:29.604775+0000","last_peered":"2024-03-08T20:29:29.604775+0000","last_clean":"2024-03-08T20:29:29.604775+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:29:29.604775+0000","last_undegraded":"2024-03-08T20:29:29.604775+0000","last_fullsized":"2024-03-08T20:29:29.604775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692533+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:29:29.692533+0000","last_peered":"2024-03-08T20:29:29.692533+0000","last_clean":"2024-03-08T20:29:29.692533+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:29:29.692533+0000","last_undegraded":"2024-03-08T20:29:29.692533+0000","last_fullsized":"2024-03-08T20:29:29.692533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696871+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:29:29.696871+0000","last_peered":"2024-03-08T20:29:29.696871+0000","last_clean":"2024-03-08T20:29:29.696871+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:29:29.696871+0000","last_undegraded":"2024-03-08T20:29:29.696871+0000","last_fullsized":"2024-03-08T20:29:29.696871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629717+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:29:29.629717+0000","last_peered":"2024-03-08T20:29:29.629717+0000","last_clean":"2024-03-08T20:29:29.629717+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:29:29.629717+0000","last_undegraded":"2024-03-08T20:29:29.629717+0000","last_fullsized":"2024-03-08T20:29:29.629717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328240+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.328240+0000","last_peered":"2024-03-08T20:29:29.328240+0000","last_clean":"2024-03-08T20:29:29.328240+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:29:29.328240+0000","last_undegraded":"2024-03-08T20:29:29.328240+0000","last_fullsized":"2024-03-08T20:29:29.328240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696081+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:29:29.696081+0000","last_peered":"2024-03-08T20:29:29.696081+0000","last_clean":"2024-03-08T20:29:29.696081+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:29:29.696081+0000","last_undegraded":"2024-03-08T20:29:29.696081+0000","last_fullsized":"2024-03-08T20:29:29.696081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.331585+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:29:29.331585+0000","last_peered":"2024-03-08T20:29:29.331585+0000","last_clean":"2024-03-08T20:29:29.331585+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:29:29.331585+0000","last_undegraded":"2024-03-08T20:29:29.331585+0000","last_fullsized":"2024-03-08T20:29:29.331585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326308+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:29:29.326308+0000","last_peered":"2024-03-08T20:29:29.326308+0000","last_clean":"2024-03-08T20:29:29.326308+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:29:29.326308+0000","last_undegraded":"2024-03-08T20:29:29.326308+0000","last_fullsized":"2024-03-08T20:29:29.326308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694312+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:29:29.694312+0000","last_peered":"2024-03-08T20:29:29.694312+0000","last_clean":"2024-03-08T20:29:29.694312+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:29:29.694312+0000","last_undegraded":"2024-03-08T20:29:29.694312+0000","last_fullsized":"2024-03-08T20:29:29.694312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.628871+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:29:29.628871+0000","last_peered":"2024-03-08T20:29:29.628871+0000","last_clean":"2024-03-08T20:29:29.628871+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:29:29.628871+0000","last_undegraded":"2024-03-08T20:29:29.628871+0000","last_fullsized":"2024-03-08T20:29:29.628871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693296+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:29:29.693296+0000","last_peered":"2024-03-08T20:29:29.693296+0000","last_clean":"2024-03-08T20:29:29.693296+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:29:29.693296+0000","last_undegraded":"2024-03-08T20:29:29.693296+0000","last_fullsized":"2024-03-08T20:29:29.693296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693106+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:29:29.693106+0000","last_peered":"2024-03-08T20:29:29.693106+0000","last_clean":"2024-03-08T20:29:29.693106+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:29:29.693106+0000","last_undegraded":"2024-03-08T20:29:29.693106+0000","last_fullsized":"2024-03-08T20:29:29.693106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693542+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:29:29.693542+0000","last_peered":"2024-03-08T20:29:29.693542+0000","last_clean":"2024-03-08T20:29:29.693542+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:29:29.693542+0000","last_undegraded":"2024-03-08T20:29:29.693542+0000","last_fullsized":"2024-03-08T20:29:29.693542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325186+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:29:29.325186+0000","last_peered":"2024-03-08T20:29:29.325186+0000","last_clean":"2024-03-08T20:29:29.325186+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:29:29.325186+0000","last_undegraded":"2024-03-08T20:29:29.325186+0000","last_fullsized":"2024-03-08T20:29:29.325186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694546+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:29:29.694546+0000","last_peered":"2024-03-08T20:29:29.694546+0000","last_clean":"2024-03-08T20:29:29.694546+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:29:29.694546+0000","last_undegraded":"2024-03-08T20:29:29.694546+0000","last_fullsized":"2024-03-08T20:29:29.694546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327131+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:29:29.327131+0000","last_peered":"2024-03-08T20:29:29.327131+0000","last_clean":"2024-03-08T20:29:29.327131+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:29:29.327131+0000","last_undegraded":"2024-03-08T20:29:29.327131+0000","last_fullsized":"2024-03-08T20:29:29.327131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324284+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:29:29.324284+0000","last_peered":"2024-03-08T20:29:29.324284+0000","last_clean":"2024-03-08T20:29:29.324284+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:29:29.324284+0000","last_undegraded":"2024-03-08T20:29:29.324284+0000","last_fullsized":"2024-03-08T20:29:29.324284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692438+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692438+0000","last_peered":"2024-03-08T20:29:29.692438+0000","last_clean":"2024-03-08T20:29:29.692438+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:29:29.692438+0000","last_undegraded":"2024-03-08T20:29:29.692438+0000","last_fullsized":"2024-03-08T20:29:29.692438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692729+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:29:29.692729+0000","last_peered":"2024-03-08T20:29:29.692729+0000","last_clean":"2024-03-08T20:29:29.692729+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:29:29.692729+0000","last_undegraded":"2024-03-08T20:29:29.692729+0000","last_fullsized":"2024-03-08T20:29:29.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327436+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:29:29.327436+0000","last_peered":"2024-03-08T20:29:29.327436+0000","last_clean":"2024-03-08T20:29:29.327436+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:29:29.327436+0000","last_undegraded":"2024-03-08T20:29:29.327436+0000","last_fullsized":"2024-03-08T20:29:29.327436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695853+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:29:29.695853+0000","last_peered":"2024-03-08T20:29:29.695853+0000","last_clean":"2024-03-08T20:29:29.695853+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:29:29.695853+0000","last_undegraded":"2024-03-08T20:29:29.695853+0000","last_fullsized":"2024-03-08T20:29:29.695853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:42.977992+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:29:42.977992+0000","last_peered":"2024-03-08T20:29:42.977992+0000","last_clean":"2024-03-08T20:29:42.977992+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:29:42.977992+0000","last_undegraded":"2024-03-08T20:29:42.977992+0000","last_fullsized":"2024-03-08T20:29:42.977992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604126+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:29:29.604126+0000","last_peered":"2024-03-08T20:29:29.604126+0000","last_clean":"2024-03-08T20:29:29.604126+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:29:29.604126+0000","last_undegraded":"2024-03-08T20:29:29.604126+0000","last_fullsized":"2024-03-08T20:29:29.604126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330303+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:29:29.330303+0000","last_peered":"2024-03-08T20:29:29.330303+0000","last_clean":"2024-03-08T20:29:29.330303+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:29:29.330303+0000","last_undegraded":"2024-03-08T20:29:29.330303+0000","last_fullsized":"2024-03-08T20:29:29.330303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604749+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:29:29.604749+0000","last_peered":"2024-03-08T20:29:29.604749+0000","last_clean":"2024-03-08T20:29:29.604749+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:29:29.604749+0000","last_undegraded":"2024-03-08T20:29:29.604749+0000","last_fullsized":"2024-03-08T20:29:29.604749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329992+0000","last_change":"2024-03-08T20:29:28.284054+0000","last_active":"2024-03-08T20:29:29.329992+0000","last_peered":"2024-03-08T20:29:29.329992+0000","last_clean":"2024-03-08T20:29:29.329992+0000","last_became_active":"2024-03-08T20:29:28.282361+0000","last_became_peered":"2024-03-08T20:29:28.282361+0000","last_unstale":"2024-03-08T20:29:29.329992+0000","last_undegraded":"2024-03-08T20:29:29.329992+0000","last_fullsized":"2024-03-08T20:29:29.329992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693127+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:29:29.693127+0000","last_peered":"2024-03-08T20:29:29.693127+0000","last_clean":"2024-03-08T20:29:29.693127+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:29:29.693127+0000","last_undegraded":"2024-03-08T20:29:29.693127+0000","last_fullsized":"2024-03-08T20:29:29.693127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328317+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:29:29.328317+0000","last_peered":"2024-03-08T20:29:29.328317+0000","last_clean":"2024-03-08T20:29:29.328317+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:29:29.328317+0000","last_undegraded":"2024-03-08T20:29:29.328317+0000","last_fullsized":"2024-03-08T20:29:29.328317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322805+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:29:29.322805+0000","last_peered":"2024-03-08T20:29:29.322805+0000","last_clean":"2024-03-08T20:29:29.322805+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:29:29.322805+0000","last_undegraded":"2024-03-08T20:29:29.322805+0000","last_fullsized":"2024-03-08T20:29:29.322805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328142+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:29:29.328142+0000","last_peered":"2024-03-08T20:29:29.328142+0000","last_clean":"2024-03-08T20:29:29.328142+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:29:29.328142+0000","last_undegraded":"2024-03-08T20:29:29.328142+0000","last_fullsized":"2024-03-08T20:29:29.328142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697363+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:29:29.697363+0000","last_peered":"2024-03-08T20:29:29.697363+0000","last_clean":"2024-03-08T20:29:29.697363+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:29:29.697363+0000","last_undegraded":"2024-03-08T20:29:29.697363+0000","last_fullsized":"2024-03-08T20:29:29.697363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322850+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:29:29.322850+0000","last_peered":"2024-03-08T20:29:29.322850+0000","last_clean":"2024-03-08T20:29:29.322850+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:29:29.322850+0000","last_undegraded":"2024-03-08T20:29:29.322850+0000","last_fullsized":"2024-03-08T20:29:29.322850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692999+0000","last_change":"2024-03-08T20:29:28.304811+0000","last_active":"2024-03-08T20:29:29.692999+0000","last_peered":"2024-03-08T20:29:29.692999+0000","last_clean":"2024-03-08T20:29:29.692999+0000","last_became_active":"2024-03-08T20:29:28.304218+0000","last_became_peered":"2024-03-08T20:29:28.304218+0000","last_unstale":"2024-03-08T20:29:29.692999+0000","last_undegraded":"2024-03-08T20:29:29.692999+0000","last_fullsized":"2024-03-08T20:29:29.692999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603670+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:29:29.603670+0000","last_peered":"2024-03-08T20:29:29.603670+0000","last_clean":"2024-03-08T20:29:29.603670+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:29:29.603670+0000","last_undegraded":"2024-03-08T20:29:29.603670+0000","last_fullsized":"2024-03-08T20:29:29.603670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325365+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:29:29.325365+0000","last_peered":"2024-03-08T20:29:29.325365+0000","last_clean":"2024-03-08T20:29:29.325365+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:29:29.325365+0000","last_undegraded":"2024-03-08T20:29:29.325365+0000","last_fullsized":"2024-03-08T20:29:29.325365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697547+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:29:29.697547+0000","last_peered":"2024-03-08T20:29:29.697547+0000","last_clean":"2024-03-08T20:29:29.697547+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:29:29.697547+0000","last_undegraded":"2024-03-08T20:29:29.697547+0000","last_fullsized":"2024-03-08T20:29:29.697547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322791+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:29:29.322791+0000","last_peered":"2024-03-08T20:29:29.322791+0000","last_clean":"2024-03-08T20:29:29.322791+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:29:29.322791+0000","last_undegraded":"2024-03-08T20:29:29.322791+0000","last_fullsized":"2024-03-08T20:29:29.322791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323271+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:29:29.323271+0000","last_peered":"2024-03-08T20:29:29.323271+0000","last_clean":"2024-03-08T20:29:29.323271+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:29:29.323271+0000","last_undegraded":"2024-03-08T20:29:29.323271+0000","last_fullsized":"2024-03-08T20:29:29.323271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695741+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:29:29.695741+0000","last_peered":"2024-03-08T20:29:29.695741+0000","last_clean":"2024-03-08T20:29:29.695741+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:29:29.695741+0000","last_undegraded":"2024-03-08T20:29:29.695741+0000","last_fullsized":"2024-03-08T20:29:29.695741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692624+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:29:29.692624+0000","last_peered":"2024-03-08T20:29:29.692624+0000","last_clean":"2024-03-08T20:29:29.692624+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:29:29.692624+0000","last_undegraded":"2024-03-08T20:29:29.692624+0000","last_fullsized":"2024-03-08T20:29:29.692624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629301+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:29:29.629301+0000","last_peered":"2024-03-08T20:29:29.629301+0000","last_clean":"2024-03-08T20:29:29.629301+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:29:29.629301+0000","last_undegraded":"2024-03-08T20:29:29.629301+0000","last_fullsized":"2024-03-08T20:29:29.629301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323851+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:29:29.323851+0000","last_peered":"2024-03-08T20:29:29.323851+0000","last_clean":"2024-03-08T20:29:29.323851+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:29:29.323851+0000","last_undegraded":"2024-03-08T20:29:29.323851+0000","last_fullsized":"2024-03-08T20:29:29.323851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329117+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:29:29.329117+0000","last_peered":"2024-03-08T20:29:29.329117+0000","last_clean":"2024-03-08T20:29:29.329117+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:29:29.329117+0000","last_undegraded":"2024-03-08T20:29:29.329117+0000","last_fullsized":"2024-03-08T20:29:29.329117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324482+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:29:29.324482+0000","last_peered":"2024-03-08T20:29:29.324482+0000","last_clean":"2024-03-08T20:29:29.324482+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:29:29.324482+0000","last_undegraded":"2024-03-08T20:29:29.324482+0000","last_fullsized":"2024-03-08T20:29:29.324482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692905+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:29:29.692905+0000","last_peered":"2024-03-08T20:29:29.692905+0000","last_clean":"2024-03-08T20:29:29.692905+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:29:29.692905+0000","last_undegraded":"2024-03-08T20:29:29.692905+0000","last_fullsized":"2024-03-08T20:29:29.692905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629275+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:29:29.629275+0000","last_peered":"2024-03-08T20:29:29.629275+0000","last_clean":"2024-03-08T20:29:29.629275+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:29:29.629275+0000","last_undegraded":"2024-03-08T20:29:29.629275+0000","last_fullsized":"2024-03-08T20:29:29.629275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326896+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:29:29.326896+0000","last_peered":"2024-03-08T20:29:29.326896+0000","last_clean":"2024-03-08T20:29:29.326896+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:29:29.326896+0000","last_undegraded":"2024-03-08T20:29:29.326896+0000","last_fullsized":"2024-03-08T20:29:29.326896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692632+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:29:29.692632+0000","last_peered":"2024-03-08T20:29:29.692632+0000","last_clean":"2024-03-08T20:29:29.692632+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:29:29.692632+0000","last_undegraded":"2024-03-08T20:29:29.692632+0000","last_fullsized":"2024-03-08T20:29:29.692632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324493+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:29:29.324493+0000","last_peered":"2024-03-08T20:29:29.324493+0000","last_clean":"2024-03-08T20:29:29.324493+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:29:29.324493+0000","last_undegraded":"2024-03-08T20:29:29.324493+0000","last_fullsized":"2024-03-08T20:29:29.324493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604628+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:29:29.604628+0000","last_peered":"2024-03-08T20:29:29.604628+0000","last_clean":"2024-03-08T20:29:29.604628+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:29:29.604628+0000","last_undegraded":"2024-03-08T20:29:29.604628+0000","last_fullsized":"2024-03-08T20:29:29.604628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696589+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:29:29.696589+0000","last_peered":"2024-03-08T20:29:29.696589+0000","last_clean":"2024-03-08T20:29:29.696589+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:29:29.696589+0000","last_undegraded":"2024-03-08T20:29:29.696589+0000","last_fullsized":"2024-03-08T20:29:29.696589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325184+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:29:29.325184+0000","last_peered":"2024-03-08T20:29:29.325184+0000","last_clean":"2024-03-08T20:29:29.325184+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:29:29.325184+0000","last_undegraded":"2024-03-08T20:29:29.325184+0000","last_fullsized":"2024-03-08T20:29:29.325184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325117+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:29:29.325117+0000","last_peered":"2024-03-08T20:29:29.325117+0000","last_clean":"2024-03-08T20:29:29.325117+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:29:29.325117+0000","last_undegraded":"2024-03-08T20:29:29.325117+0000","last_fullsized":"2024-03-08T20:29:29.325117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323214+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:29:29.323214+0000","last_peered":"2024-03-08T20:29:29.323214+0000","last_clean":"2024-03-08T20:29:29.323214+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:29:29.323214+0000","last_undegraded":"2024-03-08T20:29:29.323214+0000","last_fullsized":"2024-03-08T20:29:29.323214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326675+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:29:29.326675+0000","last_peered":"2024-03-08T20:29:29.326675+0000","last_clean":"2024-03-08T20:29:29.326675+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:29:29.326675+0000","last_undegraded":"2024-03-08T20:29:29.326675+0000","last_fullsized":"2024-03-08T20:29:29.326675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692321+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692321+0000","last_peered":"2024-03-08T20:29:29.692321+0000","last_clean":"2024-03-08T20:29:29.692321+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:29:29.692321+0000","last_undegraded":"2024-03-08T20:29:29.692321+0000","last_fullsized":"2024-03-08T20:29:29.692321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695239+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:29:29.695239+0000","last_peered":"2024-03-08T20:29:29.695239+0000","last_clean":"2024-03-08T20:29:29.695239+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:29:29.695239+0000","last_undegraded":"2024-03-08T20:29:29.695239+0000","last_fullsized":"2024-03-08T20:29:29.695239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696160+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:29:29.696160+0000","last_peered":"2024-03-08T20:29:29.696160+0000","last_clean":"2024-03-08T20:29:29.696160+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:29:29.696160+0000","last_undegraded":"2024-03-08T20:29:29.696160+0000","last_fullsized":"2024-03-08T20:29:29.696160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629573+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:29:29.629573+0000","last_peered":"2024-03-08T20:29:29.629573+0000","last_clean":"2024-03-08T20:29:29.629573+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:29:29.629573+0000","last_undegraded":"2024-03-08T20:29:29.629573+0000","last_fullsized":"2024-03-08T20:29:29.629573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328419+0000","last_change":"2024-03-08T20:29:24.269658+0000","last_active":"2024-03-08T20:29:29.328419+0000","last_peered":"2024-03-08T20:29:29.328419+0000","last_clean":"2024-03-08T20:29:29.328419+0000","last_became_active":"2024-03-08T20:29:24.268813+0000","last_became_peered":"2024-03-08T20:29:24.268813+0000","last_unstale":"2024-03-08T20:29:29.328419+0000","last_undegraded":"2024-03-08T20:29:29.328419+0000","last_fullsized":"2024-03-08T20:29:29.328419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324804+0000","last_change":"2024-03-08T20:29:24.244300+0000","last_active":"2024-03-08T20:29:29.324804+0000","last_peered":"2024-03-08T20:29:29.324804+0000","last_clean":"2024-03-08T20:29:29.324804+0000","last_became_active":"2024-03-08T20:29:24.243929+0000","last_became_peered":"2024-03-08T20:29:24.243929+0000","last_unstale":"2024-03-08T20:29:29.324804+0000","last_undegraded":"2024-03-08T20:29:29.324804+0000","last_fullsized":"2024-03-08T20:29:29.324804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603720+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:29:29.603720+0000","last_peered":"2024-03-08T20:29:29.603720+0000","last_clean":"2024-03-08T20:29:29.603720+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:29:29.603720+0000","last_undegraded":"2024-03-08T20:29:29.603720+0000","last_fullsized":"2024-03-08T20:29:29.603720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692350+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:29:29.692350+0000","last_peered":"2024-03-08T20:29:29.692350+0000","last_clean":"2024-03-08T20:29:29.692350+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:29:29.692350+0000","last_undegraded":"2024-03-08T20:29:29.692350+0000","last_fullsized":"2024-03-08T20:29:29.692350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323559+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:29:29.323559+0000","last_peered":"2024-03-08T20:29:29.323559+0000","last_clean":"2024-03-08T20:29:29.323559+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:29:29.323559+0000","last_undegraded":"2024-03-08T20:29:29.323559+0000","last_fullsized":"2024-03-08T20:29:29.323559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330666+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:29:29.330666+0000","last_peered":"2024-03-08T20:29:29.330666+0000","last_clean":"2024-03-08T20:29:29.330666+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:29:29.330666+0000","last_undegraded":"2024-03-08T20:29:29.330666+0000","last_fullsized":"2024-03-08T20:29:29.330666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695621+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:29:29.695621+0000","last_peered":"2024-03-08T20:29:29.695621+0000","last_clean":"2024-03-08T20:29:29.695621+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:29:29.695621+0000","last_undegraded":"2024-03-08T20:29:29.695621+0000","last_fullsized":"2024-03-08T20:29:29.695621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696357+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:29:29.696357+0000","last_peered":"2024-03-08T20:29:29.696357+0000","last_clean":"2024-03-08T20:29:29.696357+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:29:29.696357+0000","last_undegraded":"2024-03-08T20:29:29.696357+0000","last_fullsized":"2024-03-08T20:29:29.696357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696755+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:29:29.696755+0000","last_peered":"2024-03-08T20:29:29.696755+0000","last_clean":"2024-03-08T20:29:29.696755+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:29:29.696755+0000","last_undegraded":"2024-03-08T20:29:29.696755+0000","last_fullsized":"2024-03-08T20:29:29.696755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322453+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:29:29.322453+0000","last_peered":"2024-03-08T20:29:29.322453+0000","last_clean":"2024-03-08T20:29:29.322453+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:29:29.322453+0000","last_undegraded":"2024-03-08T20:29:29.322453+0000","last_fullsized":"2024-03-08T20:29:29.322453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694028+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:29:29.694028+0000","last_peered":"2024-03-08T20:29:29.694028+0000","last_clean":"2024-03-08T20:29:29.694028+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:29:29.694028+0000","last_undegraded":"2024-03-08T20:29:29.694028+0000","last_fullsized":"2024-03-08T20:29:29.694028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326448+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:29:29.326448+0000","last_peered":"2024-03-08T20:29:29.326448+0000","last_clean":"2024-03-08T20:29:29.326448+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:29:29.326448+0000","last_undegraded":"2024-03-08T20:29:29.326448+0000","last_fullsized":"2024-03-08T20:29:29.326448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694256+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:29:29.694256+0000","last_peered":"2024-03-08T20:29:29.694256+0000","last_clean":"2024-03-08T20:29:29.694256+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:29:29.694256+0000","last_undegraded":"2024-03-08T20:29:29.694256+0000","last_fullsized":"2024-03-08T20:29:29.694256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327678+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:29:29.327678+0000","last_peered":"2024-03-08T20:29:29.327678+0000","last_clean":"2024-03-08T20:29:29.327678+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:29:29.327678+0000","last_undegraded":"2024-03-08T20:29:29.327678+0000","last_fullsized":"2024-03-08T20:29:29.327678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692705+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:29:29.692705+0000","last_peered":"2024-03-08T20:29:29.692705+0000","last_clean":"2024-03-08T20:29:29.692705+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:29:29.692705+0000","last_undegraded":"2024-03-08T20:29:29.692705+0000","last_fullsized":"2024-03-08T20:29:29.692705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605002+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:29:29.605002+0000","last_peered":"2024-03-08T20:29:29.605002+0000","last_clean":"2024-03-08T20:29:29.605002+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:29:29.605002+0000","last_undegraded":"2024-03-08T20:29:29.605002+0000","last_fullsized":"2024-03-08T20:29:29.605002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696518+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:29:29.696518+0000","last_peered":"2024-03-08T20:29:29.696518+0000","last_clean":"2024-03-08T20:29:29.696518+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:29:29.696518+0000","last_undegraded":"2024-03-08T20:29:29.696518+0000","last_fullsized":"2024-03-08T20:29:29.696518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:29:48.330 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-08T20:29:48.330 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-08T20:29:48.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-08T20:29:48.331 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-08T20:29:48.331 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-08T20:29:48.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.571+0000 7f8977800640 1 Processor -- start 2024-03-08T20:29:48.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.571+0000 7f8977800640 1 -- start start 2024-03-08T20:29:48.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.572+0000 7f8977800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89700c38b0 0x7f89701523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.572+0000 7f8977800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700c3e90 con 0x7f89700aa7e0 2024-03-08T20:29:48.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.572+0000 7f8977800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700c1210 con 0x7f897014f210 2024-03-08T20:29:48.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.572+0000 7f8977800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89700c14f0 con 0x7f89700c38b0 2024-03-08T20:29:48.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896fe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f89700aa7e0 0x7f8970151ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47900/0 (socket says 172.21.15.118:47900) 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896fe00640 1 -- 172.21.15.118:0/3719778395 learned_addr learned my addr 172.21.15.118:0/3719778395 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229954175 0 0) 0x7f89700c3e90 con 0x7f89700aa7e0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f8975800640 1 --2- 172.21.15.118:0/3719778395 >> v2:172.21.15.144:3300/0 conn(0x7f89700c38b0 0x7f89701523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8958003520 con 0x7f89700aa7e0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3714005609 0 0) 0x7f8958003520 con 0x7f89700aa7e0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 >> v2:172.21.15.144:3300/0 conn(0x7f89700c38b0 msgr2=0x7f89701523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 --2- 172.21.15.118:0/3719778395 >> v2:172.21.15.144:3300/0 conn(0x7f89700c38b0 0x7f89701523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 >> v1:172.21.15.144:6789/0 conn(0x7f897014f210 legacy=0x7f897006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.573+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700c0cc0 con 0x7f89700aa7e0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f895c001670 con 0x7f89700aa7e0 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 >> v1:172.21.15.118:6789/0 conn(0x7f89700aa7e0 legacy=0x7f8970151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8958003a00 0x7f8958003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8958004800 0x7f8958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f895800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89700c14f0 con 0x7f89580052e0 2024-03-08T20:29:48.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895800c1e0 con 0x7f8958003a00 2024-03-08T20:29:48.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895800c3e0 con 0x7f8958004800 2024-03-08T20:29:48.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f895800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f896fe00640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8958004800 0x7f8958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8974e00640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8958003a00 0x7f8958003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 -- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8958004800 msgr2=0x7f8958004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8958004800 0x7f8958004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 -- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8958003a00 msgr2=0x7f8958003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8958003a00 0x7f8958003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.574+0000 7f8975800640 1 -- 172.21.15.118:0/3719778395 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958003520 con 0x7f89580052e0 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.575+0000 7f8975800640 1 -- 172.21.15.118:0/3719778395 reap_dead start 2024-03-08T20:29:48.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.575+0000 7f8975800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f895800b9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8968009fc0 tx=0x7f8958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2378699cdfcfae server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968009c10 con 0x7f89580052e0 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896802cca0 con 0x7f89580052e0 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f896f400640 1 -- 172.21.15.118:0/3719778395 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968003bd0 con 0x7f89580052e0 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 -- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 msgr2=0x7f895800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f895800b9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8968009fc0 tx=0x7f8958005830 comp rx=0 tx=0).stop 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 -- 172.21.15.118:0/3719778395 shutdown_connections 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 --2- 172.21.15.118:0/3719778395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f895800b9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 -- 172.21.15.118:0/3719778395 >> 172.21.15.118:0/3719778395 conn(0x7f89700a84c0 msgr2=0x7f89700a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 -- 172.21.15.118:0/3719778395 shutdown_connections 2024-03-08T20:29:48.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.576+0000 7f8977800640 1 -- 172.21.15.118:0/3719778395 wait complete. 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.578+0000 7f8977800640 1 Processor -- start 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.578+0000 7f8977800640 1 -- start start 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89701512d0 0x7f897013bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f897013c280 0x7f89701ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897014f5f0 con 0x7f89580052e0 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897006ad10 con 0x7f89701512d0 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8977800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700c62e0 con 0x7f897013c280 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8974e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8974e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59328/0 (socket says 172.21.15.118:59328) 2024-03-08T20:29:48.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.579+0000 7f8974e00640 1 -- 172.21.15.118:0/1343631751 learned_addr learned my addr 172.21.15.118:0/1343631751 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 -- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f897013c280 msgr2=0x7f89701ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f897013c280 0x7f89701ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 -- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89701512d0 msgr2=0x7f897013bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89701512d0 0x7f897013bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 -- 172.21.15.118:0/1343631751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700c7150 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8974e00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f896400e480 tx=0x7f896400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89640052e0 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964018070 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964003830 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89700c49f0 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.580+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89700c4fb0 con 0x7f89580052e0 2024-03-08T20:29:48.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.581+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8970074a40 con 0x7f89580052e0 2024-03-08T20:29:48.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.582+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f89640039d0 con 0x7f89580052e0 2024-03-08T20:29:48.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.583+0000 7f896cc00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 0x7f895006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:48.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.583+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f896408aa20 con 0x7f89580052e0 2024-03-08T20:29:48.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.583+0000 7f896fe00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 0x7f895006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:48.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.584+0000 7f896fe00640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 0x7f895006e0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f895c001eb0 tx=0x7f895c000f60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:48.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.588+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f89640591c0 con 0x7f89580052e0 2024-03-08T20:29:48.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.815+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8970151ad0 con 0x7f89580052e0 2024-03-08T20:29:48.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.820+0000 7f896cc00640 1 -- 172.21.15.118:0/1343631751 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+172586 (secure 0 0 0) 0x7f8964058ac0 con 0x7f89580052e0 2024-03-08T20:29:48.820 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 msgr2=0x7f895006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 0x7f895006e0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f895c001eb0 tx=0x7f895c000f60 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 msgr2=0x7f89700c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f896400e480 tx=0x7f896400e940 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 shutdown_connections 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f895006bc00 0x7f895006e0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f897013c280 0x7f89701ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89701512d0 0x7f897013bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 --2- 172.21.15.118:0/1343631751 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89580052e0 0x7f89700c5da0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 >> 172.21.15.118:0/1343631751 conn(0x7f89700a84c0 msgr2=0x7f897006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:48.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 shutdown_connections 2024-03-08T20:29:48.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:48.824+0000 7f8977800640 1 -- 172.21.15.118:0/1343631751 wait complete. 2024-03-08T20:29:48.842 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":3268310629},{"type":"v1","addr":"172.21.15.118:6833","nonce":3268310629}]},"active_addr":"172.21.15.118:6833/3268310629","active_change":"2024-03-08T20:29:09.491616+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1676726079}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3873410480}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":1099835682}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.118:0","nonce":3606985971}]}]} 2024-03-08T20:29:48.845 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-08T20:29:48.845 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-08T20:29:48.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:49.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.046+0000 7fb00b800640 1 Processor -- start 2024-03-08T20:29:49.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.046+0000 7fb00b800640 1 -- start start 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.047+0000 7fb00b800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406af80 0x7fb00406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.047+0000 7fb00b800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb0041505e0 0x7fb004152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.047+0000 7fb00b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040aa980 con 0x7fb00406ebd0 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb00b800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040aac60 con 0x7fb0041505e0 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb00b800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040aaf40 con 0x7fb00406af80 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb0041505e0 0x7fb004152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb0041505e0 0x7fb004152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59340/0 (socket says 172.21.15.118:59340) 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 -- 172.21.15.118:0/1909805481 learned_addr learned my addr 172.21.15.118:0/1909805481 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb008e00640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406af80 0x7fb00406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 -- 172.21.15.118:0/1909805481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406af80 msgr2=0x7fb00406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406af80 0x7fb00406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 -- 172.21.15.118:0/1909805481 >> v1:172.21.15.144:6789/0 conn(0x7fb00406ebd0 legacy=0x7fb00414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:49.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.048+0000 7fb009800640 1 -- 172.21.15.118:0/1909805481 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040ab220 con 0x7fb0041505e0 2024-03-08T20:29:49.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.049+0000 7fb009800640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb004152e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faffc009e50 tx=0x7faffc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2378c55c8de809ec server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.050+0000 7fb003400640 1 -- 172.21.15.118:0/1909805481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc02c9e0 con 0x7fb0041505e0 2024-03-08T20:29:49.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.050+0000 7fb003400640 1 -- 172.21.15.118:0/1909805481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc02cb80 con 0x7fb0041505e0 2024-03-08T20:29:49.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.050+0000 7fb003400640 1 -- 172.21.15.118:0/1909805481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc0343f0 con 0x7fb0041505e0 2024-03-08T20:29:49.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.050+0000 7fb00b800640 1 -- 172.21.15.118:0/1909805481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 msgr2=0x7fb004152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.050+0000 7fb00b800640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb004152e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faffc009e50 tx=0x7faffc02be40 comp rx=0 tx=0).stop 2024-03-08T20:29:49.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 -- 172.21.15.118:0/1909805481 shutdown_connections 2024-03-08T20:29:49.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb004152e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 --2- 172.21.15.118:0/1909805481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406af80 0x7fb00406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 -- 172.21.15.118:0/1909805481 >> 172.21.15.118:0/1909805481 conn(0x7fb0040a84c0 msgr2=0x7fb0040a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:49.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 -- 172.21.15.118:0/1909805481 shutdown_connections 2024-03-08T20:29:49.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.051+0000 7fb00b800640 1 -- 172.21.15.118:0/1909805481 wait complete. 2024-03-08T20:29:49.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.052+0000 7fb00b800640 1 Processor -- start 2024-03-08T20:29:49.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.052+0000 7fb00b800640 1 -- start start 2024-03-08T20:29:49.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 0x7fb0040bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 0x7fb0040c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00406b4e0 con 0x7fb0041505e0 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00406b360 con 0x7fb00406af80 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.053+0000 7fb00b800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb004153350 con 0x7fb00406ebd0 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59348/0 (socket says 172.21.15.118:59348) 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 -- 172.21.15.118:0/2769469576 learned_addr learned my addr 172.21.15.118:0/2769469576 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb008e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 0x7fb0040bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 -- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 msgr2=0x7fb0040c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb003e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 0x7fb0040c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 0x7fb0040c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 -- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 msgr2=0x7fb0040bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 0x7fb0040bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 -- 172.21.15.118:0/2769469576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040bbc20 con 0x7fb0041505e0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb008e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 0x7fb0040bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb003e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 0x7fb0040c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.054+0000 7fb009800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faffc009e50 tx=0x7faffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.055+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc044020 con 0x7fb0041505e0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.055+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc040690 con 0x7fb0041505e0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.055+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0040bbf00 con 0x7fb0041505e0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.055+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc009510 con 0x7fb0041505e0 2024-03-08T20:29:49.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.055+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0040c6c30 con 0x7fb0041505e0 2024-03-08T20:29:49.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.056+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040c5ce0 con 0x7fb0041505e0 2024-03-08T20:29:49.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.057+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faffc047020 con 0x7fb0041505e0 2024-03-08T20:29:49.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.058+0000 7fb000c00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 0x7fafe406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.058+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faffc0ad870 con 0x7fb0041505e0 2024-03-08T20:29:49.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.058+0000 7fb008e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 0x7fafe406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.058+0000 7fb008e00640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 0x7fafe406e090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faff8006fd0 tx=0x7faff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.062+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faffc04e030 con 0x7fb0041505e0 2024-03-08T20:29:49.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.260+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb004074a40 con 0x7fb0041505e0 2024-03-08T20:29:49.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.264+0000 7fb000c00640 1 -- 172.21.15.118:0/2769469576 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7faffc07c0b0 con 0x7fb0041505e0 2024-03-08T20:29:49.264 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:49.264 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:49.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.266+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 msgr2=0x7fafe406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.266+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 0x7fafe406e090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faff8006fd0 tx=0x7faff8008040 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.266+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 msgr2=0x7fb0040bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.266+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faffc009e50 tx=0x7faffc004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 shutdown_connections 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fafe406bbd0 0x7fafe406e090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0041505e0 0x7fb0040bfef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb00406ebd0 0x7fb0040c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 --2- 172.21.15.118:0/2769469576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb00406af80 0x7fb0040bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 >> 172.21.15.118:0/2769469576 conn(0x7fb0040a84c0 msgr2=0x7fb0040a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 shutdown_connections 2024-03-08T20:29:49.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.267+0000 7fb00b800640 1 -- 172.21.15.118:0/2769469576 wait complete. 2024-03-08T20:29:49.285 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-08T20:29:49.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:49.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.495+0000 7f4369600640 1 Processor -- start 2024-03-08T20:29:49.495 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.495+0000 7f4369600640 1 -- start start 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.496+0000 7f4369600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f43640bde30 0x7f43640c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.496+0000 7f4369600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4364155e20 con 0x7f43640c5120 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.496+0000 7f4369600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640c72c0 con 0x7f43640c8730 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.496+0000 7f4369600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640c75a0 con 0x7f43640bde30 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4362a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f43640c5120 0x7f436406c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:47912/0 (socket says 172.21.15.118:47912) 2024-03-08T20:29:49.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4362a00640 1 -- 172.21.15.118:0/771873114 learned_addr learned my addr 172.21.15.118:0/771873114 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:49.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4363400640 1 --2- 172.21.15.118:0/771873114 >> v2:172.21.15.144:3300/0 conn(0x7f43640bde30 0x7f43640c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517445552 0 0) 0x7f4364155e20 con 0x7f43640c5120 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4344003520 con 0x7f43640c5120 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615851172 0 0) 0x7f4344003520 con 0x7f43640c5120 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 >> v2:172.21.15.144:3300/0 conn(0x7f43640bde30 msgr2=0x7f43640c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.497+0000 7f4361600640 1 --2- 172.21.15.118:0/771873114 >> v2:172.21.15.144:3300/0 conn(0x7f43640bde30 0x7f43640c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 >> v1:172.21.15.144:6789/0 conn(0x7f43640c8730 legacy=0x7f436406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640c7880 con 0x7f43640c5120 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f4354001670 con 0x7f43640c5120 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 >> v1:172.21.15.118:6789/0 conn(0x7f43640c5120 legacy=0x7f436406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440039b0 0x7f4344003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4344004800 0x7f4344004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 0x7f434400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c75a0 con 0x7f43440051c0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434400c160 con 0x7f4344004800 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434400c360 con 0x7f43440039b0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 0x7f434400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4362000640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4344004800 0x7f4344004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4362a00640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440039b0 0x7f4344003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 -- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440039b0 msgr2=0x7f4344003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440039b0 0x7f4344003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 -- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4344004800 msgr2=0x7f4344004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4344004800 0x7f4344004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.498+0000 7f4363400640 1 -- 172.21.15.118:0/771873114 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344003520 con 0x7f43440051c0 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.499+0000 7f4363400640 1 -- 172.21.15.118:0/771873114 reap_dead start 2024-03-08T20:29:49.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.499+0000 7f4363400640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 0x7f434400b9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ac0 tx=0x7f4344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187914930887863f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c009690 con 0x7f43440051c0 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c004020 con 0x7f43440051c0 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4361600640 1 -- 172.21.15.118:0/771873114 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c004410 con 0x7f43440051c0 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 -- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 msgr2=0x7f434400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 0x7f434400b9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f435c009ac0 tx=0x7f4344005830 comp rx=0 tx=0).stop 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 -- 172.21.15.118:0/771873114 shutdown_connections 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 --2- 172.21.15.118:0/771873114 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f43440051c0 0x7f434400b9c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 -- 172.21.15.118:0/771873114 >> 172.21.15.118:0/771873114 conn(0x7f4364072cc0 msgr2=0x7f43640ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.500+0000 7f4369600640 1 -- 172.21.15.118:0/771873114 shutdown_connections 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.501+0000 7f4369600640 1 -- 172.21.15.118:0/771873114 wait complete. 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.502+0000 7f4369600640 1 Processor -- start 2024-03-08T20:29:49.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.502+0000 7f4369600640 1 -- start start 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 0x7f43640abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43641450c0 0x7f43641472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4364155a30 con 0x7f4364145730 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43641558b0 con 0x7f43641450c0 2024-03-08T20:29:49.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.503+0000 7f4369600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4364155bb0 con 0x7f43440051c0 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59372/0 (socket says 172.21.15.118:59372) 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 -- 172.21.15.118:0/1401306690 learned_addr learned my addr 172.21.15.118:0/1401306690 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362a00640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 0x7f43640abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4363400640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43641450c0 0x7f43641472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 -- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 msgr2=0x7f43640abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 0x7f43640abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 -- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43641450c0 msgr2=0x7f43641472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43641450c0 0x7f43641472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 -- 172.21.15.118:0/1401306690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436414f460 con 0x7f4364145730 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362a00640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 0x7f43640abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:49.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.504+0000 7f4362000640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f434c00e850 tx=0x7f434c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.505+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c003b80 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.505+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c018070 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.505+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0050d0 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.505+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4364145540 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.505+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436414ed30 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.506+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4364153df0 con 0x7f4364145730 2024-03-08T20:29:49.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.507+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f434c005270 con 0x7f4364145730 2024-03-08T20:29:49.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.508+0000 7f435aa00640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 0x7f434006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:49.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.508+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f434c08acc0 con 0x7f4364145730 2024-03-08T20:29:49.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.508+0000 7f4362a00640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 0x7f434006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:49.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.509+0000 7f4362a00640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 0x7f434006e0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4354001200 tx=0x7f4354009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:49.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.513+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4364153df0 con 0x7f4364145730 2024-03-08T20:29:49.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.711+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4364074a40 con 0x7f4364145730 2024-03-08T20:29:49.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.714+0000 7f435aa00640 1 -- 172.21.15.118:0/1401306690 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f434c059480 con 0x7f4364145730 2024-03-08T20:29:49.714 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:49.714 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 msgr2=0x7f434006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 0x7f434006e0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4354001200 tx=0x7f4354009040 comp rx=0 tx=0).stop 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 msgr2=0x7f4364144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f434c00e850 tx=0x7f434c00ed10 comp rx=0 tx=0).stop 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 shutdown_connections 2024-03-08T20:29:49.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f434006bc00 0x7f434006e0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43641450c0 0x7f43641472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4364145730 0x7f4364144b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 --2- 172.21.15.118:0/1401306690 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43440051c0 0x7f43640abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 >> 172.21.15.118:0/1401306690 conn(0x7f4364072cc0 msgr2=0x7f43640cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 shutdown_connections 2024-03-08T20:29:49.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:49.717+0000 7f4369600640 1 -- 172.21.15.118:0/1401306690 wait complete. 2024-03-08T20:29:49.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-08T20:29:49.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-08T20:29:49.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-08T20:29:49.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-08T20:29:49.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-08T20:29:49.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-08T20:29:49.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-08T20:29:49.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-08T20:29:50.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.036+0000 7f1d89600640 1 Processor -- start 2024-03-08T20:29:50.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.037+0000 7f1d89600640 1 -- start start 2024-03-08T20:29:50.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.039+0000 7f1d89600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.039+0000 7f1d89600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 0x7f1d7c00ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.039+0000 7f1d89600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c00bb50 con 0x7f1d7c0df180 2024-03-08T20:29:50.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.039+0000 7f1d89600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c00a420 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.039+0000 7f1d89600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c048060 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.040+0000 7f2504c00640 1 Processor -- start 2024-03-08T20:29:50.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.040+0000 7f1d88c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 0x7f1d7c00ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.040+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.040+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48250/0 (socket says 172.21.15.118:48250) 2024-03-08T20:29:50.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.040+0000 7f1d83e00640 1 -- 172.21.15.118:0/693728469 learned_addr learned my addr 172.21.15.118:0/693728469 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.041+0000 7f1d83e00640 1 -- 172.21.15.118:0/693728469 >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 msgr2=0x7f1d7c00ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.041+0000 7f1d83e00640 1 --2- 172.21.15.118:0/693728469 >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 0x7f1d7c00ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.042+0000 7f1d83e00640 1 -- 172.21.15.118:0/693728469 >> v1:172.21.15.144:6789/0 conn(0x7f1d7c0df180 legacy=0x7f1d7c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.042+0000 7f1d83e00640 1 -- 172.21.15.118:0/693728469 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c00a0f0 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.041+0000 7f2504c00640 1 -- start start 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f2504c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 0x7f2500151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f2504c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f25001524e0 0x7f2500154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f2504c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000c5840 con 0x7f25000c8950 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f2504c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2500152900 con 0x7f25001524e0 2024-03-08T20:29:50.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f2504c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2500158430 con 0x7f250006d780 2024-03-08T20:29:50.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.043+0000 7f1d88c00640 1 --2- 172.21.15.118:0/693728469 >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 0x7f1d7c00ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:50.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.044+0000 7f24fde00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f25000c8950 0x7f25000c4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57860/0 (socket says 172.21.15.118:57860) 2024-03-08T20:29:50.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.044+0000 7f24fde00640 1 -- 172.21.15.118:0/2037839206 learned_addr learned my addr 172.21.15.118:0/2037839206 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.044+0000 7f1d83e00640 1 --2- 172.21.15.118:0/693728469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d7802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5623d78d3ddc949 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.044+0000 7f24fd400640 1 --2- 172.21.15.118:0/2037839206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 0x7f2500151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.044+0000 7f24fe800640 1 --2- 172.21.15.118:0/2037839206 >> v2:172.21.15.144:3300/0 conn(0x7f25001524e0 0x7f2500154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.045+0000 7f1d82a00640 1 -- 172.21.15.118:0/693728469 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78035020 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.045+0000 7f1d82a00640 1 -- 172.21.15.118:0/693728469 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78031890 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.045+0000 7f1d82a00640 1 -- 172.21.15.118:0/693728469 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78031ca0 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.045+0000 7f24fca00640 1 -- 172.21.15.118:0/2037839206 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570981353 0 0) 0x7f25000c5840 con 0x7f25000c8950 2024-03-08T20:29:50.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.045+0000 7f24fca00640 1 -- 172.21.15.118:0/2037839206 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e4003520 con 0x7f25000c8950 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 -- 172.21.15.118:0/693728469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 msgr2=0x7f1d7c0474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 --2- 172.21.15.118:0/693728469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009870 tx=0x7f1d7802b930 comp rx=0 tx=0).stop 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 -- 172.21.15.118:0/693728469 shutdown_connections 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 --2- 172.21.15.118:0/693728469 >> v2:172.21.15.144:3300/0 conn(0x7f1d7c00a8b0 0x7f1d7c00ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 --2- 172.21.15.118:0/693728469 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0474a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f1d89600640 1 -- 172.21.15.118:0/693728469 >> 172.21.15.118:0/693728469 conn(0x7f1d7c048250 msgr2=0x7f1d7c048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f24fd400640 1 -- 172.21.15.118:0/2037839206 >> v2:172.21.15.144:3300/0 conn(0x7f25001524e0 msgr2=0x7f2500154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f24fd400640 1 --2- 172.21.15.118:0/2037839206 >> v2:172.21.15.144:3300/0 conn(0x7f25001524e0 0x7f2500154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f24fd400640 1 -- 172.21.15.118:0/2037839206 >> v1:172.21.15.118:6789/0 conn(0x7f25000c8950 legacy=0x7f25000c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.046+0000 7f24fd400640 1 -- 172.21.15.118:0/2037839206 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500158710 con 0x7f250006d780 2024-03-08T20:29:50.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.048+0000 7f1d89600640 1 -- 172.21.15.118:0/693728469 shutdown_connections 2024-03-08T20:29:50.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.048+0000 7f24fd400640 1 --2- 172.21.15.118:0/2037839206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 0x7f2500151fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0097a0 tx=0x7f24ec02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e49ba7c5bbef464 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.048+0000 7f1d89600640 1 -- 172.21.15.118:0/693728469 wait complete. 2024-03-08T20:29:50.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.049+0000 7f24fca00640 1 -- 172.21.15.118:0/2037839206 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec039070 con 0x7f250006d780 2024-03-08T20:29:50.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.050+0000 7f24fca00640 1 -- 172.21.15.118:0/2037839206 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec0316f0 con 0x7f250006d780 2024-03-08T20:29:50.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.050+0000 7f24fca00640 1 -- 172.21.15.118:0/2037839206 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec031ac0 con 0x7f250006d780 2024-03-08T20:29:50.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.050+0000 7f407d400640 1 Processor -- start 2024-03-08T20:29:50.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.050+0000 7f407d400640 1 -- start start 2024-03-08T20:29:50.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.050+0000 7f1d89600640 1 Processor -- start 2024-03-08T20:29:50.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.051+0000 7f1d89600640 1 -- start start 2024-03-08T20:29:50.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.051+0000 7f2504c00640 1 -- 172.21.15.118:0/2037839206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 msgr2=0x7f2500151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.051+0000 7f2504c00640 1 --2- 172.21.15.118:0/2037839206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 0x7f2500151fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0097a0 tx=0x7f24ec02b790 comp rx=0 tx=0).stop 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 -- 172.21.15.118:0/2037839206 shutdown_connections 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f407d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40780a7810 0x7f407806be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f407d400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407806de60 con 0x7f40780715b0 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f407d400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407815a010 con 0x7f4078159470 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f407d400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407815d940 con 0x7f40780a7810 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 --2- 172.21.15.118:0/2037839206 >> v2:172.21.15.144:3300/0 conn(0x7f25001524e0 0x7f2500154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 --2- 172.21.15.118:0/2037839206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f250006d780 0x7f2500151fa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.051+0000 7fda8d200640 1 Processor -- start 2024-03-08T20:29:50.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 -- 172.21.15.118:0/2037839206 >> 172.21.15.118:0/2037839206 conn(0x7f25000ac370 msgr2=0x7f25000ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f1d89600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c00a8b0 0x7f1d7c0dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f09cec00640 1 Processor -- start 2024-03-08T20:29:50.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7fed01600640 1 Processor -- start 2024-03-08T20:29:50.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f1d89600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0d4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f1d89600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d7c0df180 0x7f1d7c0d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f4075e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40780a7810 0x7f407806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f4075e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40780a7810 0x7f407806be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56806/0 (socket says 172.21.15.118:56806) 2024-03-08T20:29:50.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f4075e00640 1 -- 172.21.15.118:0/450157287 learned_addr learned my addr 172.21.15.118:0/450157287 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f09cec00640 1 -- start start 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f1d89600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c00b240 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f1d89600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c047d80 con 0x7f1d7c0df180 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f1d89600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0dc0c0 con 0x7f1d7c0dbce0 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f1d83e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c00a8b0 0x7f1d7c0dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.051+0000 7fda8d200640 1 -- start start 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7fda8d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda8808a4a0 0x7fda8815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7fda8d200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8806ea30 con 0x7fda880c10d0 2024-03-08T20:29:50.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7fda8d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda881603d0 con 0x7fda8815ff60 2024-03-08T20:29:50.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7fda8d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda88165f10 con 0x7fda8808a4a0 2024-03-08T20:29:50.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f4075e00640 1 -- 172.21.15.118:0/450157287 >> v1:172.21.15.144:6789/0 conn(0x7f4078159470 legacy=0x7f4078159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f4075e00640 1 -- 172.21.15.118:0/450157287 >> v1:172.21.15.118:6789/0 conn(0x7f40780715b0 legacy=0x7f40780ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f4075e00640 1 -- 172.21.15.118:0/450157287 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407806c520 con 0x7f40780a7810 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7f1d88c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d7c0df180 0x7f1d7c0d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f1d83400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f1d83400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0d4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48262/0 (socket says 172.21.15.118:48262) 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7f1d83400640 1 -- 172.21.15.118:0/1720091867 learned_addr learned my addr 172.21.15.118:0/1720091867 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7fda86a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda8808a4a0 0x7fda8815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7fda87e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fda8815ff60 0x7fda88164fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:52312/0 (socket says 172.21.15.118:52312) 2024-03-08T20:29:50.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.054+0000 7fda87e00640 1 -- 172.21.15.118:0/3814926622 learned_addr learned my addr 172.21.15.118:0/3814926622 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.053+0000 7fed01600640 1 -- start start 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f1d83e00640 1 -- 172.21.15.118:0/1720091867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 msgr2=0x7f1d7c0d4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f1d83e00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1d7c0dbce0 0x7f1d7c0d4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f1d83e00640 1 -- 172.21.15.118:0/1720091867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d7c0df180 msgr2=0x7f1d7c0d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f1d83e00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d7c0df180 0x7f1d7c0d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f1d83e00640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0d5760 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 -- 172.21.15.118:0/2037839206 shutdown_connections 2024-03-08T20:29:50.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.052+0000 7f2504c00640 1 -- 172.21.15.118:0/2037839206 wait complete. 2024-03-08T20:29:50.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f09cec00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 0x7f09c80c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f09cec00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09c8154a60 0x7f09c8154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f2504c00640 1 Processor -- start 2024-03-08T20:29:50.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f09cec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c80c15c0 con 0x7f09c80c5d70 2024-03-08T20:29:50.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f2504c00640 1 -- start start 2024-03-08T20:29:50.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f09cec00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c8155410 con 0x7f09c8154a60 2024-03-08T20:29:50.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7f09cec00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80c18a0 con 0x7f09c814e6e0 2024-03-08T20:29:50.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7fda86a00640 1 -- 172.21.15.118:0/3814926622 >> v1:172.21.15.144:6789/0 conn(0x7fda8815ff60 legacy=0x7fda88164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7fda86a00640 1 -- 172.21.15.118:0/3814926622 >> v1:172.21.15.118:6789/0 conn(0x7fda880c10d0 legacy=0x7fda8815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.055+0000 7fda86a00640 1 -- 172.21.15.118:0/3814926622 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88071c60 con 0x7fda8808a4a0 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.056+0000 7f09ccc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09c8154a60 0x7f09c8154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.056+0000 7f09ccc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f09c8154a60 0x7f09c8154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56740/0 (socket says 172.21.15.118:56740) 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.056+0000 7f09ccc00640 1 -- 172.21.15.118:0/237483594 learned_addr learned my addr 172.21.15.118:0/237483594 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.056+0000 7f09ccc00640 1 -- 172.21.15.118:0/237483594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 msgr2=0x7f09c80c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.056+0000 7f09c7e00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 0x7f09c80c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f09ccc00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 0x7f09c80c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f09ccc00640 1 -- 172.21.15.118:0/237483594 >> v1:172.21.15.144:6789/0 conn(0x7f09c80c5d70 legacy=0x7f09c80c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f09ccc00640 1 -- 172.21.15.118:0/237483594 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c80c1b80 con 0x7f09c8154a60 2024-03-08T20:29:50.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f09c7e00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 0x7f09c80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:50.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed01600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fecfc0c6530 0x7fecfc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed01600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fecfc159bb0 0x7fecfc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed01600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc15abf0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed01600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc159720 con 0x7fecfc159bb0 2024-03-08T20:29:50.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed01600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0a9a40 con 0x7fecfc0c6530 2024-03-08T20:29:50.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f2504c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250006d780 0x7f25000afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f2504c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25000c8950 0x7f2500147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f4075e00640 1 --2- 172.21.15.118:0/450157287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40780a7810 0x7f407806be20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4064009870 tx=0x7f406402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2b2166b48fcecf server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7f1d83e00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c00a8b0 0x7f1d7c0dfd60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0de740 tx=0x7f1d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f24fde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250006d780 0x7f25000afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fecfb400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fecfc0c0d30 0x7fecfc06e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57892/0 (socket says 172.21.15.118:57892) 2024-03-08T20:29:50.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fecfb400640 1 -- 172.21.15.118:0/1397666096 learned_addr learned my addr 172.21.15.118:0/1397666096 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.057+0000 7fed00c00640 1 --2- 172.21.15.118:0/1397666096 >> v2:172.21.15.118:3300/0 conn(0x7fecfc159bb0 0x7fecfc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fecfbe00640 1 --2- 172.21.15.118:0/1397666096 >> v2:172.21.15.144:3300/0 conn(0x7fecfc0c6530 0x7fecfc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f2504c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25001524e0 0x7f25001edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f24fde00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250006d780 0x7f25000afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56750/0 (socket says 172.21.15.118:56750) 2024-03-08T20:29:50.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f24fd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25000c8950 0x7f2500147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f2504c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25001591f0 con 0x7f250006d780 2024-03-08T20:29:50.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f4075400640 1 -- 172.21.15.118:0/450157287 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064035020 con 0x7f40780a7810 2024-03-08T20:29:50.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f2504c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2500158cd0 con 0x7f25000c8950 2024-03-08T20:29:50.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f4075400640 1 -- 172.21.15.118:0/450157287 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064031870 con 0x7f40780a7810 2024-03-08T20:29:50.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f4075400640 1 -- 172.21.15.118:0/450157287 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064035020 con 0x7f40780a7810 2024-03-08T20:29:50.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fda86a00640 1 --2- 172.21.15.118:0/3814926622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8808a4a0 0x7fda8815fa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda740097a0 tx=0x7fda7402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c979a54b7cd2f16 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f24fde00640 1 -- 172.21.15.118:0/2690423732 learned_addr learned my addr 172.21.15.118:0/2690423732 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7f24fe800640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25001524e0 0x7f25001edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f7da4600640 1 Processor -- start 2024-03-08T20:29:50.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78040070 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78030d20 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78035040 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0d5480 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250014dd70 con 0x7f25001524e0 2024-03-08T20:29:50.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c0e02a0 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d7c0df5c0 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f24fe800640 1 -- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25000c8950 msgr2=0x7f2500147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f24fe800640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25000c8950 0x7f2500147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f24fe800640 1 -- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250006d780 msgr2=0x7f25000afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f24fe800640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f250006d780 0x7f25000afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f24fe800640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250014dfc0 con 0x7f25001524e0 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f24fe800640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25001524e0 0x7f25001edcd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009ea0 tx=0x7f24f0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.071 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f407d400640 1 -- 172.21.15.118:0/450157287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40780a7810 msgr2=0x7f407806be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f407d400640 1 --2- 172.21.15.118:0/450157287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40780a7810 0x7f407806be20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4064009870 tx=0x7f406402b910 comp rx=0 tx=0).stop 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f407d400640 1 -- 172.21.15.118:0/450157287 shutdown_connections 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f407d400640 1 --2- 172.21.15.118:0/450157287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40780a7810 0x7f407806be20 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4064009870 tx=0x7f406402b910 comp rx=0 tx=0).stop 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f407d400640 1 -- 172.21.15.118:0/450157287 >> 172.21.15.118:0/450157287 conn(0x7f40780aa290 msgr2=0x7f40780aa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f407d400640 1 -- 172.21.15.118:0/450157287 shutdown_connections 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7f407d400640 1 -- 172.21.15.118:0/450157287 wait complete. 2024-03-08T20:29:50.072 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f09ccc00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c8154ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09c80710c0 tx=0x7f09c002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfb8f90512ecfa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fecfaa00640 1 -- 172.21.15.118:0/1397666096 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283900874 0 0) 0x7fecfc15abf0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fed00c00640 1 -- 172.21.15.118:0/1397666096 >> v2:172.21.15.144:3300/0 conn(0x7fecfc0c6530 msgr2=0x7fecfc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7fed00c00640 1 --2- 172.21.15.118:0/1397666096 >> v2:172.21.15.144:3300/0 conn(0x7fecfc0c6530 0x7fecfc15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7fed00c00640 1 -- 172.21.15.118:0/1397666096 >> v1:172.21.15.118:6789/0 conn(0x7fecfc0c0d30 legacy=0x7fecfc06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7fed00c00640 1 -- 172.21.15.118:0/1397666096 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0a9480 con 0x7fecfc159bb0 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0024070 con 0x7f25001524e0 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f0017a50 con 0x7f25001524e0 2024-03-08T20:29:50.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000c730 con 0x7f25001524e0 2024-03-08T20:29:50.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.059+0000 7f7da4600640 1 -- start start 2024-03-08T20:29:50.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f09c6a00640 1 -- 172.21.15.118:0/237483594 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c002c9c0 con 0x7f09c8154a60 2024-03-08T20:29:50.074 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7fed00c00640 1 --2- 172.21.15.118:0/1397666096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc159bb0 0x7fecfc1563f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06e330 tx=0x7fece802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55365a1271cededa server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da4600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f09c6a00640 1 -- 172.21.15.118:0/237483594 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c002cb60 con 0x7f09c8154a60 2024-03-08T20:29:50.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da4600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d9c0a5780 0x7f7d9c0c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fda86000640 1 -- 172.21.15.118:0/3814926622 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74035020 con 0x7fda8808a4a0 2024-03-08T20:29:50.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fda86000640 1 -- 172.21.15.118:0/3814926622 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda74031830 con 0x7fda8808a4a0 2024-03-08T20:29:50.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.058+0000 7fda86000640 1 -- 172.21.15.118:0/3814926622 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74031c00 con 0x7fda8808a4a0 2024-03-08T20:29:50.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7fda8d200640 1 -- 172.21.15.118:0/3814926622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8808a4a0 msgr2=0x7fda8815fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7fda8d200640 1 --2- 172.21.15.118:0/3814926622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8808a4a0 0x7fda8815fa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda740097a0 tx=0x7fda7402b8d0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000ae2a0 con 0x7f25001524e0 2024-03-08T20:29:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f407d400640 1 Processor -- start 2024-03-08T20:29:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7fecfaa00640 1 -- 172.21.15.118:0/1397666096 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80317c0 con 0x7fecfc159bb0 2024-03-08T20:29:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7fecfaa00640 1 -- 172.21.15.118:0/1397666096 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8037070 con 0x7fecfc159bb0 2024-03-08T20:29:50.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7fecfaa00640 1 -- 172.21.15.118:0/1397666096 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8031b80 con 0x7fecfc159bb0 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7fda8d200640 1 -- 172.21.15.118:0/3814926622 shutdown_connections 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7fda8d200640 1 --2- 172.21.15.118:0/3814926622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda8808a4a0 0x7fda8815fa20 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda740097a0 tx=0x7fda7402b8d0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.060+0000 7fda8d200640 1 -- 172.21.15.118:0/3814926622 >> 172.21.15.118:0/3814926622 conn(0x7fda8806ad10 msgr2=0x7fda8806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7fda8d200640 1 -- 172.21.15.118:0/3814926622 shutdown_connections 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7fda8d200640 1 -- 172.21.15.118:0/3814926622 wait complete. 2024-03-08T20:29:50.078 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f407d400640 1 -- start start 2024-03-08T20:29:50.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da4600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0c46a0 con 0x7f7d9c06d620 2024-03-08T20:29:50.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da4600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c4fb0 con 0x7f7d9c0a5780 2024-03-08T20:29:50.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2500148100 con 0x7f25001524e0 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da4600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c6280 con 0x7f7d9c0c3010 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da1c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da1c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48294/0 (socket says 172.21.15.118:48294) 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.061+0000 7f7da1c00640 1 -- 172.21.15.118:0/171981340 learned_addr learned my addr 172.21.15.118:0/171981340 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f7da1c00640 1 -- 172.21.15.118:0/171981340 >> v2:172.21.15.118:3300/0 conn(0x7f7d9c0a5780 msgr2=0x7f7d9c0c33f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f7da1c00640 1 --2- 172.21.15.118:0/171981340 >> v2:172.21.15.118:3300/0 conn(0x7f7d9c0a5780 0x7f7d9c0c33f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f7da1c00640 1 -- 172.21.15.118:0/171981340 >> v1:172.21.15.118:6789/0 conn(0x7f7d9c06d620 legacy=0x7f7d9c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f7da1c00640 1 -- 172.21.15.118:0/171981340 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0c4960 con 0x7f7d9c0c3010 2024-03-08T20:29:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.062+0000 7f09c6a00640 1 -- 172.21.15.118:0/237483594 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c00343f0 con 0x7f09c8154a60 2024-03-08T20:29:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f09cec00640 1 -- 172.21.15.118:0/237483594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 msgr2=0x7f09c8154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.081 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f09cec00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c8154ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09c80710c0 tx=0x7f09c002be20 comp rx=0 tx=0).stop 2024-03-08T20:29:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f09cec00640 1 -- 172.21.15.118:0/237483594 shutdown_connections 2024-03-08T20:29:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40780715b0 0x7f40780a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f09cec00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c8154ed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f09cec00640 1 --2- 172.21.15.118:0/237483594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c814e6e0 0x7f09c80c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.082 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f09cec00640 1 -- 172.21.15.118:0/237483594 >> 172.21.15.118:0/237483594 conn(0x7f09c80c6580 msgr2=0x7f09c80c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 0x7f40781e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40781e31f0 0x7f40781e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407815ce60 con 0x7f4078159470 2024-03-08T20:29:50.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407815d4b0 con 0x7f40781e31f0 2024-03-08T20:29:50.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f407d400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407815d140 con 0x7f40780715b0 2024-03-08T20:29:50.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25000ae8f0 con 0x7f25001524e0 2024-03-08T20:29:50.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7fed01600640 1 -- 172.21.15.118:0/1397666096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc159bb0 msgr2=0x7fecfc1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7fed01600640 1 --2- 172.21.15.118:0/1397666096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc159bb0 0x7fecfc1563f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecfc06e330 tx=0x7fece802b860 comp rx=0 tx=0).stop 2024-03-08T20:29:50.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f7da1c00640 1 --2- 172.21.15.118:0/171981340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009e50 tx=0x7f7d9402be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b3d2307e8c4cbb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f09cec00640 1 -- 172.21.15.118:0/237483594 shutdown_connections 2024-03-08T20:29:50.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f4076800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40780715b0 0x7f40780a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f4075e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 0x7f40781e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 -- 172.21.15.118:0/1397666096 shutdown_connections 2024-03-08T20:29:50.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 --2- 172.21.15.118:0/1397666096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc159bb0 0x7fecfc1563f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 --2- 172.21.15.118:0/1397666096 >> v2:172.21.15.144:3300/0 conn(0x7fecfc0c6530 0x7fecfc15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 -- 172.21.15.118:0/1397666096 >> 172.21.15.118:0/1397666096 conn(0x7fecfc06d410 msgr2=0x7fecfc0a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.063+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1d7804b060 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.064+0000 7f1d77e00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1d6406bca0 0x7f1d6406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1d780ad0e0 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f1d77e00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7f1d64075420 0x7f1d64077860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d78031890 con 0x7f1d64075420 2024-03-08T20:29:50.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d780ad4d0 con 0x7f1d7c00a8b0 2024-03-08T20:29:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f4075e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 0x7f40781e4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56762/0 (socket says 172.21.15.118:56762) 2024-03-08T20:29:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f4075e00640 1 -- 172.21.15.118:0/796429530 learned_addr learned my addr 172.21.15.118:0/796429530 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f4077200640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40781e31f0 0x7f40781e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 -- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40780715b0 msgr2=0x7f40780a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40780715b0 0x7f40780a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 -- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40781e31f0 msgr2=0x7f40781e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40781e31f0 0x7f40781e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407815a680 con 0x7f4078159470 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4077200640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40781e31f0 0x7f40781e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7f4075e00640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 0x7f40781e4d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f40640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 -- 172.21.15.118:0/1397666096 shutdown_connections 2024-03-08T20:29:50.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fed01600640 1 -- 172.21.15.118:0/1397666096 wait complete. 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fda8d200640 1 Processor -- start 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7fda8d200640 1 -- start start 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda880c10d0 0x7fda882090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8815ff60 0x7fda880aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 0x7fda880c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda881656c0 con 0x7fda88173380 2024-03-08T20:29:50.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda880717d0 con 0x7fda880c10d0 2024-03-08T20:29:50.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.066+0000 7fda8d200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda88165840 con 0x7fda8815ff60 2024-03-08T20:29:50.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064035050 con 0x7f4078159470 2024-03-08T20:29:50.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064003a20 con 0x7f4078159470 2024-03-08T20:29:50.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064003e10 con 0x7f4078159470 2024-03-08T20:29:50.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407815bde0 con 0x7f4078159470 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7fda87e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 0x7fda880c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7fda87400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda880c10d0 0x7fda882090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7fda87e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 0x7fda880c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56776/0 (socket says 172.21.15.118:56776) 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7fda87e00640 1 -- 172.21.15.118:0/2362025357 learned_addr learned my addr 172.21.15.118:0/2362025357 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7fda86a00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8815ff60 0x7fda880aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f7d9be00640 1 -- 172.21.15.118:0/171981340 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9402ca10 con 0x7f7d9c0c3010 2024-03-08T20:29:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f7d9be00640 1 -- 172.21.15.118:0/171981340 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9402cbb0 con 0x7f7d9c0c3010 2024-03-08T20:29:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f7d9be00640 1 -- 172.21.15.118:0/171981340 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940343f0 con 0x7f7d9c0c3010 2024-03-08T20:29:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407815c3a0 con 0x7f4078159470 2024-03-08T20:29:50.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fed01600640 1 Processor -- start 2024-03-08T20:29:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fda87e00640 1 -- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8815ff60 msgr2=0x7fda880aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fda87e00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda8815ff60 0x7fda880aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7f1d83400640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1d6406bca0 0x7f1d6406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fda87e00640 1 -- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda880c10d0 msgr2=0x7fda882090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fda87e00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda880c10d0 0x7fda882090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7f7da4600640 1 -- 172.21.15.118:0/171981340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 msgr2=0x7f7d9c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7fed01600640 1 -- start start 2024-03-08T20:29:50.095 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7f7da4600640 1 --2- 172.21.15.118:0/171981340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009e50 tx=0x7f7d9402be70 comp rx=0 tx=0).stop 2024-03-08T20:29:50.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7fda87e00640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda881627c0 con 0x7fda88173380 2024-03-08T20:29:50.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.068+0000 7f1d88c00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7f1d64075420 0x7f1d64077860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.065+0000 7f09cec00640 1 -- 172.21.15.118:0/237483594 wait complete. 2024-03-08T20:29:50.096 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.067+0000 7f09cec00640 1 Processor -- start 2024-03-08T20:29:50.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f7da4600640 1 -- 172.21.15.118:0/171981340 shutdown_connections 2024-03-08T20:29:50.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7fda87e00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 0x7fda880c5a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c9f0 tx=0x7fda7800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f7da4600640 1 --2- 172.21.15.118:0/171981340 >> v2:172.21.15.118:3300/0 conn(0x7f7d9c0a5780 0x7f7d9c0c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f7da4600640 1 --2- 172.21.15.118:0/171981340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0c5ca0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f7da4600640 1 -- 172.21.15.118:0/171981340 >> 172.21.15.118:0/171981340 conn(0x7f7d9c0c6760 msgr2=0x7f7d9c0c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f09cec00640 1 -- start start 2024-03-08T20:29:50.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f7da4600640 1 -- 172.21.15.118:0/171981340 shutdown_connections 2024-03-08T20:29:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78017070 con 0x7fda88173380 2024-03-08T20:29:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7800ab70 con 0x7fda88173380 2024-03-08T20:29:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78012400 con 0x7fda88173380 2024-03-08T20:29:50.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda880a9450 con 0x7fda88173380 2024-03-08T20:29:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.069+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4078074a40 con 0x7f4078159470 2024-03-08T20:29:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7f7da4600640 1 -- 172.21.15.118:0/171981340 wait complete. 2024-03-08T20:29:50.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7f1d88c00640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7f1d64075420 0x7f1d64077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7fed01600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 0x7fecfc153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7fed01600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc0c6530 0x7fecfc149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda880a99f0 con 0x7fda88173380 2024-03-08T20:29:50.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7f1d83400640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1d6406bca0 0x7f1d6406e160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c042670 tx=0x7f1d70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f24f0027070 con 0x7f25001524e0 2024-03-08T20:29:50.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 0x7fecfc153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 0x7fecfc153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56850/0 (socket says 172.21.15.118:56850) 2024-03-08T20:29:50.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fed01600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fecfc159bb0 0x7fecfc14a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fecfbe00640 1 -- 172.21.15.118:0/2599914930 learned_addr learned my addr 172.21.15.118:0/2599914930 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.070+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4064038020 con 0x7f4078159470 2024-03-08T20:29:50.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc15a000 con 0x7fecfc0c6530 2024-03-08T20:29:50.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.071+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1593b0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc15a180 con 0x7fecfc159bb0 2024-03-08T20:29:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda88074a40 con 0x7fda88173380 2024-03-08T20:29:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7fed00c00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fecfc159bb0 0x7fecfc14a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7fecfb400640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc0c6530 0x7fecfc149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7f24f6000640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24e006bca0 0x7f24e006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 -- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fecfc159bb0 msgr2=0x7fecfc14a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== osd.0 v2:172.21.15.118:6800/822956166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1d78031890 con 0x7f1d64075420 2024-03-08T20:29:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fecfc159bb0 0x7fecfc14a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 -- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc0c6530 msgr2=0x7fecfc149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fecfc0c6530 0x7fecfc149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc1ef500 con 0x7fecfc0c0d30 2024-03-08T20:29:50.106 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.072+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f24f0093020 con 0x7f25001524e0 2024-03-08T20:29:50.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fda7801a070 con 0x7fda88173380 2024-03-08T20:29:50.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7f24fde00640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24e006bca0 0x7f24e006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7f09cec00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c80c5d70 0x7f09c81f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7f406ea00640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f405806bbd0 0x7f405806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f40640ad1a0 con 0x7f4078159470 2024-03-08T20:29:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09cec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c814e6e0 0x7f09c8147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f9aabe00640 1 Processor -- start 2024-03-08T20:29:50.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7fecfbe00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 0x7fecfc153070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecec00d800 tx=0x7fecec00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.073+0000 7f24f6000640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7f24e0075410 0x7f24e0077850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09cec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c81f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00b6c0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc0720f0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc1535b0 con 0x7fecfc0c0d30 2024-03-08T20:29:50.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09cec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80c54b0 con 0x7f09c8154a60 2024-03-08T20:29:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09cec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8154540 con 0x7f09c814e6e0 2024-03-08T20:29:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09ccc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c81f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7fda7f400640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda6806bc50 0x7fda6806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f9aabe00640 1 -- start start 2024-03-08T20:29:50.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec019070 con 0x7fecfc0c0d30 2024-03-08T20:29:50.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda7808a8e0 con 0x7fda88173380 2024-03-08T20:29:50.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09cec00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80c5630 con 0x7f09c80c5d70 2024-03-08T20:29:50.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00ba80 con 0x7fecfc0c0d30 2024-03-08T20:29:50.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fda7f400640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7fda680753d0 0x7fda68077810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09ccc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c81f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56792/0 (socket says 172.21.15.118:56792) 2024-03-08T20:29:50.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f09ccc00640 1 -- 172.21.15.118:0/9344222 learned_addr learned my addr 172.21.15.118:0/9344222 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7f09c7400640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c814e6e0 0x7f09c8147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f4076800640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f405806bbd0 0x7f405806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecd4001030 con 0x7fecfc0c0d30 2024-03-08T20:29:50.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda68077ee0 con 0x7fda680753d0 2024-03-08T20:29:50.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda7808f2a0 con 0x7fda88173380 2024-03-08T20:29:50.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7fda87400640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda6806bc50 0x7fda6806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.074+0000 7f24fd400640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7f24e0075410 0x7f24e0077850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.075+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24f0023ec0 con 0x7f24e0075410 2024-03-08T20:29:50.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f7da4600640 1 Processor -- start 2024-03-08T20:29:50.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f0093410 con 0x7f25001524e0 2024-03-08T20:29:50.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f09c7e00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c80c5d70 0x7f09c81f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f24fde00640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24e006bca0 0x7f24e006e160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8005bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f7da4600640 1 -- start start 2024-03-08T20:29:50.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7fda86a00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7fda680753d0 0x7fda68077810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f24fd400640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7f24e0075410 0x7f24e0077850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7fda87400640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda6806bc50 0x7fda6806e110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda80000f60 tx=0x7fda80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aabe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9aa41526e0 0x7f9aa4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aabe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 0x7f9aa41556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aabe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa4159510 con 0x7f9aa40c8bd0 2024-03-08T20:29:50.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aabe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa4155250 con 0x7f9aa41526e0 2024-03-08T20:29:50.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aabe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa40c71d0 con 0x7f9aa40c8750 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d9c06d620 0x7f7d9c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 0x7f7d9c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c06e320 con 0x7f7d9c0a5780 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c06e1a0 con 0x7f7d9c06d620 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f7da4600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0c1a00 con 0x7f7d9c0c3010 2024-03-08T20:29:50.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f9aa9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9aa41526e0 0x7f9aa4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f406ea00640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f4058075230 0x7f4058077670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4058077d40 con 0x7f4058075230 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f4077200640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f4058075230 0x7f4058077670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.076+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40640b4050 con 0x7f4078159470 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.077+0000 7f4076800640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f405806bbd0 0x7f405806e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40780c2bc0 tx=0x7f4070003d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f9aa9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9aa41526e0 0x7f9aa4158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56798/0 (socket says 172.21.15.118:56798) 2024-03-08T20:29:50.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f9aa9400640 1 -- 172.21.15.118:0/659053463 learned_addr learned my addr 172.21.15.118:0/659053463 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f7da1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 0x7f7d9c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f4077200640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f4058075230 0x7f4058077670 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f7da1200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 0x7f7d9c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56804/0 (socket says 172.21.15.118:56804) 2024-03-08T20:29:50.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f7da1200640 1 -- 172.21.15.118:0/619767274 learned_addr learned my addr 172.21.15.118:0/619767274 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f7da2600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== osd.1 v2:172.21.15.118:6808/1158609225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f24f0023ec0 con 0x7f24e0075410 2024-03-08T20:29:50.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f7da1c00640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d9c06d620 0x7f7d9c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.078+0000 7f9aa8a00640 1 --2- 172.21.15.118:0/659053463 >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 0x7f9aa41556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7fda86a00640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7fda680753d0 0x7fda68077810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f9aa9400640 1 -- 172.21.15.118:0/659053463 >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 msgr2=0x7f9aa41556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f9aa9400640 1 --2- 172.21.15.118:0/659053463 >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 0x7f9aa41556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f9aa9400640 1 -- 172.21.15.118:0/659053463 >> v1:172.21.15.118:6789/0 conn(0x7f9aa40c8bd0 legacy=0x7f9aa40c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f7da1200640 1 -- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 msgr2=0x7f7d9c0a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f7da1200640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d9c0c3010 0x7f7d9c0a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f7da1200640 1 -- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d9c06d620 msgr2=0x7f7d9c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f7da1200640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d9c06d620 0x7f7d9c15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f7da1200640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0c0100 con 0x7f7d9c0a5780 2024-03-08T20:29:50.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7f9aa9400640 1 -- 172.21.15.118:0/659053463 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40c74b0 con 0x7f9aa41526e0 2024-03-08T20:29:50.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== osd.2 v2:172.21.15.118:6809/1361206557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4058077d40 con 0x7f4058075230 2024-03-08T20:29:50.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.079+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fecec00bc20 con 0x7fecfc0c0d30 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f9aa8a00640 1 --2- 172.21.15.118:0/659053463 >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 0x7f9aa41556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09ccc00640 1 -- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c80c5d70 msgr2=0x7f09c81f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09ccc00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09c80c5d70 0x7f09c81f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09ccc00640 1 -- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c814e6e0 msgr2=0x7f09c8147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09ccc00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c814e6e0 0x7f09c8147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09ccc00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8146310 con 0x7f09c8154a60 2024-03-08T20:29:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f09c7400640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c814e6e0 0x7f09c8147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.080+0000 7f7da1200640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 0x7f7d9c15d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800b3e0 tx=0x7f7d8800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09ccc00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c81f4520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009e50 tx=0x7f09c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7fecf3e00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecdc06bc00 0x7fecdc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88015020 con 0x7f7d9c0a5780 2024-03-08T20:29:50.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88011850 con 0x7f7d9c0a5780 2024-03-08T20:29:50.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f9aa9400640 1 --2- 172.21.15.118:0/659053463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa41526e0 0x7f9aa4158fd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9aa41553d0 tx=0x7f9a9c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b00ac9a66986c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88011c40 con 0x7f7d9c0a5780 2024-03-08T20:29:50.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0043020 con 0x7f09c8154a60 2024-03-08T20:29:50.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c00094d0 con 0x7f09c8154a60 2024-03-08T20:29:50.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c003e690 con 0x7f09c8154a60 2024-03-08T20:29:50.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c0c03a0 con 0x7f7d9c0a5780 2024-03-08T20:29:50.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c81465f0 con 0x7f09c8154a60 2024-03-08T20:29:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f9aa3e00640 1 -- 172.21.15.118:0/659053463 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c02ca80 con 0x7f9aa41526e0 2024-03-08T20:29:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f9aa3e00640 1 -- 172.21.15.118:0/659053463 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c02cc20 con 0x7f9aa41526e0 2024-03-08T20:29:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c8146bb0 con 0x7f09c8154a60 2024-03-08T20:29:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fecec08bc80 con 0x7fecfc0c0d30 2024-03-08T20:29:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fecfb400640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecdc06bc00 0x7fecdc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fecf3e00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7fecdc075380 0x7fecdc0777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecec00cfb0 con 0x7fecdc075380 2024-03-08T20:29:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecec08c070 con 0x7fecfc0c0d30 2024-03-08T20:29:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.081+0000 7f9aa3e00640 1 -- 172.21.15.118:0/659053463 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0343f0 con 0x7f9aa41526e0 2024-03-08T20:29:50.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c1512c0 con 0x7f7d9c0a5780 2024-03-08T20:29:50.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.083+0000 7f9aabe00640 1 -- 172.21.15.118:0/659053463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa41526e0 msgr2=0x7f9aa4158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.083+0000 7f9aabe00640 1 --2- 172.21.15.118:0/659053463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa41526e0 0x7f9aa4158fd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9aa41553d0 tx=0x7f9a9c02bee0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.083+0000 7fecfb400640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecdc06bc00 0x7fecdc06e0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecfc15c120 tx=0x7fecf4007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.082+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== osd.5 v2:172.21.15.144:6800/4103646837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fda68077ee0 con 0x7fda680753d0 2024-03-08T20:29:50.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7fed00c00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7fecdc075380 0x7fecdc0777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 -- 172.21.15.118:0/659053463 shutdown_connections 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 --2- 172.21.15.118:0/659053463 >> v2:172.21.15.144:3300/0 conn(0x7f9aa40c8750 0x7f9aa41556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 --2- 172.21.15.118:0/659053463 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa41526e0 0x7f9aa4158fd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 -- 172.21.15.118:0/659053463 >> 172.21.15.118:0/659053463 conn(0x7f9aa4072c30 msgr2=0x7f9aa40ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 -- 172.21.15.118:0/659053463 shutdown_connections 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.084+0000 7f9aabe00640 1 -- 172.21.15.118:0/659053463 wait complete. 2024-03-08T20:29:50.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.085+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d9c074a40 con 0x7f7d9c0a5780 2024-03-08T20:29:50.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.086+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09c80bbc90 con 0x7f09c8154a60 2024-03-08T20:29:50.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.086+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7d88018020 con 0x7f7d9c0a5780 2024-03-08T20:29:50.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.086+0000 7fed00c00640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7fecdc075380 0x7fecdc0777c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f09c0046020 con 0x7f09c8154a60 2024-03-08T20:29:50.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f9aabe00640 1 Processor -- start 2024-03-08T20:29:50.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f7d99600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d7c06bca0 0x7f7d7c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7d8808ab40 con 0x7f7d9c0a5780 2024-03-08T20:29:50.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f7d99600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f7d7c075420 0x7f7d7c077860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d88004460 con 0x7f7d7c075420 2024-03-08T20:29:50.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d8808f2a0 con 0x7f7d9c0a5780 2024-03-08T20:29:50.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.088+0000 7f9aabe00640 1 -- start start 2024-03-08T20:29:50.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== osd.4 v2:172.21.15.144:6808/2013996799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fecec00cfb0 con 0x7fecdc075380 2024-03-08T20:29:50.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f7da1c00640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d7c06bca0 0x7f7d7c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f7da2600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f7d7c075420 0x7f7d7c077860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f9aabe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 0x7f9aa41eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f9aabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa40c8bd0 0x7f9aa414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f9aabe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9aa41526e0 0x7f9aa40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aabe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c5850 con 0x7f9aa40c8750 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aabe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c7a70 con 0x7f9aa40c8bd0 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aabe00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c59d0 con 0x7f9aa41526e0 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aa9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 0x7f9aa41eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aa9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 0x7f9aa41eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56812/0 (socket says 172.21.15.118:56812) 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aa9400640 1 -- 172.21.15.118:0/4170861781 learned_addr learned my addr 172.21.15.118:0/4170861781 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aa8a00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa40c8bd0 0x7f9aa414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f09bfe00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09a806bbd0 0x7f09a806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.089+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f09c00ad700 con 0x7f09c8154a60 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f09bfe00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7f09a80752c0 0x7f09a8077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09a8077dd0 con 0x7f09a80752c0 2024-03-08T20:29:50.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f7da1c00640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d7c06bca0 0x7f7d7c06e160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d94035000 tx=0x7f7d94030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.090+0000 7f9aa9e00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9aa41526e0 0x7f9aa40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c00b4050 con 0x7f09c8154a60 2024-03-08T20:29:50.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f09c7e00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09a806bbd0 0x7f09a806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f09c7400640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7f09a80752c0 0x7f09a8077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f9aa9400640 1 -- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9aa41526e0 msgr2=0x7f9aa40ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.147 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f9aa9400640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9aa41526e0 0x7f9aa40ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f9aa9400640 1 -- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa40c8bd0 msgr2=0x7f9aa414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f9aa9400640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9aa40c8bd0 0x7f9aa414b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.091+0000 7f9aa9400640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa41eb310 con 0x7f9aa40c8750 2024-03-08T20:29:50.148 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.092+0000 7f7da2600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f7d7c075420 0x7f7d7c077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.092+0000 7f9aa9400640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 0x7f9aa41eacc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c036040 tx=0x7f9a9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.092+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c043020 con 0x7f9aa40c8750 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.092+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c03e450 con 0x7f9aa40c8750 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.092+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c009510 con 0x7f9aa40c8750 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.093+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa41eb5f0 con 0x7f9aa40c8750 2024-03-08T20:29:50.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.093+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa41ebbb0 con 0x7f9aa40c8750 2024-03-08T20:29:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.093+0000 7f09c7400640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7f09a80752c0 0x7f09a8077700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.094+0000 7f09c7e00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09a806bbd0 0x7f09a806e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09c814e0f0 tx=0x7f09b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.095+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== osd.6 v2:172.21.15.144:6810/1443686898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7d88004460 con 0x7f7d7c075420 2024-03-08T20:29:50.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.095+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== osd.3 v2:172.21.15.118:6824/2572185717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f09a8077dd0 con 0x7f09a80752c0 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.094+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9aa4074a40 con 0x7f9aa40c8750 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.097+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9a9c046020 con 0x7f9aa40c8750 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa1600640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9a8406bc20 0x7f9a8406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9a9c0ad3d0 con 0x7f9aa40c8750 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa1600640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7f9a84075310 0x7f9a84077750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a9c00ae60 con 0x7f9a84075310 2024-03-08T20:29:50.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa8a00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9a8406bc20 0x7f9a8406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.099+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a9c0b4050 con 0x7f9aa40c8750 2024-03-08T20:29:50.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.100+0000 7f9aa9e00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7f9a84075310 0x7f9a84077750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.101+0000 7f9aa8a00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9a8406bc20 0x7f9a8406e0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009560 tx=0x7f9a98009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.101+0000 7f9aa9e00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7f9a84075310 0x7f9a84077750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.104+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== osd.7 v2:172.21.15.144:6824/1313104786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a9c00ae60 con 0x7f9a84075310 2024-03-08T20:29:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.110+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 --> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda8815dee0 con 0x7fda680753d0 2024-03-08T20:29:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.111+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 --> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40780c3410 con 0x7f4058075230 2024-03-08T20:29:50.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.112+0000 7fda7f400640 1 -- 172.21.15.118:0/2362025357 <== osd.5 v2:172.21.15.144:6800/4103646837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda8815dee0 con 0x7fda680753d0 2024-03-08T20:29:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.112+0000 7f406ea00640 1 -- 172.21.15.118:0/796429530 <== osd.2 v2:172.21.15.118:6809/1361206557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40780c3410 con 0x7f4058075230 2024-03-08T20:29:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.112+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7fda680753d0 msgr2=0x7fda68077810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.112+0000 7fda8d200640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7fda680753d0 0x7fda68077810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.155 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 --> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f250014c190 con 0x7f24e0075410 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda6806bc50 msgr2=0x7fda6806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda6806bc50 0x7fda6806e110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fda80000f60 tx=0x7fda80009040 comp rx=0 tx=0).stop 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 msgr2=0x7fda880c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 --2- 172.21.15.118:0/2362025357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda88173380 0x7fda880c5a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c9f0 tx=0x7fda7800ceb0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f4058075230 msgr2=0x7f4058077670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f4058075230 0x7f4058077670 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda87e00640 1 -- 172.21.15.118:0/2362025357 reap_dead start 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 shutdown_connections 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 >> 172.21.15.118:0/2362025357 conn(0x7fda8806ad10 msgr2=0x7fda880c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 shutdown_connections 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f405806bbd0 msgr2=0x7f405806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f405806bbd0 0x7f405806e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f40780c2bc0 tx=0x7f4070003d90 comp rx=0 tx=0).stop 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 msgr2=0x7f40781e4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.157 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.113+0000 7f407d400640 1 --2- 172.21.15.118:0/796429530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4078159470 0x7f40781e4d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f40640046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f4077200640 1 -- 172.21.15.118:0/796429530 reap_dead start 2024-03-08T20:29:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7fda8d200640 1 -- 172.21.15.118:0/2362025357 wait complete. 2024-03-08T20:29:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 --> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d7c005390 con 0x7f1d64075420 2024-03-08T20:29:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 shutdown_connections 2024-03-08T20:29:50.158 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 >> 172.21.15.118:0/796429530 conn(0x7f40780aa290 msgr2=0x7f40780aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f24f6000640 1 -- 172.21.15.118:0/2690423732 <== osd.1 v2:172.21.15.118:6808/1158609225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f250014c190 con 0x7f24e0075410 2024-03-08T20:29:50.159 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 shutdown_connections 2024-03-08T20:29:50.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.114+0000 7f407d400640 1 -- 172.21.15.118:0/796429530 wait complete. 2024-03-08T20:29:50.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7f24e0075410 msgr2=0x7f24e0077850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7f24e0075410 0x7f24e0077850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24e006bca0 msgr2=0x7f24e006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f24e006bca0 0x7f24e006e160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8005bc0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25001524e0 msgr2=0x7f25001edcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 --2- 172.21.15.118:0/2690423732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25001524e0 0x7f25001edcd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009ea0 tx=0x7f24f0009f90 comp rx=0 tx=0).stop 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f24fe800640 1 -- 172.21.15.118:0/2690423732 reap_dead start 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f1d77e00640 1 -- 172.21.15.118:0/1720091867 <== osd.0 v2:172.21.15.118:6800/822956166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d7c005390 con 0x7f1d64075420 2024-03-08T20:29:50.161 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 shutdown_connections 2024-03-08T20:29:50.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.115+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 >> 172.21.15.118:0/2690423732 conn(0x7f25000ac370 msgr2=0x7f250006c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.116+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 shutdown_connections 2024-03-08T20:29:50.162 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.116+0000 7f2504c00640 1 -- 172.21.15.118:0/2690423732 wait complete. 2024-03-08T20:29:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7f1d64075420 msgr2=0x7f1d64077860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7f1d64075420 0x7f1d64077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1d6406bca0 msgr2=0x7f1d6406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1d6406bca0 0x7f1d6406e160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c042670 tx=0x7f1d70009040 comp rx=0 tx=0).stop 2024-03-08T20:29:50.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c00a8b0 msgr2=0x7f1d7c0dfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.117+0000 7f1d89600640 1 --2- 172.21.15.118:0/1720091867 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d7c00a8b0 0x7f1d7c0dfd60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0de740 tx=0x7f1d780046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.118+0000 7f1d88c00640 1 -- 172.21.15.118:0/1720091867 reap_dead start 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.118+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 shutdown_connections 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.118+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 >> 172.21.15.118:0/1720091867 conn(0x7f1d7c048250 msgr2=0x7f1d7c0e0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.118+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 shutdown_connections 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.118+0000 7f1d89600640 1 -- 172.21.15.118:0/1720091867 wait complete. 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.119+0000 7fed01600640 1 -- 172.21.15.118:0/2599914930 --> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecd4002dd0 con 0x7fecdc075380 2024-03-08T20:29:50.164 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.121+0000 7fecf3e00640 1 -- 172.21.15.118:0/2599914930 <== osd.4 v2:172.21.15.144:6808/2013996799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecd4002dd0 con 0x7fecdc075380 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.121+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7fecdc075380 msgr2=0x7fecdc0777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.121+0000 7fecf1600640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7fecdc075380 0x7fecdc0777c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.123+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecdc06bc00 msgr2=0x7fecdc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.123+0000 7fecf1600640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fecdc06bc00 0x7fecdc06e0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecfc15c120 tx=0x7fecf4007ed0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.123+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 msgr2=0x7fecfc153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.123+0000 7fecf1600640 1 --2- 172.21.15.118:0/2599914930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecfc0c0d30 0x7fecfc153070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecec00d800 tx=0x7fecec00dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.123+0000 7fed00c00640 1 -- 172.21.15.118:0/2599914930 reap_dead start 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.124+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 shutdown_connections 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.124+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 >> 172.21.15.118:0/2599914930 conn(0x7fecfc06d410 msgr2=0x7fecfc154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.124+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 shutdown_connections 2024-03-08T20:29:50.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.125+0000 7fecf1600640 1 -- 172.21.15.118:0/2599914930 wait complete. 2024-03-08T20:29:50.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.127+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 --> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d9c0c4480 con 0x7f7d7c075420 2024-03-08T20:29:50.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.130+0000 7f7d99600640 1 -- 172.21.15.118:0/619767274 <== osd.6 v2:172.21.15.144:6810/1443686898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d9c0c4480 con 0x7f7d7c075420 2024-03-08T20:29:50.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.130+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 --> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09c81460c0 con 0x7f09a80752c0 2024-03-08T20:29:50.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.131+0000 7f09bfe00640 1 -- 172.21.15.118:0/9344222 <== osd.3 v2:172.21.15.118:6824/2572185717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09c81460c0 con 0x7f09a80752c0 2024-03-08T20:29:50.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.131+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f7d7c075420 msgr2=0x7f7d7c077860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.168 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.131+0000 7f7da4600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f7d7c075420 0x7f7d7c077860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d7c06bca0 msgr2=0x7f7d7c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d7c06bca0 0x7f7d7c06e160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d94035000 tx=0x7f7d94030000 comp rx=0 tx=0).stop 2024-03-08T20:29:50.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 msgr2=0x7f7d9c15d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 --2- 172.21.15.118:0/619767274 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d9c0a5780 0x7f7d9c15d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800b3e0 tx=0x7f7d8800b8a0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.169 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da2600640 1 -- 172.21.15.118:0/619767274 reap_dead start 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 shutdown_connections 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 >> 172.21.15.118:0/619767274 conn(0x7f7d9c0c6760 msgr2=0x7f7d9c0c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 shutdown_connections 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7f09a80752c0 msgr2=0x7f09a8077700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.132+0000 7f09cec00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7f09a80752c0 0x7f09a8077700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.170 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f7da4600640 1 -- 172.21.15.118:0/619767274 wait complete. 2024-03-08T20:29:50.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09a806bbd0 msgr2=0x7f09a806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f09cec00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f09a806bbd0 0x7f09a806e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09c814e0f0 tx=0x7f09b8008040 comp rx=0 tx=0).stop 2024-03-08T20:29:50.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 msgr2=0x7f09c81f4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f09cec00640 1 --2- 172.21.15.118:0/9344222 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09c8154a60 0x7f09c81f4520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09c0009e50 tx=0x7f09c0004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:50.171 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.133+0000 7f09ccc00640 1 -- 172.21.15.118:0/9344222 reap_dead start 2024-03-08T20:29:50.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.134+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 --> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9aa40ac880 con 0x7f9a84075310 2024-03-08T20:29:50.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.134+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 shutdown_connections 2024-03-08T20:29:50.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.134+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 >> 172.21.15.118:0/9344222 conn(0x7f09c80c6580 msgr2=0x7f09c8072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.134+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 shutdown_connections 2024-03-08T20:29:50.172 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.134+0000 7f09cec00640 1 -- 172.21.15.118:0/9344222 wait complete. 2024-03-08T20:29:50.173 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.135+0000 7f9aa1600640 1 -- 172.21.15.118:0/4170861781 <== osd.7 v2:172.21.15.144:6824/1313104786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9aa40ac880 con 0x7f9a84075310 2024-03-08T20:29:50.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.136+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7f9a84075310 msgr2=0x7f9a84077750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.136+0000 7f9aabe00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7f9a84075310 0x7f9a84077750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.137+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9a8406bc20 msgr2=0x7f9a8406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.137+0000 7f9aabe00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9a8406bc20 0x7f9a8406e0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009560 tx=0x7f9a98009190 comp rx=0 tx=0).stop 2024-03-08T20:29:50.174 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.137+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 msgr2=0x7f9aa41eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.137+0000 7f9aabe00640 1 --2- 172.21.15.118:0/4170861781 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9aa40c8750 0x7f9aa41eacc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c036040 tx=0x7f9a9c004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.138+0000 7f9aa9e00640 1 -- 172.21.15.118:0/4170861781 reap_dead start 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.139+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 shutdown_connections 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.139+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 >> 172.21.15.118:0/4170861781 conn(0x7f9aa4072c30 msgr2=0x7f9aa414ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.140+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 shutdown_connections 2024-03-08T20:29:50.175 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.140+0000 7f9aabe00640 1 -- 172.21.15.118:0/4170861781 wait complete. 2024-03-08T20:29:50.176 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:50.176 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-08T20:29:50.176 INFO:teuthology.orchestra.run.smithi118.stdout:55834574858 2024-03-08T20:29:50.177 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:50.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-08T20:29:50.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-08T20:29:50.179 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:50.179 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-08T20:29:50.180 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:50.180 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-08T20:29:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:50.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-08T20:29:50.182 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-08T20:29:50.183 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:50.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-08T20:29:50.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.509+0000 7f4d0ca00640 1 Processor -- start 2024-03-08T20:29:50.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.509+0000 7f4d0ca00640 1 -- start start 2024-03-08T20:29:50.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.511+0000 7f4d0ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d080c89c0 0x7f4d080cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.510 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.511+0000 7f4d0ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 0x7f4d08152530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.511+0000 7f4d05e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d080c89c0 0x7f4d080cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.512+0000 7f4d05e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d080c89c0 0x7f4d080cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56822/0 (socket says 172.21.15.118:56822) 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.511+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d08158430 0x7f4d08158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.512+0000 7f4d05400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 0x7f4d08152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.512+0000 7f4d05400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 0x7f4d08152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56884/0 (socket says 172.21.15.118:56884) 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.512+0000 7f4d0ca00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080c9bc0 con 0x7f4d080c89c0 2024-03-08T20:29:50.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.513+0000 7f4d0ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080cb060 con 0x7f4d081520a0 2024-03-08T20:29:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.513+0000 7f4d0ca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08158dc0 con 0x7f4d08158430 2024-03-08T20:29:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.513+0000 7f4d05e00640 1 -- 172.21.15.118:0/4100016204 learned_addr learned my addr 172.21.15.118:0/4100016204 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.513+0000 7f4d06800640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d08158430 0x7f4d08158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.514+0000 7f4d05e00640 1 -- 172.21.15.118:0/4100016204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d08158430 msgr2=0x7f4d08158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.514+0000 7f4d05e00640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d08158430 0x7f4d08158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.514+0000 7f4d05e00640 1 -- 172.21.15.118:0/4100016204 >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 msgr2=0x7f4d08152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.514+0000 7f4d05e00640 1 --2- 172.21.15.118:0/4100016204 >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 0x7f4d08152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.514+0000 7f4d05e00640 1 -- 172.21.15.118:0/4100016204 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0806d890 con 0x7f4d080c89c0 2024-03-08T20:29:50.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.516+0000 7f4d05e00640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d080c89c0 0x7f4d080cab20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d080be110 tx=0x7f4cf402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de9c2f0c4540d00 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.517+0000 7f4d04a00640 1 -- 172.21.15.118:0/4100016204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4035020 con 0x7f4d080c89c0 2024-03-08T20:29:50.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.517+0000 7f4d04a00640 1 -- 172.21.15.118:0/4100016204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4031810 con 0x7f4d080c89c0 2024-03-08T20:29:50.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.517+0000 7f4d04a00640 1 -- 172.21.15.118:0/4100016204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4031c20 con 0x7f4d080c89c0 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 -- 172.21.15.118:0/4100016204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d080c89c0 msgr2=0x7f4d080cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d080c89c0 0x7f4d080cab20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d080be110 tx=0x7f4cf402b8b0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 -- 172.21.15.118:0/4100016204 shutdown_connections 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d08158430 0x7f4d08158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/4100016204 >> v2:172.21.15.144:3300/0 conn(0x7f4d081520a0 0x7f4d08152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/4100016204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d080c89c0 0x7f4d080cab20 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d080be110 tx=0x7f4cf402b8b0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.518+0000 7f4d0ca00640 1 -- 172.21.15.118:0/4100016204 >> 172.21.15.118:0/4100016204 conn(0x7f4d08072860 msgr2=0x7f4d08072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.518 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.519+0000 7f4d0ca00640 1 -- 172.21.15.118:0/4100016204 shutdown_connections 2024-03-08T20:29:50.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.519+0000 7fe781a00640 1 Processor -- start 2024-03-08T20:29:50.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.519+0000 7f9d67000640 1 Processor -- start 2024-03-08T20:29:50.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.520+0000 7fe781a00640 1 -- start start 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c1526e0 0x7fe77c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe77c0c8750 0x7fe77c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 0x7fe77c0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c155250 con 0x7fe77c0c8bd0 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c159510 con 0x7fe77c0c8750 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7fe781a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0c71d0 con 0x7fe77c1526e0 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.519+0000 7f4d0ca00640 1 -- 172.21.15.118:0/4100016204 wait complete. 2024-03-08T20:29:50.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f4d0ca00640 1 Processor -- start 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.520+0000 7f9d67000640 1 -- start start 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f9d67000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d601526e0 0x7f9d60158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f9d67000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 0x7f9d601556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f9d67000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d60159510 con 0x7f9d600c8bd0 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f9d67000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d60155250 con 0x7f9d600c8750 2024-03-08T20:29:50.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.521+0000 7f9d67000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600c71d0 con 0x7f9d601526e0 2024-03-08T20:29:50.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.522+0000 7f4d0ca00640 1 -- start start 2024-03-08T20:29:50.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.522+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c1526e0 0x7fe77c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.522+0000 7fe77a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe77c0c8750 0x7fe77c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.522+0000 7fbc4c000640 1 Processor -- start 2024-03-08T20:29:50.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7fe77a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe77c0c8750 0x7fe77c1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56894/0 (socket says 172.21.15.118:56894) 2024-03-08T20:29:50.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7fe77a000640 1 -- 172.21.15.118:0/2326599615 learned_addr learned my addr 172.21.15.118:0/2326599615 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d601526e0 0x7f9d60158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f9d5fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d601526e0 0x7f9d60158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56908/0 (socket says 172.21.15.118:56908) 2024-03-08T20:29:50.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f9d5fe00640 1 -- 172.21.15.118:0/3151800179 learned_addr learned my addr 172.21.15.118:0/3151800179 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7fe77b400640 1 --2- 172.21.15.118:0/2326599615 >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 0x7fe77c0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d081520a0 0x7f4d081f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f4d0ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d081fb950 0x7f4d080ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.525 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d0ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9570 con 0x7f4d08158430 2024-03-08T20:29:50.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7f9d5f400640 1 --2- 172.21.15.118:0/3151800179 >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 0x7f9d601556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d0ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9290 con 0x7f4d081fb950 2024-03-08T20:29:50.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d0ca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c9850 con 0x7f4d081520a0 2024-03-08T20:29:50.526 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d05400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7fe77a000640 1 -- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c1526e0 msgr2=0x7fe77c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7fe77a000640 1 --2- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c1526e0 0x7fe77c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d05400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56842/0 (socket says 172.21.15.118:56842) 2024-03-08T20:29:50.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d05400640 1 -- 172.21.15.118:0/1730562135 learned_addr learned my addr 172.21.15.118:0/1730562135 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.527 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7f4d06800640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d081fb950 0x7f4d080ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.524+0000 7fe77a000640 1 -- 172.21.15.118:0/2326599615 >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 msgr2=0x7fe77c0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.523+0000 7fbc4c000640 1 -- start start 2024-03-08T20:29:50.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7f9d5fe00640 1 -- 172.21.15.118:0/3151800179 >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 msgr2=0x7f9d601556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.528 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fe77a000640 1 --2- 172.21.15.118:0/2326599615 >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 0x7fe77c0c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7f9d5fe00640 1 --2- 172.21.15.118:0/3151800179 >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 0x7f9d601556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fbc4c000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbc440c2860 0x7fbc4415d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fbc4c000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440c7d60 con 0x7fbc440c8b20 2024-03-08T20:29:50.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fe77a000640 1 -- 172.21.15.118:0/2326599615 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0c74b0 con 0x7fe77c0c8750 2024-03-08T20:29:50.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fbc4c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440c77a0 con 0x7fbc440a7c60 2024-03-08T20:29:50.530 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7fbc4c000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440c7a80 con 0x7fbc440c2860 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f4d05400640 1 -- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d081520a0 msgr2=0x7f4d081f8420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f4d05400640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d081520a0 0x7f4d081f8420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f4d05400640 1 -- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d081fb950 msgr2=0x7f4d080ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f4d05400640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d081fb950 0x7f4d080ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f4d05400640 1 -- 172.21.15.118:0/1730562135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d081f7960 con 0x7f4d08158430 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7f9d5fe00640 1 -- 172.21.15.118:0/3151800179 >> v1:172.21.15.118:6789/0 conn(0x7f9d600c8bd0 legacy=0x7f9d600c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.525+0000 7f9d5fe00640 1 -- 172.21.15.118:0/3151800179 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600c74b0 con 0x7f9d601526e0 2024-03-08T20:29:50.531 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7f9d5f400640 1 --2- 172.21.15.118:0/3151800179 >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 0x7f9d601556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7fe77b400640 1 --2- 172.21.15.118:0/2326599615 >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 0x7fe77c0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.527+0000 7f9d5fe00640 1 --2- 172.21.15.118:0/3151800179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601526e0 0x7f9d60158fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d601553d0 tx=0x7f9d5002b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4265755b1c62c802 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f9d5ea00640 1 -- 172.21.15.118:0/3151800179 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50037070 con 0x7f9d601526e0 2024-03-08T20:29:50.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f9d5ea00640 1 -- 172.21.15.118:0/3151800179 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50030710 con 0x7f9d601526e0 2024-03-08T20:29:50.532 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f9d5ea00640 1 -- 172.21.15.118:0/3151800179 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50030ae0 con 0x7f9d601526e0 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7fbc48c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbc440a7c60 0x7fbc440c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:52330/0 (socket says 172.21.15.118:52330) 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.526+0000 7fbc48c00640 1 -- 172.21.15.118:0/2045450729 learned_addr learned my addr 172.21.15.118:0/2045450729 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.527+0000 7fbc4a000640 1 --2- 172.21.15.118:0/2045450729 >> v2:172.21.15.118:3300/0 conn(0x7fbc440c2860 0x7fbc4415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.527+0000 7f4d05400640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800e8c0 tx=0x7f4cf800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8017070 con 0x7f4d08158430 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800c940 con 0x7f4d08158430 2024-03-08T20:29:50.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800cd10 con 0x7f4d08158430 2024-03-08T20:29:50.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7fbc43e00640 1 -- 172.21.15.118:0/2045450729 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736797434 0 0) 0x7fbc440c7d60 con 0x7fbc440c8b20 2024-03-08T20:29:50.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7fbc43e00640 1 -- 172.21.15.118:0/2045450729 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c003520 con 0x7fbc440c8b20 2024-03-08T20:29:50.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 -- 172.21.15.118:0/3151800179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601526e0 msgr2=0x7f9d60158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 --2- 172.21.15.118:0/3151800179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601526e0 0x7f9d60158fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9d601553d0 tx=0x7f9d5002b760 comp rx=0 tx=0).stop 2024-03-08T20:29:50.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fbc4a000640 1 -- 172.21.15.118:0/2045450729 >> v1:172.21.15.144:6789/0 conn(0x7fbc440a7c60 legacy=0x7fbc440c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fbc4a000640 1 -- 172.21.15.118:0/2045450729 >> v1:172.21.15.118:6789/0 conn(0x7fbc440c8b20 legacy=0x7fbc441592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fbc4a000640 1 -- 172.21.15.118:0/2045450729 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4415c940 con 0x7fbc440c2860 2024-03-08T20:29:50.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7fe77a000640 1 --2- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c1556e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe77c073340 tx=0x7fe76802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c7fa67d6f1f108 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 -- 172.21.15.118:0/3151800179 shutdown_connections 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 --2- 172.21.15.118:0/3151800179 >> v2:172.21.15.118:3300/0 conn(0x7f9d600c8750 0x7f9d601556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 --2- 172.21.15.118:0/3151800179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601526e0 0x7f9d60158fd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 -- 172.21.15.118:0/3151800179 >> 172.21.15.118:0/3151800179 conn(0x7f9d60072c30 msgr2=0x7f9d600ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 -- 172.21.15.118:0/3151800179 shutdown_connections 2024-03-08T20:29:50.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fe779600640 1 -- 172.21.15.118:0/2326599615 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76802e070 con 0x7fe77c0c8750 2024-03-08T20:29:50.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fe779600640 1 -- 172.21.15.118:0/2326599615 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768037070 con 0x7fe77c0c8750 2024-03-08T20:29:50.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7fe779600640 1 -- 172.21.15.118:0/2326599615 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768031a00 con 0x7fe77c0c8750 2024-03-08T20:29:50.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d080ad950 con 0x7f4d08158430 2024-03-08T20:29:50.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.528+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081f7c20 con 0x7f4d08158430 2024-03-08T20:29:50.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f36f7800640 1 Processor -- start 2024-03-08T20:29:50.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fe781a00640 1 -- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 msgr2=0x7fe77c1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fe781a00640 1 --2- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c1556e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe77c073340 tx=0x7fe76802b880 comp rx=0 tx=0).stop 2024-03-08T20:29:50.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fe781a00640 1 -- 172.21.15.118:0/2326599615 shutdown_connections 2024-03-08T20:29:50.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fe781a00640 1 --2- 172.21.15.118:0/2326599615 >> v2:172.21.15.118:3300/0 conn(0x7fe77c0c8bd0 0x7fe77c0c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fe781a00640 1 --2- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c1556e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7fe781a00640 1 --2- 172.21.15.118:0/2326599615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c1526e0 0x7fe77c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7fe781a00640 1 -- 172.21.15.118:0/2326599615 >> 172.21.15.118:0/2326599615 conn(0x7fe77c072c30 msgr2=0x7fe77c0ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7f36f7800640 1 -- start start 2024-03-08T20:29:50.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.529+0000 7f9d67000640 1 -- 172.21.15.118:0/3151800179 wait complete. 2024-03-08T20:29:50.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7f9d67000640 1 Processor -- start 2024-03-08T20:29:50.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7fe781a00640 1 -- 172.21.15.118:0/2326599615 shutdown_connections 2024-03-08T20:29:50.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.530+0000 7fbc4a000640 1 --2- 172.21.15.118:0/2045450729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc4415d420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009d90 tx=0x7fbc3c02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e4278aea330a74 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7f9d67000640 1 -- start start 2024-03-08T20:29:50.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7fe781a00640 1 -- 172.21.15.118:0/2326599615 wait complete. 2024-03-08T20:29:50.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7fae98400640 1 Processor -- start 2024-03-08T20:29:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7fbc43e00640 1 -- 172.21.15.118:0/2045450729 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c039070 con 0x7fbc440c2860 2024-03-08T20:29:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7fbc43e00640 1 -- 172.21.15.118:0/2045450729 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c02cbe0 con 0x7fbc440c2860 2024-03-08T20:29:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7fbc43e00640 1 -- 172.21.15.118:0/2045450729 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c034440 con 0x7fbc440c2860 2024-03-08T20:29:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.531+0000 7f36f7800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7fae98400640 1 -- start start 2024-03-08T20:29:50.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f7800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00c71d0 con 0x7f36f01526e0 2024-03-08T20:29:50.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f7800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00c74b0 con 0x7f36f00c8750 2024-03-08T20:29:50.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f7800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0155250 con 0x7f36f00c8bd0 2024-03-08T20:29:50.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08074a40 con 0x7f4d08158430 2024-03-08T20:29:50.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f4e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f36f01526e0 0x7f36f0158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57928/0 (socket says 172.21.15.118:57928) 2024-03-08T20:29:50.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 -- 172.21.15.118:0/2045450729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 msgr2=0x7fbc4415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 --2- 172.21.15.118:0/2045450729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc4415d420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009d90 tx=0x7fbc3c02be30 comp rx=0 tx=0).stop 2024-03-08T20:29:50.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f9d67000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600c8750 0x7f9d60158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f9d67000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f9d67000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d601526e0 0x7f9d601eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f9d67000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600c5850 con 0x7f9d600c8bd0 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f9d67000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600c7a70 con 0x7f9d600c8750 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f9d67000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600c59d0 con 0x7f9d601526e0 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f5800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.532+0000 7f36f4e00640 1 -- 172.21.15.118:0/1280726284 learned_addr learned my addr 172.21.15.118:0/1280726284 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 -- 172.21.15.118:0/2045450729 shutdown_connections 2024-03-08T20:29:50.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 --2- 172.21.15.118:0/2045450729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc4415d420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 -- 172.21.15.118:0/2045450729 >> 172.21.15.118:0/2045450729 conn(0x7fbc44066e40 msgr2=0x7fbc44067250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 -- 172.21.15.118:0/2045450729 shutdown_connections 2024-03-08T20:29:50.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fbc4c000640 1 -- 172.21.15.118:0/2045450729 wait complete. 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f36f5800640 1 -- 172.21.15.118:0/1280726284 >> v1:172.21.15.144:6789/0 conn(0x7f36f00c8750 legacy=0x7f36f01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fae98400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 0x7fae901556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fae98400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae900c8bd0 0x7fae900c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fae98400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae900c71d0 con 0x7fae901526e0 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fae98400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae90155250 con 0x7fae900c8bd0 2024-03-08T20:29:50.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7fae98400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c74b0 con 0x7fae900c8750 2024-03-08T20:29:50.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f36f5800640 1 -- 172.21.15.118:0/1280726284 >> v1:172.21.15.118:6789/0 conn(0x7f36f01526e0 legacy=0x7f36f0158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.533+0000 7f36f5800640 1 -- 172.21.15.118:0/1280726284 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00c7790 con 0x7f36f00c8bd0 2024-03-08T20:29:50.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fae95a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fae901526e0 0x7fae90158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57942/0 (socket says 172.21.15.118:57942) 2024-03-08T20:29:50.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fae95a00640 1 -- 172.21.15.118:0/3428930119 learned_addr learned my addr 172.21.15.118:0/3428930119 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fe781a00640 1 Processor -- start 2024-03-08T20:29:50.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fae95000640 1 --2- 172.21.15.118:0/3428930119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 0x7fae901556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fe781a00640 1 -- start start 2024-03-08T20:29:50.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7fae96400640 1 --2- 172.21.15.118:0/3428930119 >> v2:172.21.15.144:3300/0 conn(0x7fae900c8bd0 0x7fae900c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7f9d5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.535+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4cf801a070 con 0x7f4d08158430 2024-03-08T20:29:50.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7f9d5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56848/0 (socket says 172.21.15.118:56848) 2024-03-08T20:29:50.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7f9d5f400640 1 -- 172.21.15.118:0/2683284876 learned_addr learned my addr 172.21.15.118:0/2683284876 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7f9d65000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d601526e0 0x7f9d601eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.534+0000 7f9d5fe00640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600c8750 0x7f9d60158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 0x7fe77c0ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.535+0000 7fae95000640 1 -- 172.21.15.118:0/3428930119 >> v2:172.21.15.144:3300/0 conn(0x7fae900c8bd0 msgr2=0x7fae900c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.535+0000 7fae95000640 1 --2- 172.21.15.118:0/3428930119 >> v2:172.21.15.144:3300/0 conn(0x7fae900c8bd0 0x7fae900c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.535+0000 7fae95000640 1 -- 172.21.15.118:0/3428930119 >> v1:172.21.15.118:6789/0 conn(0x7fae901526e0 legacy=0x7fae90158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.535+0000 7fae95000640 1 -- 172.21.15.118:0/3428930119 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900c7790 con 0x7fae900c8750 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 -- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d601526e0 msgr2=0x7f9d601eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d601526e0 0x7f9d601eadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 -- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600c8750 msgr2=0x7f9d60158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600c8750 0x7f9d60158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 -- 172.21.15.118:0/2683284876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d601ee9f0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fbc4c000640 1 Processor -- start 2024-03-08T20:29:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7f9d5f400640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d800 tx=0x7f9d4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 0x7fe77c0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c155c20 con 0x7fe77c1526e0 2024-03-08T20:29:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0c7a70 con 0x7fe77c0c8750 2024-03-08T20:29:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.536+0000 7fe781a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c155da0 con 0x7fe77c0c8bd0 2024-03-08T20:29:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7f36f5800640 1 --2- 172.21.15.118:0/1280726284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c5140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009dc0 tx=0x7f36e802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b929ab65d8c3889b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fe77aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fe77a000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 0x7fe77c0ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fe77b400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 0x7fe77c0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fe77a000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 0x7fe77c0ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48410/0 (socket says 172.21.15.118:48410) 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fe77a000640 1 -- 172.21.15.118:0/2528196698 learned_addr learned my addr 172.21.15.118:0/2528196698 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fb6c3200640 1 Processor -- start 2024-03-08T20:29:50.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fae95000640 1 --2- 172.21.15.118:0/3428930119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 0x7fae901556e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097a0 tx=0x7fae7c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93ce90396dae04c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7f36efe00640 1 -- 172.21.15.118:0/1280726284 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8039070 con 0x7f36f00c8bd0 2024-03-08T20:29:50.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fae8fe00640 1 -- 172.21.15.118:0/3428930119 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0317c0 con 0x7fae900c8750 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 -- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 msgr2=0x7fe77c0ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 0x7fe77c0ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 -- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 msgr2=0x7fe77c153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 -- 172.21.15.118:0/2528196698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0c3c80 con 0x7fe77c1526e0 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fae8fe00640 1 -- 172.21.15.118:0/3428930119 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c037070 con 0x7fae900c8750 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fae8fe00640 1 -- 172.21.15.118:0/3428930119 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c031bc0 con 0x7fae900c8750 2024-03-08T20:29:50.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7f4cfe000640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 0x7f4ce806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4cf808afd0 con 0x7f4d08158430 2024-03-08T20:29:50.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7f4d05e00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 0x7f4ce806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7f36efe00640 1 -- 172.21.15.118:0/1280726284 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e802cc40 con 0x7f36f00c8bd0 2024-03-08T20:29:50.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7f36efe00640 1 -- 172.21.15.118:0/1280726284 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8034440 con 0x7f36f00c8bd0 2024-03-08T20:29:50.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fe77b400640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 0x7fe77c0aba60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe77c06bde0 tx=0x7fe77400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.537+0000 7fbc4c000640 1 -- start start 2024-03-08T20:29:50.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fbc4c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fbc4c000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc44158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 -- 172.21.15.118:0/3428930119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 msgr2=0x7fae901556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 --2- 172.21.15.118:0/3428930119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 0x7fae901556e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097a0 tx=0x7fae7c02b860 comp rx=0 tx=0).stop 2024-03-08T20:29:50.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.538+0000 7fbc4c000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 0x7fbc441eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 -- 172.21.15.118:0/3428930119 shutdown_connections 2024-03-08T20:29:50.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 --2- 172.21.15.118:0/3428930119 >> v2:172.21.15.144:3300/0 conn(0x7fae900c8bd0 0x7fae900c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 --2- 172.21.15.118:0/3428930119 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8750 0x7fae901556e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 -- 172.21.15.118:0/3428930119 >> 172.21.15.118:0/3428930119 conn(0x7fae90072c30 msgr2=0x7fae900ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc49600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc49600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56962/0 (socket says 172.21.15.118:56962) 2024-03-08T20:29:50.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 -- 172.21.15.118:0/3428930119 shutdown_connections 2024-03-08T20:29:50.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fae98400640 1 -- 172.21.15.118:0/3428930119 wait complete. 2024-03-08T20:29:50.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7f4d05e00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 0x7f4ce806e160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4036000 tx=0x7f4cf4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc4c000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441599c0 con 0x7fbc440c2860 2024-03-08T20:29:50.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7f36f7800640 1 -- 172.21.15.118:0/1280726284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 msgr2=0x7f36f00c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7f36f7800640 1 --2- 172.21.15.118:0/1280726284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c5140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009dc0 tx=0x7f36e802be90 comp rx=0 tx=0).stop 2024-03-08T20:29:50.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc4c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4415cf00 con 0x7fbc440a7c60 2024-03-08T20:29:50.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fb6c3200640 1 -- start start 2024-03-08T20:29:50.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc4c000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44156ba0 con 0x7fbc440c8b20 2024-03-08T20:29:50.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.539+0000 7fbc49600640 1 -- 172.21.15.118:0/1773341801 learned_addr learned my addr 172.21.15.118:0/1773341801 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7f36f7800640 1 -- 172.21.15.118:0/1280726284 shutdown_connections 2024-03-08T20:29:50.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7f36f7800640 1 --2- 172.21.15.118:0/1280726284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c5140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7f36f7800640 1 -- 172.21.15.118:0/1280726284 >> 172.21.15.118:0/1280726284 conn(0x7f36f0072c30 msgr2=0x7f36f00ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc4a000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 0x7fbc441eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc49600640 1 -- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 msgr2=0x7fbc441eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc49600640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 0x7fbc441eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc49600640 1 -- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 msgr2=0x7fbc44158170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-08T20:29:50.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7f36f7800640 1 -- 172.21.15.118:0/1280726284 shutdown_connections 2024-03-08T20:29:50.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc48c00640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc44158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7f36f7800640 1 -- 172.21.15.118:0/1280726284 wait complete. 2024-03-08T20:29:50.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc49600640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc44158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc49600640 1 -- 172.21.15.118:0/1773341801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4414faa0 con 0x7fbc440a7c60 2024-03-08T20:29:50.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.540+0000 7fbc4a000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 0x7fbc441eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:50.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fbc49600640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c4b0 tx=0x7fbc3800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fae98400640 1 Processor -- start 2024-03-08T20:29:50.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fb6c3200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fb6c3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6bc159380 0x7fb6bc0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fb6c3200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc159860 con 0x7fb6bc0ce8b0 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fb6c3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cadc0 con 0x7fb6bc159380 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38017070 con 0x7fbc440a7c60 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380052d0 con 0x7fbc440a7c60 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38012870 con 0x7fbc440a7c60 2024-03-08T20:29:50.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fae98400640 1 -- start start 2024-03-08T20:29:50.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4415c130 con 0x7fbc440a7c60 2024-03-08T20:29:50.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.541+0000 7fb6c3200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc159b40 con 0x7fb6bc0ce4d0 2024-03-08T20:29:50.573 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4415bde0 con 0x7fbc440a7c60 2024-03-08T20:29:50.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fb6c1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6bc159380 0x7fb6bc0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fb6bb400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb6bc0ce8b0 0x7fb6bc0cb230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57948/0 (socket says 172.21.15.118:57948) 2024-03-08T20:29:50.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fb6bb400640 1 -- 172.21.15.118:0/2540600521 learned_addr learned my addr 172.21.15.118:0/2540600521 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fb6bbe00640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.574 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.542+0000 7fae98400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae900c8750 0x7fae900abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae98400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 0x7fae90158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae98400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae98400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90155da0 con 0x7fae901526e0 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae98400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90155c20 con 0x7fae900c8750 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae98400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90155f20 con 0x7fae900c8bd0 2024-03-08T20:29:50.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fb6c1200640 1 -- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 msgr2=0x7fb6bc06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fb6c1200640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc06ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fb6c1200640 1 -- 172.21.15.118:0/2540600521 >> v1:172.21.15.118:6789/0 conn(0x7fb6bc0ce8b0 legacy=0x7fb6bc0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fb6c1200640 1 -- 172.21.15.118:0/2540600521 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc159e20 con 0x7fb6bc159380 2024-03-08T20:29:50.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7f36f7800640 1 Processor -- start 2024-03-08T20:29:50.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fb6bbe00640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7f36f7800640 1 -- start start 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae96400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae95a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae900c8750 0x7fae900abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae96400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56880/0 (socket says 172.21.15.118:56880) 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.543+0000 7fae96400640 1 -- 172.21.15.118:0/3951451484 learned_addr learned my addr 172.21.15.118:0/3951451484 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44074a40 con 0x7fbc440a7c60 2024-03-08T20:29:50.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae95000640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 0x7fae90158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae96400640 1 -- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 msgr2=0x7fae90158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae96400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 0x7fae90158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae96400640 1 -- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae900c8750 msgr2=0x7fae900abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae96400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae900c8750 0x7fae900abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae96400640 1 -- 172.21.15.118:0/3951451484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90157b60 con 0x7fae901526e0 2024-03-08T20:29:50.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.544+0000 7fae95000640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 0x7fae90158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.545+0000 7fae96400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fae8800efc0 tx=0x7fae8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.545+0000 7f36f7800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.545+0000 7fb6c1200640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc159380 0x7fb6bc0cb940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0097a0 tx=0x7fb6ac02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977770c2673c86a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.545+0000 7f36f7800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f7800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36f01526e0 0x7f36f00c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f7800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0155f70 con 0x7f36f01526e0 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f7800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0155df0 con 0x7f36f00c8750 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f7800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00c5680 con 0x7f36f00c8bd0 2024-03-08T20:29:50.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbc3801a070 con 0x7fbc440a7c60 2024-03-08T20:29:50.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:56982/0 (socket says 172.21.15.118:56982) 2024-03-08T20:29:50.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36f4e00640 1 -- 172.21.15.118:0/3671901344 learned_addr learned my addr 172.21.15.118:0/3671901344 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.581 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f36e7e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c004030 con 0x7f9d600c8bd0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0041d0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c0096a0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d601eec90 con 0x7f9d600c8bd0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77401a070 con 0x7fe77c1526e0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774015400 con 0x7fe77c1526e0 2024-03-08T20:29:50.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7740157f0 con 0x7fe77c1526e0 2024-03-08T20:29:50.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c1eb670 con 0x7fe77c1526e0 2024-03-08T20:29:50.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c154530 con 0x7fe77c1526e0 2024-03-08T20:29:50.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36f5800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36f01526e0 0x7f36f00c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4cf80591a0 con 0x7f4d08158430 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36e7e00640 1 -- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 msgr2=0x7f36f00c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36e7e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36e7e00640 1 -- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36f01526e0 msgr2=0x7f36f00c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36e7e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36f01526e0 0x7f36f00c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36e7e00640 1 -- 172.21.15.118:0/3671901344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f01efc20 con 0x7f36f00c8bd0 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f36f4e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:50.584 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.547+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d60157590 con 0x7f9d600c8bd0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88018020 con 0x7fae901526e0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88014480 con 0x7fae901526e0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.546+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88014870 con 0x7fae901526e0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.548+0000 7f36e7e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c4160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c390 tx=0x7f36d800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.548+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90157e40 con 0x7fae901526e0 2024-03-08T20:29:50.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.548+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90158400 con 0x7fae901526e0 2024-03-08T20:29:50.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.548+0000 7fbc41600640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 0x7fbc2406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.548+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbc3808a2b0 con 0x7fbc440a7c60 2024-03-08T20:29:50.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.549+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8017070 con 0x7f36f00c8bd0 2024-03-08T20:29:50.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.549+0000 7fbc48c00640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 0x7fbc2406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.549+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe754005290 con 0x7fe77c1526e0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d80052d0 con 0x7f36f00c8bd0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8017070 con 0x7f36f00c8bd0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f00c19c0 con 0x7f36f00c8bd0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f00c1f40 con 0x7f36f00c8bd0 2024-03-08T20:29:50.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90074a40 con 0x7fae901526e0 2024-03-08T20:29:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.551+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60074a40 con 0x7f9d600c8bd0 2024-03-08T20:29:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.550+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe77401d070 con 0x7fe77c1526e0 2024-03-08T20:29:50.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.551+0000 7fbc48c00640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 0x7fbc2406e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc440aea40 tx=0x7fbc30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fae88005d10 con 0x7fae901526e0 2024-03-08T20:29:50.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7fe772a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 0x7fe75c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7f784f200640 1 Processor -- start 2024-03-08T20:29:50.589 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9d4c009840 con 0x7f9d600c8bd0 2024-03-08T20:29:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe77408ae70 con 0x7fe77c1526e0 2024-03-08T20:29:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.553+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00c4760 con 0x7f36f00c8bd0 2024-03-08T20:29:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.552+0000 7f784f200640 1 -- start start 2024-03-08T20:29:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.553+0000 7fae8d600640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 0x7fae7006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.590 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.554+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fae88057cc0 con 0x7fae901526e0 2024-03-08T20:29:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.554+0000 7fae95a00640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 0x7fae7006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.553+0000 7f9d57e00640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 0x7f9d4006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.591 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.554+0000 7fe77aa00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 0x7fe75c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.553+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9d4c08ae80 con 0x7f9d600c8bd0 2024-03-08T20:29:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.554+0000 7f9d5fe00640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 0x7f9d4006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.555+0000 7f9d5fe00640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 0x7f9d4006e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d50034000 tx=0x7f9d50008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.555+0000 7f784f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78481526e0 0x7f7848158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.592 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.554+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f36d801a070 con 0x7f36f00c8bd0 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7f7847400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f78480c8750 0x7f78481556e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57952/0 (socket says 172.21.15.118:57952) 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7f7847400640 1 -- 172.21.15.118:0/2877684117 learned_addr learned my addr 172.21.15.118:0/2877684117 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7848159510 con 0x7f78480c8750 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7fe77aa00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 0x7fe75c06e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0c5bf0 tx=0x7fe76c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480c71d0 con 0x7f78480c8bd0 2024-03-08T20:29:50.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848155250 con 0x7f78481526e0 2024-03-08T20:29:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.556+0000 7fae95a00640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 0x7fae7006e0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae84005880 tx=0x7fae84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f7847e00640 1 --2- 172.21.15.118:0/2877684117 >> v2:172.21.15.144:3300/0 conn(0x7f78481526e0 0x7f7848158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.594 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f36ed600640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 0x7f36cc06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f36d8089bc0 con 0x7f36f00c8bd0 2024-03-08T20:29:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f36f4e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 0x7f36cc06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f7847e00640 1 -- 172.21.15.118:0/2877684117 >> v1:172.21.15.144:6789/0 conn(0x7f78480c8bd0 legacy=0x7f78480c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f7847e00640 1 -- 172.21.15.118:0/2877684117 >> v1:172.21.15.118:6789/0 conn(0x7f78480c8750 legacy=0x7f78481556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.557+0000 7f7847e00640 1 -- 172.21.15.118:0/2877684117 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480c74b0 con 0x7f78481526e0 2024-03-08T20:29:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.558+0000 7f36f4e00640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 0x7f36cc06e290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005880 tx=0x7f36e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.558+0000 7f7847e00640 1 --2- 172.21.15.118:0/2877684117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f7848158fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78481596e0 tx=0x7f783802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f13d3c8211c3995 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.560+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe774010070 con 0x7fe77c1526e0 2024-03-08T20:29:50.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.564+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9d4c0597a0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7fb6baa00640 1 -- 172.21.15.118:0/2540600521 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac035020 con 0x7fb6bc159380 2024-03-08T20:29:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7fb6baa00640 1 -- 172.21.15.118:0/2540600521 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac031810 con 0x7fb6bc159380 2024-03-08T20:29:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7fb6baa00640 1 -- 172.21.15.118:0/2540600521 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac031be0 con 0x7fb6bc159380 2024-03-08T20:29:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7f7846a00640 1 -- 172.21.15.118:0/2877684117 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838031780 con 0x7f78481526e0 2024-03-08T20:29:50.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fae88022030 con 0x7fae901526e0 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7f7846a00640 1 -- 172.21.15.118:0/2877684117 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838037070 con 0x7f78481526e0 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.569+0000 7f7846a00640 1 -- 172.21.15.118:0/2877684117 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838031b40 con 0x7f78481526e0 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 -- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc159380 msgr2=0x7fb6bc0cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc159380 0x7fb6bc0cb940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0097a0 tx=0x7fb6ac02b8b0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 -- 172.21.15.118:0/2540600521 shutdown_connections 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc159380 0x7fb6bc0cb940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.598 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2540600521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fb6c3200640 1 -- 172.21.15.118:0/2540600521 >> 172.21.15.118:0/2540600521 conn(0x7fb6bc06aef0 msgr2=0x7fb6bc06b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 msgr2=0x7f7848158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7f784f200640 1 --2- 172.21.15.118:0/2877684117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f7848158fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f78481596e0 tx=0x7f783802b820 comp rx=0 tx=0).stop 2024-03-08T20:29:50.599 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.570+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbc38021080 con 0x7fbc440a7c60 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 shutdown_connections 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7f784f200640 1 --2- 172.21.15.118:0/2877684117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f7848158fd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 >> 172.21.15.118:0/2877684117 conn(0x7f7848072c30 msgr2=0x7f78480ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 shutdown_connections 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7f784f200640 1 -- 172.21.15.118:0/2877684117 wait complete. 2024-03-08T20:29:50.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7fb6c3200640 1 -- 172.21.15.118:0/2540600521 shutdown_connections 2024-03-08T20:29:50.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.571+0000 7fb6c3200640 1 -- 172.21.15.118:0/2540600521 wait complete. 2024-03-08T20:29:50.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.573+0000 7fb6c3200640 1 Processor -- start 2024-03-08T20:29:50.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.573+0000 7fb6c3200640 1 -- start start 2024-03-08T20:29:50.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.573+0000 7f784f200640 1 Processor -- start 2024-03-08T20:29:50.601 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.574+0000 7f784f200640 1 -- start start 2024-03-08T20:29:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.574+0000 7fb6c3200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 0x7fb6bc15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc0afe50 0x7fb6bc0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc073100 con 0x7fb6bc159380 2024-03-08T20:29:50.602 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7f784f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 0x7f7848153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7f784f200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 0x7f784814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7f784f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f784814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cbe80 con 0x7fb6bc0afe50 2024-03-08T20:29:50.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f784f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848155df0 con 0x7f78480c8750 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f784f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480c7a70 con 0x7f78481526e0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f784f200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848155f70 con 0x7f78480c8bd0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f7847400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 0x7f784814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f7847400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 0x7f784814b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48470/0 (socket says 172.21.15.118:48470) 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f7847400640 1 -- 172.21.15.118:0/4010818195 learned_addr learned my addr 172.21.15.118:0/4010818195 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c3200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc073280 con 0x7fb6bc0ce4d0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6bb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 0x7fb6bc15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6bbe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6bbe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc0b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48458/0 (socket says 172.21.15.118:48458) 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6bbe00640 1 -- 172.21.15.118:0/2438373601 learned_addr learned my addr 172.21.15.118:0/2438373601 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.575+0000 7fb6c1200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc0afe50 0x7fb6bc0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 -- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 msgr2=0x7fb6bc0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 -- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc0afe50 msgr2=0x7fb6bc0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc0afe50 0x7fb6bc0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 -- 172.21.15.118:0/2438373601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0b0cd0 con 0x7fb6bc159380 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7fb6bb400640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 0x7fb6bc15add0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c370 tx=0x7fb6a800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.576+0000 7f784d200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f784814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8028070 con 0x7fb6bc159380 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a8005cc0 con 0x7fb6bc159380 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80072d0 con 0x7fb6bc159380 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f7847e00640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 0x7f7848153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f784d200640 1 -- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 msgr2=0x7f784814b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f784d200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 0x7f784814b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f784d200640 1 -- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 msgr2=0x7f7848153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f784d200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 0x7f7848153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.577+0000 7f784d200640 1 -- 172.21.15.118:0/4010818195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480ac4f0 con 0x7f78481526e0 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.578+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc0b0fb0 con 0x7fb6bc159380 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.578+0000 7f7847e00640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 0x7f7848153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:50.607 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.578+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc0b1570 con 0x7fb6bc159380 2024-03-08T20:29:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.578+0000 7f784d200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f784814bf00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f784000c7b0 tx=0x7f784000cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.579+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840016020 con 0x7f78481526e0 2024-03-08T20:29:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.579+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000aa50 con 0x7f78481526e0 2024-03-08T20:29:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.579+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000ce60 con 0x7f78481526e0 2024-03-08T20:29:50.608 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.580+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc0cc980 con 0x7fb6bc159380 2024-03-08T20:29:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.579+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78481ee230 con 0x7f78481526e0 2024-03-08T20:29:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.579+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480c1fb0 con 0x7f78481526e0 2024-03-08T20:29:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.581+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb6a802b070 con 0x7fb6bc159380 2024-03-08T20:29:50.609 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.582+0000 7fb6b3e00640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 0x7fb69c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.581+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f36d8057d10 con 0x7f36f00c8bd0 2024-03-08T20:29:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.582+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb6a8024e00 con 0x7fb6bc159380 2024-03-08T20:29:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.583+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848155c10 con 0x7f78481526e0 2024-03-08T20:29:50.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.583+0000 7fb6bbe00640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 0x7fb69c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.584+0000 7fb6bbe00640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 0x7fb69c06e0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4003be0 tx=0x7fb6b4009950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.586+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7840019020 con 0x7f78481526e0 2024-03-08T20:29:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.587+0000 7f783fe00640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 0x7f782806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.587+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f784008aff0 con 0x7f78481526e0 2024-03-08T20:29:50.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.589+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb6bc0cc980 con 0x7fb6bc159380 2024-03-08T20:29:50.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.591+0000 7f7847e00640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 0x7f782806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:50.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.592+0000 7f7847e00640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 0x7f782806e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7838036000 tx=0x7f7838008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:50.612 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.601+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7848155c10 con 0x7f78481526e0 2024-03-08T20:29:50.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.957+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe754005580 con 0x7fe77c1526e0 2024-03-08T20:29:50.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.958+0000 7fe772a00640 1 -- 172.21.15.118:0/2528196698 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe774058fb0 con 0x7fe77c1526e0 2024-03-08T20:29:50.959 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-03-08T20:29:50.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.962+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 msgr2=0x7fe75c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.962+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 0x7fe75c06e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0c5bf0 tx=0x7fe76c008040 comp rx=0 tx=0).stop 2024-03-08T20:29:50.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.963+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 msgr2=0x7fe77c0aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.963+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 0x7fe77c0aba60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe77c06bde0 tx=0x7fe77400d4a0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 shutdown_connections 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe75c06bc20 0x7fe75c06e0e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe77c1526e0 0x7fe77c0aba60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe77c0c8bd0 0x7fe77c0ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 --2- 172.21.15.118:0/2528196698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe77c0c8750 0x7fe77c153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.964+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 >> 172.21.15.118:0/2528196698 conn(0x7fe77c072c30 msgr2=0x7fe77c0ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.965+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 shutdown_connections 2024-03-08T20:29:50.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.965+0000 7fe781a00640 1 -- 172.21.15.118:0/2528196698 wait complete. 2024-03-08T20:29:50.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.965+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d0814db90 con 0x7f4d08158430 2024-03-08T20:29:50.966 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:50.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.966+0000 7f4cfe000640 1 -- 172.21.15.118:0/1730562135 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cf805d240 con 0x7f4d08158430 2024-03-08T20:29:50.968 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.969+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 msgr2=0x7f4ce806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.969+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 0x7f4ce806e160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4036000 tx=0x7f4cf4008030 comp rx=0 tx=0).stop 2024-03-08T20:29:50.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.969+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 msgr2=0x7f4d080ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.969+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800e8c0 tx=0x7f4cf800ed80 comp rx=0 tx=0).stop 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 shutdown_connections 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f4ce806bca0 0x7f4ce806e160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d081fb950 0x7f4d080ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d08158430 0x7f4d080ad250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 --2- 172.21.15.118:0/1730562135 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d081520a0 0x7f4d081f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.970+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 >> 172.21.15.118:0/1730562135 conn(0x7f4d08072860 msgr2=0x7f4d08156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.970 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.971+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 shutdown_connections 2024-03-08T20:29:50.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.971+0000 7f4d0ca00640 1 -- 172.21.15.118:0/1730562135 wait complete. 2024-03-08T20:29:50.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.992+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d6006d8d0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.993+0000 7f9d57e00640 1 -- 172.21.15.118:0/2683284876 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d4c0590a0 con 0x7f9d600c8bd0 2024-03-08T20:29:50.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-03-08T20:29:50.993 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-03-08T20:29:50.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 msgr2=0x7f9d4006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.995 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 0x7f9d4006e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d50034000 tx=0x7f9d50008030 comp rx=0 tx=0).stop 2024-03-08T20:29:50.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 msgr2=0x7f9d600ab5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:50.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d800 tx=0x7f9d4c00dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 shutdown_connections 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9d4006bc20 0x7f9d4006e0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d601526e0 0x7f9d601eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9d600c8bd0 0x7f9d600ab5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 --2- 172.21.15.118:0/2683284876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d600c8750 0x7f9d60158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.996+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 >> 172.21.15.118:0/2683284876 conn(0x7f9d60072c30 msgr2=0x7f9d6014ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.997+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 shutdown_connections 2024-03-08T20:29:50.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:50.997+0000 7f9d67000640 1 -- 172.21.15.118:0/2683284876 wait complete. 2024-03-08T20:29:51.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.003+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbc440c7580 con 0x7fbc440a7c60 2024-03-08T20:29:51.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.004+0000 7fbc41600640 1 -- 172.21.15.118:0/1773341801 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc38058ad0 con 0x7fbc440a7c60 2024-03-08T20:29:51.004 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:51.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.006+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fae9006d8d0 con 0x7fae901526e0 2024-03-08T20:29:51.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.006+0000 7fae8d600640 1 -- 172.21.15.118:0/3951451484 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae88010040 con 0x7fae901526e0 2024-03-08T20:29:51.006 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:51.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.007+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f78480c21b0 con 0x7f78481526e0 2024-03-08T20:29:51.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 msgr2=0x7fbc2406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 0x7fbc2406e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc440aea40 tx=0x7fbc30009040 comp rx=0 tx=0).stop 2024-03-08T20:29:51.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 msgr2=0x7fbc441e5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c4b0 tx=0x7fbc3800c970 comp rx=0 tx=0).stop 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 shutdown_connections 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbc2406bbd0 0x7fbc2406e090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc440c8b20 0x7fbc441eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc440c2860 0x7fbc44158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 --2- 172.21.15.118:0/1773341801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc440a7c60 0x7fbc441e5680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 >> 172.21.15.118:0/1773341801 conn(0x7fbc44066e40 msgr2=0x7fbc4406f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 shutdown_connections 2024-03-08T20:29:51.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7f783fe00640 1 -- 172.21.15.118:0/4010818195 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78480c21b0 con 0x7f78481526e0 2024-03-08T20:29:51.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.008+0000 7fbc4c000640 1 -- 172.21.15.118:0/1773341801 wait complete. 2024-03-08T20:29:51.009 INFO:teuthology.orchestra.run.smithi118.stdout:55834574855 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.009+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 msgr2=0x7fae7006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.009+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 0x7fae7006e0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae84005880 tx=0x7fae84009040 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.009+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 msgr2=0x7fae90158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.009+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fae8800efc0 tx=0x7fae8800c490 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 shutdown_connections 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fae7006bc20 0x7fae7006e0e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae901526e0 0x7fae90158e60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae900c8bd0 0x7fae90158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 --2- 172.21.15.118:0/3951451484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae900c8750 0x7fae900abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 >> 172.21.15.118:0/3951451484 conn(0x7fae90072c30 msgr2=0x7fae900ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6bc04f050 con 0x7fb6bc159380 2024-03-08T20:29:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36f0072220 con 0x7f36f00c8bd0 2024-03-08T20:29:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 shutdown_connections 2024-03-08T20:29:51.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.010+0000 7fae98400640 1 -- 172.21.15.118:0/3951451484 wait complete. 2024-03-08T20:29:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.011+0000 7fb6b3e00640 1 -- 172.21.15.118:0/2438373601 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6a8069240 con 0x7fb6bc159380 2024-03-08T20:29:51.012 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:51.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.011+0000 7f36ed600640 1 -- 172.21.15.118:0/3671901344 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36d805bdb0 con 0x7f36f00c8bd0 2024-03-08T20:29:51.012 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.011+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 msgr2=0x7f782806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 0x7f782806e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7838036000 tx=0x7f7838008030 comp rx=0 tx=0).stop 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 msgr2=0x7f784814bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f784814bf00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f784000c7b0 tx=0x7f784000cc70 comp rx=0 tx=0).stop 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 shutdown_connections 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f782806bbd0 0x7f782806e090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78481526e0 0x7f784814bf00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f78480c8bd0 0x7f784814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 --2- 172.21.15.118:0/4010818195 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f78480c8750 0x7f7848153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.012+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 >> 172.21.15.118:0/4010818195 conn(0x7f7848072c30 msgr2=0x7f78481503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.013+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 msgr2=0x7fb69c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.013+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 0x7fb69c06e0e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4003be0 tx=0x7fb6b4009950 comp rx=0 tx=0).stop 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.013+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 msgr2=0x7fb6bc15add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.013+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 0x7fb6bc15add0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c370 tx=0x7fb6a800c830 comp rx=0 tx=0).stop 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 shutdown_connections 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb69c06bc20 0x7fb69c06e0e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6bc0afe50 0x7fb6bc0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6bc159380 0x7fb6bc15add0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 --2- 172.21.15.118:0/2438373601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6bc0ce4d0 0x7fb6bc0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 >> 172.21.15.118:0/2438373601 conn(0x7fb6bc06aef0 msgr2=0x7fb6bc154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 shutdown_connections 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7fb6c3200640 1 -- 172.21.15.118:0/2438373601 wait complete. 2024-03-08T20:29:51.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 shutdown_connections 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.014+0000 7f784f200640 1 -- 172.21.15.118:0/4010818195 wait complete. 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 msgr2=0x7f36cc06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 0x7f36cc06e290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005880 tx=0x7f36e0009040 comp rx=0 tx=0).stop 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 msgr2=0x7f36f00c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c4160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f36d800c390 tx=0x7f36d800c850 comp rx=0 tx=0).stop 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 shutdown_connections 2024-03-08T20:29:51.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f36cc06bdd0 0x7f36cc06e290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f36f01526e0 0x7f36f00c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36f00c8bd0 0x7f36f00c4160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 --2- 172.21.15.118:0/3671901344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36f00c8750 0x7f36f00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 >> 172.21.15.118:0/3671901344 conn(0x7f36f0072c30 msgr2=0x7f36f01503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.015+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 shutdown_connections 2024-03-08T20:29:51.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:51.016+0000 7f36f7800640 1 -- 172.21.15.118:0/3671901344 wait complete. 2024-03-08T20:29:51.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-03-08T20:29:51.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-03-08T20:29:51.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-03-08T20:29:51.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-03-08T20:29:51.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-03-08T20:29:51.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-03-08T20:29:51.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-08T20:29:51.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-08T20:29:52.019 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-08T20:29:52.036 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-08T20:29:52.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-08T20:29:52.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-08T20:29:52.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-08T20:29:52.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-08T20:29:52.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.256+0000 7f20a4c00640 1 Processor -- start 2024-03-08T20:29:52.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.256+0000 7f20a4c00640 1 -- start start 2024-03-08T20:29:52.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.258+0000 7f20a4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980d7920 0x7f209800edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.258+0000 7f20a4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f209800fcf0 0x7f20980069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.258+0000 7f20a4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20980d7d00 con 0x7f2098050720 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.258+0000 7f20a4c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980db250 con 0x7f209800fcf0 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.258+0000 7f20a4c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209804ba00 con 0x7f20980d7920 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.259+0000 7f209f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980d7920 0x7f209800edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.259+0000 7f209f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980d7920 0x7f209800edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57034/0 (socket says 172.21.15.118:57034) 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.259+0000 7f209f400640 1 -- 172.21.15.118:0/1699961991 learned_addr learned my addr 172.21.15.118:0/1699961991 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.260+0000 7f209fe00640 1 --2- 172.21.15.118:0/1699961991 >> v2:172.21.15.118:3300/0 conn(0x7f209800fcf0 0x7f20980069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.261+0000 7f209e000640 1 -- 172.21.15.118:0/1699961991 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668300610 0 0) 0x7f20980d7d00 con 0x7f2098050720 2024-03-08T20:29:52.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.261+0000 7f209e000640 1 -- 172.21.15.118:0/1699961991 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2088003520 con 0x7f2098050720 2024-03-08T20:29:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.262+0000 7f209f400640 1 -- 172.21.15.118:0/1699961991 >> v2:172.21.15.118:3300/0 conn(0x7f209800fcf0 msgr2=0x7f20980069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.262+0000 7f209f400640 1 --2- 172.21.15.118:0/1699961991 >> v2:172.21.15.118:3300/0 conn(0x7f209800fcf0 0x7f20980069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.262+0000 7f209f400640 1 -- 172.21.15.118:0/1699961991 >> v1:172.21.15.144:6789/0 conn(0x7f2098050720 legacy=0x7f20980062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.262+0000 7f209f400640 1 -- 172.21.15.118:0/1699961991 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209804bce0 con 0x7f20980d7920 2024-03-08T20:29:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.263+0000 7f209f400640 1 --2- 172.21.15.118:0/1699961991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f209800edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20a00502c0 tx=0x7f20a00a6870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=470314699a57326f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.263 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.264+0000 7f209e000640 1 -- 172.21.15.118:0/1699961991 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0067050 con 0x7f20980d7920 2024-03-08T20:29:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.264+0000 7f209e000640 1 -- 172.21.15.118:0/1699961991 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a00671f0 con 0x7f20980d7920 2024-03-08T20:29:52.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.264+0000 7f209e000640 1 -- 172.21.15.118:0/1699961991 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0067050 con 0x7f20980d7920 2024-03-08T20:29:52.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 -- 172.21.15.118:0/1699961991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 msgr2=0x7f209800edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.265 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 --2- 172.21.15.118:0/1699961991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f209800edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20a00502c0 tx=0x7f20a00a6870 comp rx=0 tx=0).stop 2024-03-08T20:29:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 -- 172.21.15.118:0/1699961991 shutdown_connections 2024-03-08T20:29:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 --2- 172.21.15.118:0/1699961991 >> v2:172.21.15.118:3300/0 conn(0x7f209800fcf0 0x7f20980069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 --2- 172.21.15.118:0/1699961991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f209800edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.266+0000 7f20a4c00640 1 -- 172.21.15.118:0/1699961991 >> 172.21.15.118:0/1699961991 conn(0x7f209804fc00 msgr2=0x7f2098050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.266 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.267+0000 7f20a4c00640 1 -- 172.21.15.118:0/1699961991 shutdown_connections 2024-03-08T20:29:52.267 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.267+0000 7f20a4c00640 1 -- 172.21.15.118:0/1699961991 wait complete. 2024-03-08T20:29:52.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.271+0000 7f20a4c00640 1 Processor -- start 2024-03-08T20:29:52.270 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.271+0000 7f20a4c00640 1 -- start start 2024-03-08T20:29:52.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.273+0000 7f20a4c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.273+0000 7f20a4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 0x7f209816ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.274+0000 7f20a4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f2098034230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.274+0000 7f209f400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.274+0000 7f209f400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48472/0 (socket says 172.21.15.118:48472) 2024-03-08T20:29:52.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.274+0000 7f209f400640 1 -- 172.21.15.118:0/2559842509 learned_addr learned my addr 172.21.15.118:0/2559842509 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.274+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2098006f10 con 0x7f2098050720 2024-03-08T20:29:52.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209804c2a0 con 0x7f20980d7920 2024-03-08T20:29:52.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7fd0be800640 1 Processor -- start 2024-03-08T20:29:52.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980dad20 con 0x7f209800fcf0 2024-03-08T20:29:52.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7fd0be800640 1 -- start start 2024-03-08T20:29:52.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7f209fe00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f2098034230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.275+0000 7f209ea00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 0x7f209816ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.277+0000 7fd0be800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209f400640 1 -- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 msgr2=0x7f2098034230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209f400640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f2098034230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209f400640 1 -- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 msgr2=0x7f209816ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209f400640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 0x7f209816ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209f400640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980d1de0 con 0x7f209800fcf0 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209fe00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f2098034230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.276+0000 7f209ea00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 0x7f209816ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:52.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.277+0000 7fd0be800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0b80c8750 0x7fd0b81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.277+0000 7fd0b7400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0b7e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd0b80c8bd0 0x7fd0b80c5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57968/0 (socket says 172.21.15.118:57968) 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0b7400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56940/0 (socket says 172.21.15.118:56940) 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0b7e00640 1 -- 172.21.15.118:0/26349516 learned_addr learned my addr 172.21.15.118:0/26349516 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0b6a00640 1 --2- 172.21.15.118:0/26349516 >> v2:172.21.15.144:3300/0 conn(0x7fd0b80c8750 0x7fd0b81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b8159510 con 0x7fd0b80c8bd0 2024-03-08T20:29:52.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b8155250 con 0x7fd0b81526e0 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.278+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80c71d0 con 0x7fd0b80c8750 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b6a00640 1 -- 172.21.15.118:0/26349516 >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 msgr2=0x7fd0b8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b6000640 1 -- 172.21.15.118:0/26349516 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573203773 0 0) 0x7fd0b8159510 con 0x7fd0b80c8bd0 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b6a00640 1 --2- 172.21.15.118:0/26349516 >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b6a00640 1 -- 172.21.15.118:0/26349516 >> v1:172.21.15.118:6789/0 conn(0x7fd0b80c8bd0 legacy=0x7fd0b80c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b6a00640 1 -- 172.21.15.118:0/26349516 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80c74b0 con 0x7fd0b80c8750 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7fd0b7400640 1 --2- 172.21.15.118:0/26349516 >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:52.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.279+0000 7f209f400640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20a0069230 tx=0x7f20a0068a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.281+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0067050 con 0x7f209800fcf0 2024-03-08T20:29:52.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.282+0000 7fd0b6a00640 1 --2- 172.21.15.118:0/26349516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8750 0x7fd0b81556e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0b81553d0 tx=0x7fd0b002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe525fe32b1570e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.282+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20981704d0 con 0x7f209800fcf0 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.282+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20980d2360 con 0x7f209800fcf0 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.282+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0061940 con 0x7f209800fcf0 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.282+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0061d30 con 0x7f209800fcf0 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.283+0000 7fd0b6000640 1 -- 172.21.15.118:0/26349516 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0039070 con 0x7fd0b80c8750 2024-03-08T20:29:52.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.285+0000 7fd0b6000640 1 -- 172.21.15.118:0/26349516 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b002cbd0 con 0x7fd0b80c8750 2024-03-08T20:29:52.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.285+0000 7fd0b6000640 1 -- 172.21.15.118:0/26349516 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0039070 con 0x7fd0b80c8750 2024-03-08T20:29:52.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:29:52.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.286+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8750 msgr2=0x7fd0b81556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.286+0000 7fd0be800640 1 --2- 172.21.15.118:0/26349516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8750 0x7fd0b81556e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0b81553d0 tx=0x7fd0b002be20 comp rx=0 tx=0).stop 2024-03-08T20:29:52.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.285+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c005290 con 0x7f209800fcf0 2024-03-08T20:29:52.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.289+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f20a00bf440 con 0x7f209800fcf0 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.289+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 shutdown_connections 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.289+0000 7fd0be800640 1 --2- 172.21.15.118:0/26349516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8750 0x7fd0b81556e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.289+0000 7fd0be800640 1 --2- 172.21.15.118:0/26349516 >> v2:172.21.15.118:3300/0 conn(0x7fd0b81526e0 0x7fd0b8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.289+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 >> 172.21.15.118:0/26349516 conn(0x7fd0b8072c30 msgr2=0x7fd0b80ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.290+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 shutdown_connections 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.291+0000 7f208f400640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 0x7f208406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.291+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f20a0127d80 con 0x7f209800fcf0 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.292+0000 7f209ea00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 0x7f208406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.293+0000 7f209ea00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 0x7f208406e190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20980d4dc0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.290+0000 7fd0be800640 1 -- 172.21.15.118:0/26349516 wait complete. 2024-03-08T20:29:52.301 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.292+0000 7fd0be800640 1 Processor -- start 2024-03-08T20:29:52.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.293+0000 7fd0be800640 1 -- start start 2024-03-08T20:29:52.302 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.294+0000 7fd0be800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 0x7fd0b81fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.294+0000 7fd0be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 0x7fd0b80abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.294+0000 7fd0be800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0be800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c5850 con 0x7fd0b80c8750 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0be800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c7a70 con 0x7fd0b80c8bd0 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0be800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c59d0 con 0x7fd0b81526e0 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0b7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 0x7fd0b81fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0b7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0b7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48476/0 (socket says 172.21.15.118:48476) 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.295+0000 7fd0b7e00640 1 -- 172.21.15.118:0/33613576 learned_addr learned my addr 172.21.15.118:0/33613576 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b6a00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 0x7fd0b80abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b7e00640 1 -- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 msgr2=0x7fd0b80abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b7e00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 0x7fd0b80abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b7e00640 1 -- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 msgr2=0x7fd0b81fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b7e00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 0x7fd0b81fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.296+0000 7fd0b7e00640 1 -- 172.21.15.118:0/33613576 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b81fba70 con 0x7fd0b81526e0 2024-03-08T20:29:52.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.298+0000 7fd0b6a00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 0x7fd0b80abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.299+0000 7fd0b7400640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 0x7fd0b81fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:52.304 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.300+0000 7fd0b7e00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c450 tx=0x7fd0a400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.306 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.306+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f20a00bb070 con 0x7f209800fcf0 2024-03-08T20:29:52.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.306+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4018070 con 0x7fd0b81526e0 2024-03-08T20:29:52.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.307+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4007500 con 0x7fd0b81526e0 2024-03-08T20:29:52.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.307+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4004a20 con 0x7fd0b81526e0 2024-03-08T20:29:52.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.308+0000 7fd0be800640 1 -- 172.21.15.118:0/33613576 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b8154f30 con 0x7fd0b81526e0 2024-03-08T20:29:52.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.308+0000 7fd0be800640 1 -- 172.21.15.118:0/33613576 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b8154c50 con 0x7fd0b81526e0 2024-03-08T20:29:52.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.318+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b8074a40 con 0x7fd0b81526e0 2024-03-08T20:29:52.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.319+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd0a401b070 con 0x7fd0b81526e0 2024-03-08T20:29:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.320+0000 7fd0af400640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 0x7fd09806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.320+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd0a408a1b0 con 0x7fd0b81526e0 2024-03-08T20:29:52.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.322+0000 7fd0b7400640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 0x7fd09806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.323+0000 7fd0b7400640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 0x7fd09806e160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009ba0 tx=0x7fd0a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.338+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd0a4058a90 con 0x7fd0b81526e0 2024-03-08T20:29:52.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.342+0000 7f829a400640 1 Processor -- start 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.342+0000 7f829a400640 1 -- start start 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.344+0000 7f829a400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 0x7f82940ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.344+0000 7f829a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 0x7f8294154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.344+0000 7f829a400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940c2b80 con 0x7f82940c6690 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.344+0000 7f829a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8294150dc0 con 0x7f82940c6af0 2024-03-08T20:29:52.344 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.344+0000 7f829a400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8294151010 con 0x7f82940c27a0 2024-03-08T20:29:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.346+0000 7f8293e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 0x7f8294154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.346+0000 7f8293e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 0x7f8294154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56962/0 (socket says 172.21.15.118:56962) 2024-03-08T20:29:52.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.346+0000 7f8293e00640 1 -- 172.21.15.118:0/2315145058 learned_addr learned my addr 172.21.15.118:0/2315145058 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.346+0000 7f8293400640 1 --2- 172.21.15.118:0/2315145058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 0x7f82940ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.347+0000 7f8293400640 1 -- 172.21.15.118:0/2315145058 >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 msgr2=0x7f8294154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.347+0000 7f8293400640 1 --2- 172.21.15.118:0/2315145058 >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 0x7f8294154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.347+0000 7f8293400640 1 -- 172.21.15.118:0/2315145058 >> v1:172.21.15.118:6789/0 conn(0x7f82940c6690 legacy=0x7f8294154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.347+0000 7f8293400640 1 -- 172.21.15.118:0/2315145058 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82941512f0 con 0x7f82940c27a0 2024-03-08T20:29:52.348 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.349+0000 7f8293400640 1 --2- 172.21.15.118:0/2315145058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 0x7f82940ab3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82840097a0 tx=0x7f828402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1284e5e15d828d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.349 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.350+0000 7fe286400640 1 Processor -- start 2024-03-08T20:29:52.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.351+0000 7f8292000640 1 -- 172.21.15.118:0/2315145058 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284035020 con 0x7f82940c27a0 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.351+0000 7f8292000640 1 -- 172.21.15.118:0/2315145058 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284031640 con 0x7f82940c27a0 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.351+0000 7f8292000640 1 -- 172.21.15.118:0/2315145058 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828402d040 con 0x7f82940c27a0 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.353+0000 7f829a400640 1 -- 172.21.15.118:0/2315145058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 msgr2=0x7f82940ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.353+0000 7f829a400640 1 --2- 172.21.15.118:0/2315145058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 0x7f82940ab3c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82840097a0 tx=0x7f828402b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.354+0000 7f829a400640 1 -- 172.21.15.118:0/2315145058 shutdown_connections 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.354+0000 7f829a400640 1 --2- 172.21.15.118:0/2315145058 >> v2:172.21.15.118:3300/0 conn(0x7f82940c6af0 0x7f8294154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.354+0000 7f829a400640 1 --2- 172.21.15.118:0/2315145058 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c27a0 0x7f82940ab3c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.354+0000 7f829a400640 1 -- 172.21.15.118:0/2315145058 >> 172.21.15.118:0/2315145058 conn(0x7f829406d550 msgr2=0x7f82940a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.350+0000 7fe286400640 1 -- start start 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.352+0000 7fe286400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2780d3be0 0x7fe278006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.352+0000 7fe286400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780d6ef0 con 0x7fe27800ba30 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.352+0000 7fe286400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780d7190 con 0x7fe2780070d0 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.352+0000 7fe286400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780d7470 con 0x7fe2780d3be0 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.353+0000 7fe27f400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2780d3be0 0x7fe278006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.353+0000 7fe284e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe2780070d0 0x7fe2780e0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:52360/0 (socket says 172.21.15.118:52360) 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.353+0000 7fe284e00640 1 -- 172.21.15.118:0/1673115712 learned_addr learned my addr 172.21.15.118:0/1673115712 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.354+0000 7fe27e000640 1 -- 172.21.15.118:0/1673115712 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769938021 0 0) 0x7fe2780d7190 con 0x7fe2780070d0 2024-03-08T20:29:52.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7fc577200640 1 Processor -- start 2024-03-08T20:29:52.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7fe27f400640 1 -- 172.21.15.118:0/1673115712 >> v1:172.21.15.144:6789/0 conn(0x7fe2780070d0 legacy=0x7fe2780e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7fe27f400640 1 -- 172.21.15.118:0/1673115712 >> v1:172.21.15.118:6789/0 conn(0x7fe27800ba30 legacy=0x7fe2780d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7fe27f400640 1 -- 172.21.15.118:0/1673115712 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278046460 con 0x7fe2780d3be0 2024-03-08T20:29:52.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7f829a400640 1 -- 172.21.15.118:0/2315145058 shutdown_connections 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fe27f400640 1 --2- 172.21.15.118:0/1673115712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278006b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2740097a0 tx=0x7fe27402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35412913bcdbd5b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.355+0000 7fc577200640 1 -- start start 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fc577200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc570050720 0x7fc5700062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fc577200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57000fcf0 0x7fc570006800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fc577200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700d7d00 con 0x7fc5700d7920 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fc577200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5700db250 con 0x7fc570050720 2024-03-08T20:29:52.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.357+0000 7fc577200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57004ba00 con 0x7fc57000fcf0 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.356+0000 7f829a400640 1 -- 172.21.15.118:0/2315145058 wait complete. 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.358+0000 7f829a400640 1 Processor -- start 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.359+0000 7f829a400640 1 -- start start 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.358+0000 7fc576800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57000fcf0 0x7fc570006800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.359+0000 7fc576800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc57000fcf0 0x7fc570006800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57060/0 (socket says 172.21.15.118:57060) 2024-03-08T20:29:52.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.359+0000 7fc576800640 1 -- 172.21.15.118:0/2327806239 learned_addr learned my addr 172.21.15.118:0/2327806239 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.359+0000 7fe27e000640 1 -- 172.21.15.118:0/1673115712 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274037070 con 0x7fe2780d3be0 2024-03-08T20:29:52.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.360+0000 7fe27e000640 1 -- 172.21.15.118:0/1673115712 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe274030710 con 0x7fe2780d3be0 2024-03-08T20:29:52.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.360+0000 7fe27e000640 1 -- 172.21.15.118:0/1673115712 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274037070 con 0x7fe2780d3be0 2024-03-08T20:29:52.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fc576800640 1 -- 172.21.15.118:0/2327806239 >> v2:172.21.15.118:3300/0 conn(0x7fc570050720 msgr2=0x7fc5700062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fc576800640 1 --2- 172.21.15.118:0/2327806239 >> v2:172.21.15.118:3300/0 conn(0x7fc570050720 0x7fc5700062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fc576800640 1 -- 172.21.15.118:0/2327806239 >> v1:172.21.15.118:6789/0 conn(0x7fc5700d7920 legacy=0x7fc57000edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fc576800640 1 -- 172.21.15.118:0/2327806239 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57004bce0 con 0x7fc57000fcf0 2024-03-08T20:29:52.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fc574a00640 1 -- 172.21.15.118:0/2327806239 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987254228 0 0) 0x7fc5700d7d00 con 0x7fc5700d7920 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7feca6a00640 1 Processor -- start 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7feca6a00640 1 -- start start 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fe286400640 1 -- 172.21.15.118:0/1673115712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 msgr2=0x7fe278006b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.361+0000 7fe286400640 1 --2- 172.21.15.118:0/1673115712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278006b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2740097a0 tx=0x7fe27402b710 comp rx=0 tx=0).stop 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.362+0000 7fe286400640 1 -- 172.21.15.118:0/1673115712 shutdown_connections 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.362+0000 7fe286400640 1 --2- 172.21.15.118:0/1673115712 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278006b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.362+0000 7fe286400640 1 -- 172.21.15.118:0/1673115712 >> 172.21.15.118:0/1673115712 conn(0x7fe278006070 msgr2=0x7fe278006480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7feca6a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 0x7feca00717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 0x7f82940c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 0x7f8294071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8294151b90 con 0x7f82940c6690 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941518b0 con 0x7f82940c27a0 2024-03-08T20:29:52.364 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f829a400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82941551b0 con 0x7f82940c6af0 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7feca6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feca015f500 0x7feca0165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7f8293e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7f8293e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48492/0 (socket says 172.21.15.118:48492) 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7f8293e00640 1 -- 172.21.15.118:0/345303706 learned_addr learned my addr 172.21.15.118:0/345303706 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7feca6a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca00c0f40 con 0x7feca015fa20 2024-03-08T20:29:52.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.363+0000 7feca6a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca0071d00 con 0x7feca008a9d0 2024-03-08T20:29:52.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7feca6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca00c1220 con 0x7feca015f500 2024-03-08T20:29:52.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7f8293400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 0x7f82940c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7fe286400640 1 -- 172.21.15.118:0/1673115712 shutdown_connections 2024-03-08T20:29:52.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7fe286400640 1 -- 172.21.15.118:0/1673115712 wait complete. 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7feca6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feca015f500 0x7feca0165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7feca6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feca015f500 0x7feca0165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57072/0 (socket says 172.21.15.118:57072) 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7feca6000640 1 -- 172.21.15.118:0/570013025 learned_addr learned my addr 172.21.15.118:0/570013025 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7feca5600640 1 --2- 172.21.15.118:0/570013025 >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 0x7feca00717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7feca6000640 1 -- 172.21.15.118:0/570013025 >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 msgr2=0x7feca00717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7feca6000640 1 --2- 172.21.15.118:0/570013025 >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 0x7feca00717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.367 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7feca6000640 1 -- 172.21.15.118:0/570013025 >> v1:172.21.15.118:6789/0 conn(0x7feca015fa20 legacy=0x7feca015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7fc576800640 1 --2- 172.21.15.118:0/2327806239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc570006800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5700da2d0 tx=0x7fc56802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28c7e168124ba57 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7f8292a00640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 0x7f8294071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.364+0000 7f8293e00640 1 -- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 msgr2=0x7f82940c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7f8293e00640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 0x7f82940c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7f8293e00640 1 -- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 msgr2=0x7f8294071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.368 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7f8293e00640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 0x7f8294071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.365+0000 7f8293e00640 1 -- 172.21.15.118:0/345303706 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940c58c0 con 0x7f82940c6af0 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7f8292a00640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 0x7f8294071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7f8293400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 0x7f82940c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7f8293e00640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f828c00b050 tx=0x7f828c00b510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7fc574a00640 1 -- 172.21.15.118:0/2327806239 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568034070 con 0x7fc57000fcf0 2024-03-08T20:29:52.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c01b070 con 0x7f82940c6af0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c003b90 con 0x7f82940c6af0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82941e6f80 con 0x7f82940c6af0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c004030 con 0x7f82940c6af0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7fc574a00640 1 -- 172.21.15.118:0/2327806239 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568030800 con 0x7fc57000fcf0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7fc574a00640 1 -- 172.21.15.118:0/2327806239 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568030bd0 con 0x7fc57000fcf0 2024-03-08T20:29:52.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7feca6000640 1 -- 172.21.15.118:0/570013025 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca006e5b0 con 0x7feca015f500 2024-03-08T20:29:52.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.366+0000 7feca5600640 1 --2- 172.21.15.118:0/570013025 >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 0x7feca00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.367+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82941e7260 con 0x7f82940c6af0 2024-03-08T20:29:52.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.368+0000 7fe286400640 1 Processor -- start 2024-03-08T20:29:52.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.368+0000 7fe286400640 1 -- start start 2024-03-08T20:29:52.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.369+0000 7fc577200640 1 -- 172.21.15.118:0/2327806239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 msgr2=0x7fc570006800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.369+0000 7fc577200640 1 --2- 172.21.15.118:0/2327806239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc570006800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5700da2d0 tx=0x7fc56802b940 comp rx=0 tx=0).stop 2024-03-08T20:29:52.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.368+0000 7feca6000640 1 --2- 172.21.15.118:0/570013025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015f500 0x7feca0165190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feca00c1500 tx=0x7fec9802e140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ccd03249bf6ffd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fec9fe00640 1 -- 172.21.15.118:0/570013025 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800b0d0 con 0x7feca015f500 2024-03-08T20:29:52.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fc577200640 1 -- 172.21.15.118:0/2327806239 shutdown_connections 2024-03-08T20:29:52.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fec9fe00640 1 -- 172.21.15.118:0/570013025 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800b270 con 0x7feca015f500 2024-03-08T20:29:52.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fc577200640 1 --2- 172.21.15.118:0/2327806239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc570006800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fc577200640 1 --2- 172.21.15.118:0/2327806239 >> v2:172.21.15.118:3300/0 conn(0x7fc570050720 0x7fc5700062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fec9fe00640 1 -- 172.21.15.118:0/570013025 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98009820 con 0x7feca015f500 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fc577200640 1 -- 172.21.15.118:0/2327806239 >> 172.21.15.118:0/2327806239 conn(0x7fc57004fc00 msgr2=0x7fc570050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 0x7fe2780d56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278177e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27802e2f0 con 0x7fe2780d3be0 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278046a20 con 0x7fe27800ba30 2024-03-08T20:29:52.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe286400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe278046f40 con 0x7fe2780070d0 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe27ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe27ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57078/0 (socket says 172.21.15.118:57078) 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe27ea00640 1 -- 172.21.15.118:0/2269585094 learned_addr learned my addr 172.21.15.118:0/2269585094 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.370+0000 7fe27f400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 0x7fe2780d56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe284e00640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278177e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829414ea10 con 0x7f82940c6af0 2024-03-08T20:29:52.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe27ea00640 1 -- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 msgr2=0x7fe2780d56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe27ea00640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 0x7fe2780d56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe27ea00640 1 -- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 msgr2=0x7fe278177e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe27ea00640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278177e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fddd6a00640 1 Processor -- start 2024-03-08T20:29:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7feca6a00640 1 -- 172.21.15.118:0/570013025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015f500 msgr2=0x7feca0165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7feca6a00640 1 --2- 172.21.15.118:0/570013025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015f500 0x7feca0165190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feca00c1500 tx=0x7fec9802e140 comp rx=0 tx=0).stop 2024-03-08T20:29:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f828c01e070 con 0x7f82940c6af0 2024-03-08T20:29:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 -- 172.21.15.118:0/570013025 shutdown_connections 2024-03-08T20:29:52.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7fddd6a00640 1 -- start start 2024-03-08T20:29:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 --2- 172.21.15.118:0/570013025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015f500 0x7feca0165190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 --2- 172.21.15.118:0/570013025 >> v2:172.21.15.118:3300/0 conn(0x7feca008a9d0 0x7feca00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 -- 172.21.15.118:0/570013025 >> 172.21.15.118:0/570013025 conn(0x7feca006ad10 msgr2=0x7feca006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.371+0000 7fe27ea00640 1 -- 172.21.15.118:0/2269585094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780d1530 con 0x7fe27800ba30 2024-03-08T20:29:52.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7fe284e00640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278177e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:29:52.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7fe27f400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 0x7fe2780d56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7fe27ea00640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00c780 tx=0x7fe26c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 -- 172.21.15.118:0/570013025 shutdown_connections 2024-03-08T20:29:52.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7fc577200640 1 -- 172.21.15.118:0/2327806239 shutdown_connections 2024-03-08T20:29:52.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.372+0000 7feca6a00640 1 -- 172.21.15.118:0/570013025 wait complete. 2024-03-08T20:29:52.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7fe4aee00640 1 Processor -- start 2024-03-08T20:29:52.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7fe4aee00640 1 -- start start 2024-03-08T20:29:52.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7f828b400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 0x7f827406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.373+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f828c08b280 con 0x7f82940c6af0 2024-03-08T20:29:52.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7f8293400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 0x7f827406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd6a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fddd0152610 0x7fddd01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd006dd80 0x7fddd00c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd6a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd01529f0 con 0x7fddd0158b00 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd6a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00c1b50 con 0x7fddd0152610 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd0159010 con 0x7fddd006dd80 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd006dd80 0x7fddd00c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd006dd80 0x7fddd00c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57084/0 (socket says 172.21.15.118:57084) 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fddd4a00640 1 -- 172.21.15.118:0/2419678890 learned_addr learned my addr 172.21.15.118:0/2419678890 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fddd4a00640 1 -- 172.21.15.118:0/2419678890 >> v2:172.21.15.118:3300/0 conn(0x7fddd0152610 msgr2=0x7fddd01585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fddd4a00640 1 --2- 172.21.15.118:0/2419678890 >> v2:172.21.15.118:3300/0 conn(0x7fddd0152610 0x7fddd01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fddd4a00640 1 -- 172.21.15.118:0/2419678890 >> v1:172.21.15.118:6789/0 conn(0x7fddd0158b00 legacy=0x7fddd00c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fddd4a00640 1 -- 172.21.15.118:0/2419678890 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd01592f0 con 0x7fddd006dd80 2024-03-08T20:29:52.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7feca6a00640 1 Processor -- start 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fe4aee00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 0x7fe4a80c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fe4aee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a806c540 0x7fe4a806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fe4aee00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a81550d0 con 0x7fe4a8152590 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fe4aee00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a8152970 con 0x7fe4a80c51a0 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.375+0000 7fe4aee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80c8e30 con 0x7fe4a806c540 2024-03-08T20:29:52.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7f8293400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 0x7f827406e0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8284036000 tx=0x7f8284008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.374+0000 7fc577200640 1 -- 172.21.15.118:0/2327806239 wait complete. 2024-03-08T20:29:52.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7feca6a00640 1 -- start start 2024-03-08T20:29:52.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fc577200640 1 Processor -- start 2024-03-08T20:29:52.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c017070 con 0x7fe27800ba30 2024-03-08T20:29:52.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c005270 con 0x7fe27800ba30 2024-03-08T20:29:52.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fe4ace00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a806c540 0x7fe4a806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00a840 con 0x7fe27800ba30 2024-03-08T20:29:52.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780d17d0 con 0x7fe27800ba30 2024-03-08T20:29:52.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.376+0000 7fc577200640 1 -- start start 2024-03-08T20:29:52.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2780d1d90 con 0x7fe27800ba30 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe4ace00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a806c540 0x7fe4a806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57096/0 (socket says 172.21.15.118:57096) 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe4ace00640 1 -- 172.21.15.118:0/1901441490 learned_addr learned my addr 172.21.15.118:0/1901441490 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe4a7400640 1 --2- 172.21.15.118:0/1901441490 >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 0x7fe4a80c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.377+0000 7fe4ace00640 1 -- 172.21.15.118:0/1901441490 >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 msgr2=0x7fe4a80c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fe4ace00640 1 --2- 172.21.15.118:0/1901441490 >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 0x7fe4a80c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fe4ace00640 1 -- 172.21.15.118:0/1901441490 >> v1:172.21.15.118:6789/0 conn(0x7fe4a8152590 legacy=0x7fe4a80c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fe4ace00640 1 -- 172.21.15.118:0/1901441490 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8155390 con 0x7fe4a806c540 2024-03-08T20:29:52.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fc577200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc5700dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fc577200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.378+0000 7fc577200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 0x7fc57017dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278005570 con 0x7fe27800ba30 2024-03-08T20:29:52.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc575400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc577200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000f4c0 con 0x7fc5700d7920 2024-03-08T20:29:52.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc577200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57004c2a0 con 0x7fc57000fcf0 2024-03-08T20:29:52.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc577200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57000f640 con 0x7fc570050720 2024-03-08T20:29:52.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fe4a7400640 1 --2- 172.21.15.118:0/1901441490 >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 0x7fe4a80c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc575400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48510/0 (socket says 172.21.15.118:48510) 2024-03-08T20:29:52.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fc575400640 1 -- 172.21.15.118:0/410884853 learned_addr learned my addr 172.21.15.118:0/410884853 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.379+0000 7fddd4a00640 1 --2- 172.21.15.118:0/2419678890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd006dd80 0x7fddd00c3310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fddd006dcd0 tx=0x7fddbc034120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86debdd4f7bf505 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc576800640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 0x7fc57017dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fe4ace00640 1 --2- 172.21.15.118:0/1901441490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a806c540 0x7fe4a806c990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80ad000 tx=0x7fe4a002bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f4d75350f762b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575e00640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc5700dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca015f500 0x7feca01f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575400640 1 -- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 msgr2=0x7fc5700dd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575400640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc5700dd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575400640 1 -- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 msgr2=0x7fc57017dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575400640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 0x7fc57017dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc575400640 1 -- 172.21.15.118:0/410884853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700dc5a0 con 0x7fc570050720 2024-03-08T20:29:52.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015fa20 0x7feca01f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca015fed0 con 0x7feca008a9d0 2024-03-08T20:29:52.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca006eb70 con 0x7feca015fa20 2024-03-08T20:29:52.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7feca6a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca0160050 con 0x7feca015f500 2024-03-08T20:29:52.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.380+0000 7fc576800640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 0x7fc57017dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:52.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7feca5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7feca5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57030/0 (socket says 172.21.15.118:57030) 2024-03-08T20:29:52.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7feca5600640 1 -- 172.21.15.118:0/260389434 learned_addr learned my addr 172.21.15.118:0/260389434 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7fc575400640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc578075c40 tx=0x7fc578074580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7feca6000640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015fa20 0x7feca01f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.381+0000 7feca4c00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca015f500 0x7feca01f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 -- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca015f500 msgr2=0x7feca01f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca015f500 0x7feca01f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 -- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015fa20 msgr2=0x7feca01f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015fa20 0x7feca01f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 -- 172.21.15.118:0/260389434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca01fa4b0 con 0x7feca008a9d0 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe26c01a070 con 0x7fe27800ba30 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca5600640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c7f0 tx=0x7fec9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94015070 con 0x7feca008a9d0 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec94007a30 con 0x7feca008a9d0 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94007e00 con 0x7feca008a9d0 2024-03-08T20:29:52.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca01fa790 con 0x7feca008a9d0 2024-03-08T20:29:52.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.382+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca01fad50 con 0x7feca008a9d0 2024-03-08T20:29:52.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.383+0000 7fe273400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 0x7fe26006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.383+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe26c08a7b0 con 0x7fe27800ba30 2024-03-08T20:29:52.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.384+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca0074a40 con 0x7feca008a9d0 2024-03-08T20:29:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.384+0000 7fe27f400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 0x7fe26006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.385+0000 7fe27f400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 0x7fe26006e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe274034000 tx=0x7fe274008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.385+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fec94018070 con 0x7feca008a9d0 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.386+0000 7fec9d600640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 0x7fec8006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.386+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fec94056eb0 con 0x7feca008a9d0 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.386+0000 7feca4c00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 0x7fec8006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.387+0000 7feca4c00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 0x7fec8006e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feca0164270 tx=0x7fec8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.392+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fec94058e10 con 0x7feca008a9d0 2024-03-08T20:29:52.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.397+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780731c0 con 0x7fc570050720 2024-03-08T20:29:52.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.397+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578073360 con 0x7fc570050720 2024-03-08T20:29:52.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.397+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578066c60 con 0x7fc570050720 2024-03-08T20:29:52.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.398+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700dc880 con 0x7fc570050720 2024-03-08T20:29:52.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.398+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700de790 con 0x7fc570050720 2024-03-08T20:29:52.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.398+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f829414ea10 con 0x7f82940c6af0 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.400+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5700dca50 con 0x7fc570050720 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.401+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc578067020 con 0x7fc570050720 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.403+0000 7fc56e000640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 0x7fc55806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.403+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc5781050c0 con 0x7fc570050720 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.404+0000 7fc575e00640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 0x7fc55806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.404+0000 7fc575e00640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 0x7fc55806e0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc564000f60 tx=0x7fc564009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fe4a6a00640 1 -- 172.21.15.118:0/1901441490 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a002caa0 con 0x7fe4a806c540 2024-03-08T20:29:52.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fddcea00640 1 -- 172.21.15.118:0/2419678890 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0110d0 con 0x7fddd006dd80 2024-03-08T20:29:52.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fddcea00640 1 -- 172.21.15.118:0/2419678890 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc011270 con 0x7fddd006dd80 2024-03-08T20:29:52.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fddcea00640 1 -- 172.21.15.118:0/2419678890 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011640 con 0x7fddd006dd80 2024-03-08T20:29:52.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe26c058fd0 con 0x7fe27800ba30 2024-03-08T20:29:52.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fe4a6a00640 1 -- 172.21.15.118:0/1901441490 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a002cc40 con 0x7fe4a806c540 2024-03-08T20:29:52.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.407+0000 7fe4a6a00640 1 -- 172.21.15.118:0/1901441490 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0034610 con 0x7fe4a806c540 2024-03-08T20:29:52.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 -- 172.21.15.118:0/1901441490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a806c540 msgr2=0x7fe4a806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 --2- 172.21.15.118:0/1901441490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a806c540 0x7fe4a806c990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80ad000 tx=0x7fe4a002bf00 comp rx=0 tx=0).stop 2024-03-08T20:29:52.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 -- 172.21.15.118:0/2419678890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd006dd80 msgr2=0x7fddd00c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 --2- 172.21.15.118:0/2419678890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd006dd80 0x7fddd00c3310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fddd006dcd0 tx=0x7fddbc034120 comp rx=0 tx=0).stop 2024-03-08T20:29:52.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 -- 172.21.15.118:0/1901441490 shutdown_connections 2024-03-08T20:29:52.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 --2- 172.21.15.118:0/1901441490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a806c540 0x7fe4a806c990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 --2- 172.21.15.118:0/1901441490 >> v2:172.21.15.118:3300/0 conn(0x7fe4a80c51a0 0x7fe4a80c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 -- 172.21.15.118:0/1901441490 >> 172.21.15.118:0/1901441490 conn(0x7fe4a8072d20 msgr2=0x7fe4a80ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 -- 172.21.15.118:0/1901441490 shutdown_connections 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fe4aee00640 1 -- 172.21.15.118:0/1901441490 wait complete. 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 -- 172.21.15.118:0/2419678890 shutdown_connections 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 --2- 172.21.15.118:0/2419678890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd006dd80 0x7fddd00c3310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 --2- 172.21.15.118:0/2419678890 >> v2:172.21.15.118:3300/0 conn(0x7fddd0152610 0x7fddd01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.408+0000 7fddd6a00640 1 -- 172.21.15.118:0/2419678890 >> 172.21.15.118:0/2419678890 conn(0x7fddd00c6580 msgr2=0x7fddd00c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.409+0000 7fddd6a00640 1 -- 172.21.15.118:0/2419678890 shutdown_connections 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.409+0000 7fddd6a00640 1 -- 172.21.15.118:0/2419678890 wait complete. 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.410+0000 7fe4aee00640 1 Processor -- start 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.410+0000 7fe4aee00640 1 -- start start 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 0x7fe4a8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 0x7fe4a80c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 0x7fe4a80c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a806dbf0 con 0x7fe4a8152590 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8155950 con 0x7fe4a80c51a0 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fe4aee00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a806ced0 con 0x7fe4a806c540 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.411+0000 7fddd6a00640 1 Processor -- start 2024-03-08T20:29:52.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fe4a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 0x7fe4a80c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fddd6a00640 1 -- start start 2024-03-08T20:29:52.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 0x7fe4a8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 0x7fe4a8156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:48532/0 (socket says 172.21.15.118:48532) 2024-03-08T20:29:52.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fe4a7e00640 1 -- 172.21.15.118:0/853016577 learned_addr learned my addr 172.21.15.118:0/853016577 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.412+0000 7fe4ace00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 0x7fe4a80c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd006dd80 0x7fddd01e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd0152610 0x7fddd00bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c2c90 con 0x7fddd0152610 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c2060 con 0x7fddd0158b00 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fddd6a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c2e10 con 0x7fddd006dd80 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddcfe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd006dd80 0x7fddd01e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:57136/0 (socket says 172.21.15.118:57136) 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 -- 172.21.15.118:0/691858506 learned_addr learned my addr 172.21.15.118:0/691858506 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 -- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd006dd80 msgr2=0x7fddd01e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd006dd80 0x7fddd01e9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 -- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd0152610 msgr2=0x7fddd00bfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd0152610 0x7fddd00bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fddd4a00640 1 -- 172.21.15.118:0/691858506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd014c690 con 0x7fddd0158b00 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fe4a7400640 1 -- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 msgr2=0x7fe4a8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fe4a7400640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 0x7fe4a8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fe4a7400640 1 -- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 msgr2=0x7fe4a80c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.413+0000 7fe4a7400640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 0x7fe4a80c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fe4a7400640 1 -- 172.21.15.118:0/853016577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8156d90 con 0x7fe4a80c51a0 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fe4ace00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 0x7fe4a80c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.414+0000 7fe4a7400640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 0x7fe4a80c2e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c820 tx=0x7fe49400cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fddd4a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fddbc034700 tx=0x7fddbc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494015070 con 0x7fe4a80c51a0 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a80c1df0 con 0x7fe4a80c51a0 2024-03-08T20:29:52.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494004220 con 0x7fe4a80c51a0 2024-03-08T20:29:52.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400ce10 con 0x7fe4a80c51a0 2024-03-08T20:29:52.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a80c23b0 con 0x7fe4a80c51a0 2024-03-08T20:29:52.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc04b020 con 0x7fddd0158b00 2024-03-08T20:29:52.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00bc8a0 con 0x7fddd0158b00 2024-03-08T20:29:52.418 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.415+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd01ea5f0 con 0x7fddd0158b00 2024-03-08T20:29:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.416+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc011270 con 0x7fddd0158b00 2024-03-08T20:29:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.416+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0468a0 con 0x7fddd0158b00 2024-03-08T20:29:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.416+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a8074a40 con 0x7fe4a80c51a0 2024-03-08T20:29:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.420+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8005290 con 0x7fddd0158b00 2024-03-08T20:29:52.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.418+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe4940077d0 con 0x7fe4a80c51a0 2024-03-08T20:29:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.419+0000 7fe49fe00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 0x7fe48806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.419+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe49408ac60 con 0x7fe4a80c51a0 2024-03-08T20:29:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.420+0000 7fe4a7e00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 0x7fe48806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.420 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.421+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fddbc04e020 con 0x7fddd0158b00 2024-03-08T20:29:52.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.422+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc5780d39a0 con 0x7fc570050720 2024-03-08T20:29:52.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.422+0000 7fddc7e00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 0x7fddb006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:52.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.422+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fddbc0b59f0 con 0x7fddd0158b00 2024-03-08T20:29:52.422 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.423+0000 7fddcfe00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 0x7fddb006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:52.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.423+0000 7fe4a7e00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 0x7fe48806e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe498007fd0 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.424+0000 7fddcfe00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 0x7fddb006e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009f20 tx=0x7fddc80094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:52.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.434+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe494058e50 con 0x7fe4a80c51a0 2024-03-08T20:29:52.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.447+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fddbc055030 con 0x7fddd0158b00 2024-03-08T20:29:52.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.697+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f207c005850 con 0x7f209800fcf0 2024-03-08T20:29:52.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.698+0000 7f208f400640 1 -- 172.21.15.118:0/2559842509 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20a00f5f50 con 0x7f209800fcf0 2024-03-08T20:29:52.697 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:52.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.701+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 msgr2=0x7f208406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.701+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 0x7f208406e190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f20980d4dc0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2024-03-08T20:29:52.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 msgr2=0x7f20980dcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f20a0069230 tx=0x7f20a0068a90 comp rx=0 tx=0).stop 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 shutdown_connections 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f208406bcd0 0x7f208406e190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980d7920 0x7f2098034230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2098050720 0x7f209816ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 --2- 172.21.15.118:0/2559842509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f209800fcf0 0x7f20980dcb90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.702+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 >> 172.21.15.118:0/2559842509 conn(0x7f209804fc00 msgr2=0x7f20980061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.703+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 shutdown_connections 2024-03-08T20:29:52.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.703+0000 7f20a4c00640 1 -- 172.21.15.118:0/2559842509 wait complete. 2024-03-08T20:29:52.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-03-08T20:29:52.729 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.746+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0b806d8d0 con 0x7fd0b81526e0 2024-03-08T20:29:52.746 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:52.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.747+0000 7fd0af400640 1 -- 172.21.15.118:0/33613576 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0a4058390 con 0x7fd0b81526e0 2024-03-08T20:29:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.750+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 msgr2=0x7fd09806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.750+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 0x7fd09806e160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009ba0 tx=0x7fd0a8008040 comp rx=0 tx=0).stop 2024-03-08T20:29:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.750+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 msgr2=0x7fd0b81f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.750+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c450 tx=0x7fd0a400c910 comp rx=0 tx=0).stop 2024-03-08T20:29:52.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 shutdown_connections 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd09806bca0 0x7fd09806e160 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0b81526e0 0x7fd0b81f4790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b80c8bd0 0x7fd0b80abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 --2- 172.21.15.118:0/33613576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd0b80c8750 0x7fd0b81fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 >> 172.21.15.118:0/33613576 conn(0x7fd0b8072c30 msgr2=0x7fd0b80ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 shutdown_connections 2024-03-08T20:29:52.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.751+0000 7fd0acc00640 1 -- 172.21.15.118:0/33613576 wait complete. 2024-03-08T20:29:52.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-03-08T20:29:52.776 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.790+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7feca01faf20 con 0x7feca008a9d0 2024-03-08T20:29:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.791+0000 7fec9d600640 1 -- 172.21.15.118:0/260389434 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec9405ceb0 con 0x7feca008a9d0 2024-03-08T20:29:52.790 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.792+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdda8005580 con 0x7fddd0158b00 2024-03-08T20:29:52.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.792+0000 7fddc7e00640 1 -- 172.21.15.118:0/691858506 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddbc0841d0 con 0x7fddd0158b00 2024-03-08T20:29:52.792 INFO:teuthology.orchestra.run.smithi118.stdout:55834574858 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 msgr2=0x7fec8006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 0x7fec8006e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feca0164270 tx=0x7fec8c009040 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 msgr2=0x7feca0161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c7f0 tx=0x7fec9400cbf0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 shutdown_connections 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fec8006bc20 0x7fec8006e0e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca015fa20 0x7feca01f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca015f500 0x7feca01f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 --2- 172.21.15.118:0/260389434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7feca008a9d0 0x7feca0161fe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.793+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 >> 172.21.15.118:0/260389434 conn(0x7feca006ad10 msgr2=0x7feca00c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.794+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 shutdown_connections 2024-03-08T20:29:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.794+0000 7feca6a00640 1 -- 172.21.15.118:0/260389434 wait complete. 2024-03-08T20:29:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.795+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 msgr2=0x7fddb006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.795+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 0x7fddb006e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009f20 tx=0x7fddc80094f0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.795+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 msgr2=0x7fddd014b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.795+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fddbc034700 tx=0x7fddbc0046c0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 shutdown_connections 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fddb006bbd0 0x7fddb006e090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd0158b00 0x7fddd014b7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddd0152610 0x7fddd00bfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 --2- 172.21.15.118:0/691858506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddd006dd80 0x7fddd01e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 >> 172.21.15.118:0/691858506 conn(0x7fddd00c6580 msgr2=0x7fddd01581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 shutdown_connections 2024-03-08T20:29:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.796+0000 7fddd6a00640 1 -- 172.21.15.118:0/691858506 wait complete. 2024-03-08T20:29:52.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-03-08T20:29:52.813 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-03-08T20:29:52.813 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.831+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82941e6d90 con 0x7f82940c6af0 2024-03-08T20:29:52.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.831+0000 7f828b400640 1 -- 172.21.15.118:0/345303706 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f828c059ac0 con 0x7f82940c6af0 2024-03-08T20:29:52.831 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:52.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 msgr2=0x7f827406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 0x7f827406e0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8284036000 tx=0x7f8284008030 comp rx=0 tx=0).stop 2024-03-08T20:29:52.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 msgr2=0x7f82940c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f828c00b050 tx=0x7f828c00b510 comp rx=0 tx=0).stop 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 shutdown_connections 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f827406bc20 0x7f827406e0e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c6af0 0x7f82940c3f90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82940c6690 0x7f8294071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 --2- 172.21.15.118:0/345303706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940c27a0 0x7f82940c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 >> 172.21.15.118:0/345303706 conn(0x7f829406d550 msgr2=0x7f82940c0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 shutdown_connections 2024-03-08T20:29:52.835 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.835+0000 7f829a400640 1 -- 172.21.15.118:0/345303706 wait complete. 2024-03-08T20:29:52.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.837+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe27802bfd0 con 0x7fe27800ba30 2024-03-08T20:29:52.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.838+0000 7fe273400640 1 -- 172.21.15.118:0/2269585094 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe26c0588d0 con 0x7fe27800ba30 2024-03-08T20:29:52.837 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:52.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.841+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 msgr2=0x7fe26006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.841+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 0x7fe26006e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe274034000 tx=0x7fe274008030 comp rx=0 tx=0).stop 2024-03-08T20:29:52.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.841+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 msgr2=0x7fe2780cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.841+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00c780 tx=0x7fe26c00cc40 comp rx=0 tx=0).stop 2024-03-08T20:29:52.841 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 shutdown_connections 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe26006bca0 0x7fe26006e160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2780d3be0 0x7fe278177e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe27800ba30 0x7fe2780cb970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 --2- 172.21.15.118:0/2269585094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2780070d0 0x7fe2780d56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 >> 172.21.15.118:0/2269585094 conn(0x7fe278006070 msgr2=0x7fe2780c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 shutdown_connections 2024-03-08T20:29:52.842 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.842+0000 7fe286400640 1 -- 172.21.15.118:0/2269585094 wait complete. 2024-03-08T20:29:52.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-03-08T20:29:52.856 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.857 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.858+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc570005390 con 0x7fc570050720 2024-03-08T20:29:52.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.858+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe4a806d940 con 0x7fe4a80c51a0 2024-03-08T20:29:52.858 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.859+0000 7fc56e000640 1 -- 172.21.15.118:0/410884853 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5780d32a0 con 0x7fc570050720 2024-03-08T20:29:52.859 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.859+0000 7fe49fe00640 1 -- 172.21.15.118:0/853016577 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe49405cef0 con 0x7fe4a80c51a0 2024-03-08T20:29:52.859 INFO:teuthology.orchestra.run.smithi118.stdout:55834574857 2024-03-08T20:29:52.859 INFO:teuthology.orchestra.run.smithi118.stdout:55834574856 2024-03-08T20:29:52.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-03-08T20:29:52.860 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.862+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 msgr2=0x7fc55806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.862+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 0x7fc55806e0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc564000f60 tx=0x7fc564009040 comp rx=0 tx=0).stop 2024-03-08T20:29:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.862+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 msgr2=0x7fc5701802b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.862+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc578075c40 tx=0x7fc578074580 comp rx=0 tx=0).stop 2024-03-08T20:29:52.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 shutdown_connections 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc55806bc20 0x7fc55806e0e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc5700d7920 0x7fc57017dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc570050720 0x7fc5701802b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 --2- 172.21.15.118:0/410884853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc57000fcf0 0x7fc5700dd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 >> 172.21.15.118:0/410884853 conn(0x7fc57004fc00 msgr2=0x7fc570006cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.863 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 msgr2=0x7fe48806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 0x7fe48806e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe498007fd0 tx=0x7fe498009040 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 msgr2=0x7fe4a80c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 0x7fe4a80c2e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c820 tx=0x7fe49400cce0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 shutdown_connections 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe48806bbd0 0x7fe48806e090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe4a8152590 0x7fe4a80c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a80c51a0 0x7fe4a80c2e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 --2- 172.21.15.118:0/853016577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4a806c540 0x7fe4a8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 >> 172.21.15.118:0/853016577 conn(0x7fe4a8072d20 msgr2=0x7fe4a80ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:52.864 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 shutdown_connections 2024-03-08T20:29:52.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fc577200640 1 -- 172.21.15.118:0/410884853 wait complete. 2024-03-08T20:29:52.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 shutdown_connections 2024-03-08T20:29:52.865 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:52.863+0000 7fe4aee00640 1 -- 172.21.15.118:0/853016577 wait complete. 2024-03-08T20:29:52.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-03-08T20:29:52.887 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-03-08T20:29:52.888 DEBUG:teuthology.parallel:result is None 2024-03-08T20:29:52.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T20:29:52.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:29:53.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.132+0000 7f1c67200640 1 Processor -- start 2024-03-08T20:29:53.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.132+0000 7f1c67200640 1 -- start start 2024-03-08T20:29:53.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c67200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c60153520 0x7f1c60150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c67200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c600aa980 con 0x7f1c6014fed0 2024-03-08T20:29:53.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c67200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c600aac60 con 0x7f1c6006af80 2024-03-08T20:29:53.133 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c67200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c60150870 con 0x7f1c60153520 2024-03-08T20:29:53.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c5f400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1c6014fed0 0x7f1c60152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58030/0 (socket says 172.21.15.118:58030) 2024-03-08T20:29:53.134 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c5f400640 1 -- 172.21.15.118:0/3929459305 learned_addr learned my addr 172.21.15.118:0/3929459305 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c65200640 1 --2- 172.21.15.118:0/3929459305 >> v2:172.21.15.144:3300/0 conn(0x7f1c60153520 0x7f1c60150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.134+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564206597 0 0) 0x7f1c600aa980 con 0x7f1c6014fed0 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c44003520 con 0x7f1c6014fed0 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 900047513 0 0) 0x7f1c44003520 con 0x7f1c6014fed0 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 >> v2:172.21.15.144:3300/0 conn(0x7f1c60153520 msgr2=0x7f1c60150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 --2- 172.21.15.118:0/3929459305 >> v2:172.21.15.144:3300/0 conn(0x7f1c60153520 0x7f1c60150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 >> v1:172.21.15.144:6789/0 conn(0x7f1c6006af80 legacy=0x7f1c6006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600aaf40 con 0x7f1c6014fed0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f1c4c001670 con 0x7f1c6014fed0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 >> v1:172.21.15.118:6789/0 conn(0x7f1c6014fed0 legacy=0x7f1c60152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c44004800 0x7f1c44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c440051c0 0x7f1c4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60150870 con 0x7f1c440039b0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4400c160 con 0x7f1c440051c0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.135+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4400c360 con 0x7f1c44004800 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5f400640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c44004800 0x7f1c44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c65200640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c440051c0 0x7f1c4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c44004800 msgr2=0x7f1c44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c44004800 0x7f1c44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.137 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c440051c0 msgr2=0x7f1c4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c440051c0 0x7f1c4400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3929459305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44003520 con 0x7f1c440039b0 2024-03-08T20:29:53.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.136+0000 7f1c65200640 1 -- 172.21.15.118:0/3929459305 reap_dead start 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.137+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c44003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c50001750 tx=0x7f1c44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7baeea7c6d1c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50001370 con 0x7f1c440039b0 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500052d0 con 0x7f1c440039b0 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c5ea00640 1 -- 172.21.15.118:0/3929459305 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50003830 con 0x7f1c440039b0 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 -- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 msgr2=0x7f1c44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c44003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c50001750 tx=0x7f1c44005830 comp rx=0 tx=0).stop 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 -- 172.21.15.118:0/3929459305 shutdown_connections 2024-03-08T20:29:53.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 --2- 172.21.15.118:0/3929459305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c44003dd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 -- 172.21.15.118:0/3929459305 >> 172.21.15.118:0/3929459305 conn(0x7f1c600a84c0 msgr2=0x7f1c600a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:53.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 -- 172.21.15.118:0/3929459305 shutdown_connections 2024-03-08T20:29:53.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.138+0000 7f1c67200640 1 -- 172.21.15.118:0/3929459305 wait complete. 2024-03-08T20:29:53.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.140+0000 7f1c67200640 1 Processor -- start 2024-03-08T20:29:53.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.140+0000 7f1c67200640 1 -- start start 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c601ec320 0x7f1c60149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 0x7f1c6014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c3e10 con 0x7f1c440039b0 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601539b0 con 0x7f1c600bbf30 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c67200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c3f90 con 0x7f1c601ec320 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c5fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57068/0 (socket says 172.21.15.118:57068) 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3850508050 learned_addr learned my addr 172.21.15.118:0/3850508050 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c5f400640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c601ec320 0x7f1c60149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.141+0000 7f1c65200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 0x7f1c6014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c601ec320 msgr2=0x7f1c60149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c601ec320 0x7f1c60149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 msgr2=0x7f1c6014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 0x7f1c6014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 -- 172.21.15.118:0/3850508050 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c601451c0 con 0x7f1c440039b0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c65200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 0x7f1c6014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c5fe00640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005040 tx=0x7f1c50001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50041020 con 0x7f1c440039b0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50005480 con 0x7f1c440039b0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50001370 con 0x7f1c440039b0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c601ec860 con 0x7f1c440039b0 2024-03-08T20:29:53.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.142+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6014a630 con 0x7f1c440039b0 2024-03-08T20:29:53.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.143+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c600abc30 con 0x7f1c440039b0 2024-03-08T20:29:53.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.144+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1c50044020 con 0x7f1c440039b0 2024-03-08T20:29:53.144 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.145+0000 7f1c57e00640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 0x7f1c4006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.145+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1c500ac7c0 con 0x7f1c440039b0 2024-03-08T20:29:53.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.145+0000 7f1c5f400640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 0x7f1c4006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.146+0000 7f1c5f400640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 0x7f1c4006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001eb0 tx=0x7f1c4c000f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.149+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1c600abc30 con 0x7f1c440039b0 2024-03-08T20:29:53.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.332+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c60144f70 con 0x7f1c4006bbd0 2024-03-08T20:29:53.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.357+0000 7f1c57e00640 1 -- 172.21.15.118:0/3850508050 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332615 (secure 0 0 0) 0x7f1c60144f70 con 0x7f1c4006bbd0 2024-03-08T20:29:53.361 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:53.364 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:29:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 msgr2=0x7f1c4006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 0x7f1c4006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c001eb0 tx=0x7f1c4c000f30 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 msgr2=0x7f1c601ebde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005040 tx=0x7f1c50001120 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 shutdown_connections 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1c4006bbd0 0x7f1c4006e090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c600bbf30 0x7f1c6014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c601ec320 0x7f1c60149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 --2- 172.21.15.118:0/3850508050 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1c440039b0 0x7f1c601ebde0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 >> 172.21.15.118:0/3850508050 conn(0x7f1c600a84c0 msgr2=0x7f1c6014e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 shutdown_connections 2024-03-08T20:29:53.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.364+0000 7f1c67200640 1 -- 172.21.15.118:0/3850508050 wait complete. 2024-03-08T20:29:53.384 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-08T20:29:51.522621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222588,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752132,"statfs":{"total":773094113280,"available":772866183168,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004541"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693297+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:29:29.693297+0000","last_peered":"2024-03-08T20:29:29.693297+0000","last_clean":"2024-03-08T20:29:29.693297+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:29:29.693297+0000","last_undegraded":"2024-03-08T20:29:29.693297+0000","last_fullsized":"2024-03-08T20:29:29.693297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324902+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:29:29.324902+0000","last_peered":"2024-03-08T20:29:29.324902+0000","last_clean":"2024-03-08T20:29:29.324902+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:29:29.324902+0000","last_undegraded":"2024-03-08T20:29:29.324902+0000","last_fullsized":"2024-03-08T20:29:29.324902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323005+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:29:29.323005+0000","last_peered":"2024-03-08T20:29:29.323005+0000","last_clean":"2024-03-08T20:29:29.323005+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:29:29.323005+0000","last_undegraded":"2024-03-08T20:29:29.323005+0000","last_fullsized":"2024-03-08T20:29:29.323005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324958+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:29:29.324958+0000","last_peered":"2024-03-08T20:29:29.324958+0000","last_clean":"2024-03-08T20:29:29.324958+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:29:29.324958+0000","last_undegraded":"2024-03-08T20:29:29.324958+0000","last_fullsized":"2024-03-08T20:29:29.324958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693020+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:29:29.693020+0000","last_peered":"2024-03-08T20:29:29.693020+0000","last_clean":"2024-03-08T20:29:29.693020+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:29:29.693020+0000","last_undegraded":"2024-03-08T20:29:29.693020+0000","last_fullsized":"2024-03-08T20:29:29.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326542+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:29:29.326542+0000","last_peered":"2024-03-08T20:29:29.326542+0000","last_clean":"2024-03-08T20:29:29.326542+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:29:29.326542+0000","last_undegraded":"2024-03-08T20:29:29.326542+0000","last_fullsized":"2024-03-08T20:29:29.326542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695864+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:29:29.695864+0000","last_peered":"2024-03-08T20:29:29.695864+0000","last_clean":"2024-03-08T20:29:29.695864+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:29:29.695864+0000","last_undegraded":"2024-03-08T20:29:29.695864+0000","last_fullsized":"2024-03-08T20:29:29.695864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327934+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:29:29.327934+0000","last_peered":"2024-03-08T20:29:29.327934+0000","last_clean":"2024-03-08T20:29:29.327934+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:29:29.327934+0000","last_undegraded":"2024-03-08T20:29:29.327934+0000","last_fullsized":"2024-03-08T20:29:29.327934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329741+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:29:29.329741+0000","last_peered":"2024-03-08T20:29:29.329741+0000","last_clean":"2024-03-08T20:29:29.329741+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:29:29.329741+0000","last_undegraded":"2024-03-08T20:29:29.329741+0000","last_fullsized":"2024-03-08T20:29:29.329741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695025+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:29:29.695025+0000","last_peered":"2024-03-08T20:29:29.695025+0000","last_clean":"2024-03-08T20:29:29.695025+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:29:29.695025+0000","last_undegraded":"2024-03-08T20:29:29.695025+0000","last_fullsized":"2024-03-08T20:29:29.695025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327560+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:29:29.327560+0000","last_peered":"2024-03-08T20:29:29.327560+0000","last_clean":"2024-03-08T20:29:29.327560+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:29:29.327560+0000","last_undegraded":"2024-03-08T20:29:29.327560+0000","last_fullsized":"2024-03-08T20:29:29.327560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328809+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:29:29.328809+0000","last_peered":"2024-03-08T20:29:29.328809+0000","last_clean":"2024-03-08T20:29:29.328809+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:29:29.328809+0000","last_undegraded":"2024-03-08T20:29:29.328809+0000","last_fullsized":"2024-03-08T20:29:29.328809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693380+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:29:29.693380+0000","last_peered":"2024-03-08T20:29:29.693380+0000","last_clean":"2024-03-08T20:29:29.693380+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:29:29.693380+0000","last_undegraded":"2024-03-08T20:29:29.693380+0000","last_fullsized":"2024-03-08T20:29:29.693380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694568+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:29:29.694568+0000","last_peered":"2024-03-08T20:29:29.694568+0000","last_clean":"2024-03-08T20:29:29.694568+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:29:29.694568+0000","last_undegraded":"2024-03-08T20:29:29.694568+0000","last_fullsized":"2024-03-08T20:29:29.694568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330807+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:29:29.330807+0000","last_peered":"2024-03-08T20:29:29.330807+0000","last_clean":"2024-03-08T20:29:29.330807+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:29:29.330807+0000","last_undegraded":"2024-03-08T20:29:29.330807+0000","last_fullsized":"2024-03-08T20:29:29.330807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323615+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:29:29.323615+0000","last_peered":"2024-03-08T20:29:29.323615+0000","last_clean":"2024-03-08T20:29:29.323615+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:29:29.323615+0000","last_undegraded":"2024-03-08T20:29:29.323615+0000","last_fullsized":"2024-03-08T20:29:29.323615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604207+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:29:29.604207+0000","last_peered":"2024-03-08T20:29:29.604207+0000","last_clean":"2024-03-08T20:29:29.604207+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:29:29.604207+0000","last_undegraded":"2024-03-08T20:29:29.604207+0000","last_fullsized":"2024-03-08T20:29:29.604207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329605+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:29:29.329605+0000","last_peered":"2024-03-08T20:29:29.329605+0000","last_clean":"2024-03-08T20:29:29.329605+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:29:29.329605+0000","last_undegraded":"2024-03-08T20:29:29.329605+0000","last_fullsized":"2024-03-08T20:29:29.329605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323007+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:29:29.323007+0000","last_peered":"2024-03-08T20:29:29.323007+0000","last_clean":"2024-03-08T20:29:29.323007+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:29:29.323007+0000","last_undegraded":"2024-03-08T20:29:29.323007+0000","last_fullsized":"2024-03-08T20:29:29.323007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603803+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:29:29.603803+0000","last_peered":"2024-03-08T20:29:29.603803+0000","last_clean":"2024-03-08T20:29:29.603803+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:29:29.603803+0000","last_undegraded":"2024-03-08T20:29:29.603803+0000","last_fullsized":"2024-03-08T20:29:29.603803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605139+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:29:29.605139+0000","last_peered":"2024-03-08T20:29:29.605139+0000","last_clean":"2024-03-08T20:29:29.605139+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:29:29.605139+0000","last_undegraded":"2024-03-08T20:29:29.605139+0000","last_fullsized":"2024-03-08T20:29:29.605139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327305+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:29:29.327305+0000","last_peered":"2024-03-08T20:29:29.327305+0000","last_clean":"2024-03-08T20:29:29.327305+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:29:29.327305+0000","last_undegraded":"2024-03-08T20:29:29.327305+0000","last_fullsized":"2024-03-08T20:29:29.327305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693787+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:29:29.693787+0000","last_peered":"2024-03-08T20:29:29.693787+0000","last_clean":"2024-03-08T20:29:29.693787+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:29:29.693787+0000","last_undegraded":"2024-03-08T20:29:29.693787+0000","last_fullsized":"2024-03-08T20:29:29.693787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330826+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:29:29.330826+0000","last_peered":"2024-03-08T20:29:29.330826+0000","last_clean":"2024-03-08T20:29:29.330826+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:29:29.330826+0000","last_undegraded":"2024-03-08T20:29:29.330826+0000","last_fullsized":"2024-03-08T20:29:29.330826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693630+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:29:29.693630+0000","last_peered":"2024-03-08T20:29:29.693630+0000","last_clean":"2024-03-08T20:29:29.693630+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:29:29.693630+0000","last_undegraded":"2024-03-08T20:29:29.693630+0000","last_fullsized":"2024-03-08T20:29:29.693630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697621+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:29:29.697621+0000","last_peered":"2024-03-08T20:29:29.697621+0000","last_clean":"2024-03-08T20:29:29.697621+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:29:29.697621+0000","last_undegraded":"2024-03-08T20:29:29.697621+0000","last_fullsized":"2024-03-08T20:29:29.697621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326730+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:29:29.326730+0000","last_peered":"2024-03-08T20:29:29.326730+0000","last_clean":"2024-03-08T20:29:29.326730+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:29:29.326730+0000","last_undegraded":"2024-03-08T20:29:29.326730+0000","last_fullsized":"2024-03-08T20:29:29.326730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325381+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:29:29.325381+0000","last_peered":"2024-03-08T20:29:29.325381+0000","last_clean":"2024-03-08T20:29:29.325381+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:29:29.325381+0000","last_undegraded":"2024-03-08T20:29:29.325381+0000","last_fullsized":"2024-03-08T20:29:29.325381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605003+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:29:29.605003+0000","last_peered":"2024-03-08T20:29:29.605003+0000","last_clean":"2024-03-08T20:29:29.605003+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:29:29.605003+0000","last_undegraded":"2024-03-08T20:29:29.605003+0000","last_fullsized":"2024-03-08T20:29:29.605003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322436+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.322436+0000","last_peered":"2024-03-08T20:29:29.322436+0000","last_clean":"2024-03-08T20:29:29.322436+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:29:29.322436+0000","last_undegraded":"2024-03-08T20:29:29.322436+0000","last_fullsized":"2024-03-08T20:29:29.322436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604521+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:29:29.604521+0000","last_peered":"2024-03-08T20:29:29.604521+0000","last_clean":"2024-03-08T20:29:29.604521+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:29:29.604521+0000","last_undegraded":"2024-03-08T20:29:29.604521+0000","last_fullsized":"2024-03-08T20:29:29.604521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696204+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:29:29.696204+0000","last_peered":"2024-03-08T20:29:29.696204+0000","last_clean":"2024-03-08T20:29:29.696204+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:29:29.696204+0000","last_undegraded":"2024-03-08T20:29:29.696204+0000","last_fullsized":"2024-03-08T20:29:29.696204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692264+0000","last_change":"2024-03-08T20:29:28.297105+0000","last_active":"2024-03-08T20:29:29.692264+0000","last_peered":"2024-03-08T20:29:29.692264+0000","last_clean":"2024-03-08T20:29:29.692264+0000","last_became_active":"2024-03-08T20:29:28.296730+0000","last_became_peered":"2024-03-08T20:29:28.296730+0000","last_unstale":"2024-03-08T20:29:29.692264+0000","last_undegraded":"2024-03-08T20:29:29.692264+0000","last_fullsized":"2024-03-08T20:29:29.692264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327764+0000","last_change":"2024-03-08T20:29:24.251656+0000","last_active":"2024-03-08T20:29:29.327764+0000","last_peered":"2024-03-08T20:29:29.327764+0000","last_clean":"2024-03-08T20:29:29.327764+0000","last_became_active":"2024-03-08T20:29:24.251207+0000","last_became_peered":"2024-03-08T20:29:24.251207+0000","last_unstale":"2024-03-08T20:29:29.327764+0000","last_undegraded":"2024-03-08T20:29:29.327764+0000","last_fullsized":"2024-03-08T20:29:29.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604653+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:29:29.604653+0000","last_peered":"2024-03-08T20:29:29.604653+0000","last_clean":"2024-03-08T20:29:29.604653+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:29:29.604653+0000","last_undegraded":"2024-03-08T20:29:29.604653+0000","last_fullsized":"2024-03-08T20:29:29.604653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604080+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:29:29.604080+0000","last_peered":"2024-03-08T20:29:29.604080+0000","last_clean":"2024-03-08T20:29:29.604080+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:29:29.604080+0000","last_undegraded":"2024-03-08T20:29:29.604080+0000","last_fullsized":"2024-03-08T20:29:29.604080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330165+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:29:29.330165+0000","last_peered":"2024-03-08T20:29:29.330165+0000","last_clean":"2024-03-08T20:29:29.330165+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:29:29.330165+0000","last_undegraded":"2024-03-08T20:29:29.330165+0000","last_fullsized":"2024-03-08T20:29:29.330165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327392+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:29:29.327392+0000","last_peered":"2024-03-08T20:29:29.327392+0000","last_clean":"2024-03-08T20:29:29.327392+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:29:29.327392+0000","last_undegraded":"2024-03-08T20:29:29.327392+0000","last_fullsized":"2024-03-08T20:29:29.327392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604568+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:29:29.604568+0000","last_peered":"2024-03-08T20:29:29.604568+0000","last_clean":"2024-03-08T20:29:29.604568+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:29:29.604568+0000","last_undegraded":"2024-03-08T20:29:29.604568+0000","last_fullsized":"2024-03-08T20:29:29.604568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603861+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:29:29.603861+0000","last_peered":"2024-03-08T20:29:29.603861+0000","last_clean":"2024-03-08T20:29:29.603861+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:29:29.603861+0000","last_undegraded":"2024-03-08T20:29:29.603861+0000","last_fullsized":"2024-03-08T20:29:29.603861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629162+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:29:29.629162+0000","last_peered":"2024-03-08T20:29:29.629162+0000","last_clean":"2024-03-08T20:29:29.629162+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:29:29.629162+0000","last_undegraded":"2024-03-08T20:29:29.629162+0000","last_fullsized":"2024-03-08T20:29:29.629162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605161+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:29:29.605161+0000","last_peered":"2024-03-08T20:29:29.605161+0000","last_clean":"2024-03-08T20:29:29.605161+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:29:29.605161+0000","last_undegraded":"2024-03-08T20:29:29.605161+0000","last_fullsized":"2024-03-08T20:29:29.605161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.691864+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:29:29.691864+0000","last_peered":"2024-03-08T20:29:29.691864+0000","last_clean":"2024-03-08T20:29:29.691864+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:29:29.691864+0000","last_undegraded":"2024-03-08T20:29:29.691864+0000","last_fullsized":"2024-03-08T20:29:29.691864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694114+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:29:29.694114+0000","last_peered":"2024-03-08T20:29:29.694114+0000","last_clean":"2024-03-08T20:29:29.694114+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:29:29.694114+0000","last_undegraded":"2024-03-08T20:29:29.694114+0000","last_fullsized":"2024-03-08T20:29:29.694114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693453+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:29:29.693453+0000","last_peered":"2024-03-08T20:29:29.693453+0000","last_clean":"2024-03-08T20:29:29.693453+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:29:29.693453+0000","last_undegraded":"2024-03-08T20:29:29.693453+0000","last_fullsized":"2024-03-08T20:29:29.693453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323324+0000","last_change":"2024-03-08T20:29:24.260255+0000","last_active":"2024-03-08T20:29:29.323324+0000","last_peered":"2024-03-08T20:29:29.323324+0000","last_clean":"2024-03-08T20:29:29.323324+0000","last_became_active":"2024-03-08T20:29:24.259145+0000","last_became_peered":"2024-03-08T20:29:24.259145+0000","last_unstale":"2024-03-08T20:29:29.323324+0000","last_undegraded":"2024-03-08T20:29:29.323324+0000","last_fullsized":"2024-03-08T20:29:29.323324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325886+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:29:29.325886+0000","last_peered":"2024-03-08T20:29:29.325886+0000","last_clean":"2024-03-08T20:29:29.325886+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:29:29.325886+0000","last_undegraded":"2024-03-08T20:29:29.325886+0000","last_fullsized":"2024-03-08T20:29:29.325886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694395+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:29:29.694395+0000","last_peered":"2024-03-08T20:29:29.694395+0000","last_clean":"2024-03-08T20:29:29.694395+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:29:29.694395+0000","last_undegraded":"2024-03-08T20:29:29.694395+0000","last_fullsized":"2024-03-08T20:29:29.694395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:29:29.695250+0000","last_peered":"2024-03-08T20:29:29.695250+0000","last_clean":"2024-03-08T20:29:29.695250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:29:29.695250+0000","last_undegraded":"2024-03-08T20:29:29.695250+0000","last_fullsized":"2024-03-08T20:29:29.695250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695382+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:29:29.695382+0000","last_peered":"2024-03-08T20:29:29.695382+0000","last_clean":"2024-03-08T20:29:29.695382+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:29:29.695382+0000","last_undegraded":"2024-03-08T20:29:29.695382+0000","last_fullsized":"2024-03-08T20:29:29.695382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629459+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:29:29.629459+0000","last_peered":"2024-03-08T20:29:29.629459+0000","last_clean":"2024-03-08T20:29:29.629459+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:29:29.629459+0000","last_undegraded":"2024-03-08T20:29:29.629459+0000","last_fullsized":"2024-03-08T20:29:29.629459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694813+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:29:29.694813+0000","last_peered":"2024-03-08T20:29:29.694813+0000","last_clean":"2024-03-08T20:29:29.694813+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:29:29.694813+0000","last_undegraded":"2024-03-08T20:29:29.694813+0000","last_fullsized":"2024-03-08T20:29:29.694813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328751+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:29:29.328751+0000","last_peered":"2024-03-08T20:29:29.328751+0000","last_clean":"2024-03-08T20:29:29.328751+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:29:29.328751+0000","last_undegraded":"2024-03-08T20:29:29.328751+0000","last_fullsized":"2024-03-08T20:29:29.328751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604775+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:29:29.604775+0000","last_peered":"2024-03-08T20:29:29.604775+0000","last_clean":"2024-03-08T20:29:29.604775+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:29:29.604775+0000","last_undegraded":"2024-03-08T20:29:29.604775+0000","last_fullsized":"2024-03-08T20:29:29.604775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692533+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:29:29.692533+0000","last_peered":"2024-03-08T20:29:29.692533+0000","last_clean":"2024-03-08T20:29:29.692533+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:29:29.692533+0000","last_undegraded":"2024-03-08T20:29:29.692533+0000","last_fullsized":"2024-03-08T20:29:29.692533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696871+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:29:29.696871+0000","last_peered":"2024-03-08T20:29:29.696871+0000","last_clean":"2024-03-08T20:29:29.696871+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:29:29.696871+0000","last_undegraded":"2024-03-08T20:29:29.696871+0000","last_fullsized":"2024-03-08T20:29:29.696871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629717+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:29:29.629717+0000","last_peered":"2024-03-08T20:29:29.629717+0000","last_clean":"2024-03-08T20:29:29.629717+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:29:29.629717+0000","last_undegraded":"2024-03-08T20:29:29.629717+0000","last_fullsized":"2024-03-08T20:29:29.629717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328240+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.328240+0000","last_peered":"2024-03-08T20:29:29.328240+0000","last_clean":"2024-03-08T20:29:29.328240+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:29:29.328240+0000","last_undegraded":"2024-03-08T20:29:29.328240+0000","last_fullsized":"2024-03-08T20:29:29.328240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696081+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:29:29.696081+0000","last_peered":"2024-03-08T20:29:29.696081+0000","last_clean":"2024-03-08T20:29:29.696081+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:29:29.696081+0000","last_undegraded":"2024-03-08T20:29:29.696081+0000","last_fullsized":"2024-03-08T20:29:29.696081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.331585+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:29:29.331585+0000","last_peered":"2024-03-08T20:29:29.331585+0000","last_clean":"2024-03-08T20:29:29.331585+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:29:29.331585+0000","last_undegraded":"2024-03-08T20:29:29.331585+0000","last_fullsized":"2024-03-08T20:29:29.331585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326308+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:29:29.326308+0000","last_peered":"2024-03-08T20:29:29.326308+0000","last_clean":"2024-03-08T20:29:29.326308+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:29:29.326308+0000","last_undegraded":"2024-03-08T20:29:29.326308+0000","last_fullsized":"2024-03-08T20:29:29.326308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694312+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:29:29.694312+0000","last_peered":"2024-03-08T20:29:29.694312+0000","last_clean":"2024-03-08T20:29:29.694312+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:29:29.694312+0000","last_undegraded":"2024-03-08T20:29:29.694312+0000","last_fullsized":"2024-03-08T20:29:29.694312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.628871+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:29:29.628871+0000","last_peered":"2024-03-08T20:29:29.628871+0000","last_clean":"2024-03-08T20:29:29.628871+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:29:29.628871+0000","last_undegraded":"2024-03-08T20:29:29.628871+0000","last_fullsized":"2024-03-08T20:29:29.628871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693296+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:29:29.693296+0000","last_peered":"2024-03-08T20:29:29.693296+0000","last_clean":"2024-03-08T20:29:29.693296+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:29:29.693296+0000","last_undegraded":"2024-03-08T20:29:29.693296+0000","last_fullsized":"2024-03-08T20:29:29.693296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693106+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:29:29.693106+0000","last_peered":"2024-03-08T20:29:29.693106+0000","last_clean":"2024-03-08T20:29:29.693106+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:29:29.693106+0000","last_undegraded":"2024-03-08T20:29:29.693106+0000","last_fullsized":"2024-03-08T20:29:29.693106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693542+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:29:29.693542+0000","last_peered":"2024-03-08T20:29:29.693542+0000","last_clean":"2024-03-08T20:29:29.693542+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:29:29.693542+0000","last_undegraded":"2024-03-08T20:29:29.693542+0000","last_fullsized":"2024-03-08T20:29:29.693542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325186+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:29:29.325186+0000","last_peered":"2024-03-08T20:29:29.325186+0000","last_clean":"2024-03-08T20:29:29.325186+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:29:29.325186+0000","last_undegraded":"2024-03-08T20:29:29.325186+0000","last_fullsized":"2024-03-08T20:29:29.325186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694546+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:29:29.694546+0000","last_peered":"2024-03-08T20:29:29.694546+0000","last_clean":"2024-03-08T20:29:29.694546+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:29:29.694546+0000","last_undegraded":"2024-03-08T20:29:29.694546+0000","last_fullsized":"2024-03-08T20:29:29.694546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327131+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:29:29.327131+0000","last_peered":"2024-03-08T20:29:29.327131+0000","last_clean":"2024-03-08T20:29:29.327131+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:29:29.327131+0000","last_undegraded":"2024-03-08T20:29:29.327131+0000","last_fullsized":"2024-03-08T20:29:29.327131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324284+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:29:29.324284+0000","last_peered":"2024-03-08T20:29:29.324284+0000","last_clean":"2024-03-08T20:29:29.324284+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:29:29.324284+0000","last_undegraded":"2024-03-08T20:29:29.324284+0000","last_fullsized":"2024-03-08T20:29:29.324284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692438+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692438+0000","last_peered":"2024-03-08T20:29:29.692438+0000","last_clean":"2024-03-08T20:29:29.692438+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:29:29.692438+0000","last_undegraded":"2024-03-08T20:29:29.692438+0000","last_fullsized":"2024-03-08T20:29:29.692438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692729+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:29:29.692729+0000","last_peered":"2024-03-08T20:29:29.692729+0000","last_clean":"2024-03-08T20:29:29.692729+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:29:29.692729+0000","last_undegraded":"2024-03-08T20:29:29.692729+0000","last_fullsized":"2024-03-08T20:29:29.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327436+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:29:29.327436+0000","last_peered":"2024-03-08T20:29:29.327436+0000","last_clean":"2024-03-08T20:29:29.327436+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:29:29.327436+0000","last_undegraded":"2024-03-08T20:29:29.327436+0000","last_fullsized":"2024-03-08T20:29:29.327436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695853+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:29:29.695853+0000","last_peered":"2024-03-08T20:29:29.695853+0000","last_clean":"2024-03-08T20:29:29.695853+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:29:29.695853+0000","last_undegraded":"2024-03-08T20:29:29.695853+0000","last_fullsized":"2024-03-08T20:29:29.695853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:42.977992+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:29:42.977992+0000","last_peered":"2024-03-08T20:29:42.977992+0000","last_clean":"2024-03-08T20:29:42.977992+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:29:42.977992+0000","last_undegraded":"2024-03-08T20:29:42.977992+0000","last_fullsized":"2024-03-08T20:29:42.977992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604126+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:29:29.604126+0000","last_peered":"2024-03-08T20:29:29.604126+0000","last_clean":"2024-03-08T20:29:29.604126+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:29:29.604126+0000","last_undegraded":"2024-03-08T20:29:29.604126+0000","last_fullsized":"2024-03-08T20:29:29.604126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330303+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:29:29.330303+0000","last_peered":"2024-03-08T20:29:29.330303+0000","last_clean":"2024-03-08T20:29:29.330303+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:29:29.330303+0000","last_undegraded":"2024-03-08T20:29:29.330303+0000","last_fullsized":"2024-03-08T20:29:29.330303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604749+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:29:29.604749+0000","last_peered":"2024-03-08T20:29:29.604749+0000","last_clean":"2024-03-08T20:29:29.604749+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:29:29.604749+0000","last_undegraded":"2024-03-08T20:29:29.604749+0000","last_fullsized":"2024-03-08T20:29:29.604749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329992+0000","last_change":"2024-03-08T20:29:28.284054+0000","last_active":"2024-03-08T20:29:29.329992+0000","last_peered":"2024-03-08T20:29:29.329992+0000","last_clean":"2024-03-08T20:29:29.329992+0000","last_became_active":"2024-03-08T20:29:28.282361+0000","last_became_peered":"2024-03-08T20:29:28.282361+0000","last_unstale":"2024-03-08T20:29:29.329992+0000","last_undegraded":"2024-03-08T20:29:29.329992+0000","last_fullsized":"2024-03-08T20:29:29.329992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693127+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:29:29.693127+0000","last_peered":"2024-03-08T20:29:29.693127+0000","last_clean":"2024-03-08T20:29:29.693127+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:29:29.693127+0000","last_undegraded":"2024-03-08T20:29:29.693127+0000","last_fullsized":"2024-03-08T20:29:29.693127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328317+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:29:29.328317+0000","last_peered":"2024-03-08T20:29:29.328317+0000","last_clean":"2024-03-08T20:29:29.328317+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:29:29.328317+0000","last_undegraded":"2024-03-08T20:29:29.328317+0000","last_fullsized":"2024-03-08T20:29:29.328317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322805+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:29:29.322805+0000","last_peered":"2024-03-08T20:29:29.322805+0000","last_clean":"2024-03-08T20:29:29.322805+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:29:29.322805+0000","last_undegraded":"2024-03-08T20:29:29.322805+0000","last_fullsized":"2024-03-08T20:29:29.322805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328142+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:29:29.328142+0000","last_peered":"2024-03-08T20:29:29.328142+0000","last_clean":"2024-03-08T20:29:29.328142+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:29:29.328142+0000","last_undegraded":"2024-03-08T20:29:29.328142+0000","last_fullsized":"2024-03-08T20:29:29.328142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697363+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:29:29.697363+0000","last_peered":"2024-03-08T20:29:29.697363+0000","last_clean":"2024-03-08T20:29:29.697363+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:29:29.697363+0000","last_undegraded":"2024-03-08T20:29:29.697363+0000","last_fullsized":"2024-03-08T20:29:29.697363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322850+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:29:29.322850+0000","last_peered":"2024-03-08T20:29:29.322850+0000","last_clean":"2024-03-08T20:29:29.322850+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:29:29.322850+0000","last_undegraded":"2024-03-08T20:29:29.322850+0000","last_fullsized":"2024-03-08T20:29:29.322850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692999+0000","last_change":"2024-03-08T20:29:28.304811+0000","last_active":"2024-03-08T20:29:29.692999+0000","last_peered":"2024-03-08T20:29:29.692999+0000","last_clean":"2024-03-08T20:29:29.692999+0000","last_became_active":"2024-03-08T20:29:28.304218+0000","last_became_peered":"2024-03-08T20:29:28.304218+0000","last_unstale":"2024-03-08T20:29:29.692999+0000","last_undegraded":"2024-03-08T20:29:29.692999+0000","last_fullsized":"2024-03-08T20:29:29.692999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603670+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:29:29.603670+0000","last_peered":"2024-03-08T20:29:29.603670+0000","last_clean":"2024-03-08T20:29:29.603670+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:29:29.603670+0000","last_undegraded":"2024-03-08T20:29:29.603670+0000","last_fullsized":"2024-03-08T20:29:29.603670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325365+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:29:29.325365+0000","last_peered":"2024-03-08T20:29:29.325365+0000","last_clean":"2024-03-08T20:29:29.325365+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:29:29.325365+0000","last_undegraded":"2024-03-08T20:29:29.325365+0000","last_fullsized":"2024-03-08T20:29:29.325365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697547+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:29:29.697547+0000","last_peered":"2024-03-08T20:29:29.697547+0000","last_clean":"2024-03-08T20:29:29.697547+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:29:29.697547+0000","last_undegraded":"2024-03-08T20:29:29.697547+0000","last_fullsized":"2024-03-08T20:29:29.697547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322791+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:29:29.322791+0000","last_peered":"2024-03-08T20:29:29.322791+0000","last_clean":"2024-03-08T20:29:29.322791+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:29:29.322791+0000","last_undegraded":"2024-03-08T20:29:29.322791+0000","last_fullsized":"2024-03-08T20:29:29.322791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323271+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:29:29.323271+0000","last_peered":"2024-03-08T20:29:29.323271+0000","last_clean":"2024-03-08T20:29:29.323271+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:29:29.323271+0000","last_undegraded":"2024-03-08T20:29:29.323271+0000","last_fullsized":"2024-03-08T20:29:29.323271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695741+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:29:29.695741+0000","last_peered":"2024-03-08T20:29:29.695741+0000","last_clean":"2024-03-08T20:29:29.695741+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:29:29.695741+0000","last_undegraded":"2024-03-08T20:29:29.695741+0000","last_fullsized":"2024-03-08T20:29:29.695741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692624+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:29:29.692624+0000","last_peered":"2024-03-08T20:29:29.692624+0000","last_clean":"2024-03-08T20:29:29.692624+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:29:29.692624+0000","last_undegraded":"2024-03-08T20:29:29.692624+0000","last_fullsized":"2024-03-08T20:29:29.692624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629301+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:29:29.629301+0000","last_peered":"2024-03-08T20:29:29.629301+0000","last_clean":"2024-03-08T20:29:29.629301+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:29:29.629301+0000","last_undegraded":"2024-03-08T20:29:29.629301+0000","last_fullsized":"2024-03-08T20:29:29.629301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323851+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:29:29.323851+0000","last_peered":"2024-03-08T20:29:29.323851+0000","last_clean":"2024-03-08T20:29:29.323851+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:29:29.323851+0000","last_undegraded":"2024-03-08T20:29:29.323851+0000","last_fullsized":"2024-03-08T20:29:29.323851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329117+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:29:29.329117+0000","last_peered":"2024-03-08T20:29:29.329117+0000","last_clean":"2024-03-08T20:29:29.329117+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:29:29.329117+0000","last_undegraded":"2024-03-08T20:29:29.329117+0000","last_fullsized":"2024-03-08T20:29:29.329117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324482+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:29:29.324482+0000","last_peered":"2024-03-08T20:29:29.324482+0000","last_clean":"2024-03-08T20:29:29.324482+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:29:29.324482+0000","last_undegraded":"2024-03-08T20:29:29.324482+0000","last_fullsized":"2024-03-08T20:29:29.324482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692905+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:29:29.692905+0000","last_peered":"2024-03-08T20:29:29.692905+0000","last_clean":"2024-03-08T20:29:29.692905+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:29:29.692905+0000","last_undegraded":"2024-03-08T20:29:29.692905+0000","last_fullsized":"2024-03-08T20:29:29.692905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629275+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:29:29.629275+0000","last_peered":"2024-03-08T20:29:29.629275+0000","last_clean":"2024-03-08T20:29:29.629275+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:29:29.629275+0000","last_undegraded":"2024-03-08T20:29:29.629275+0000","last_fullsized":"2024-03-08T20:29:29.629275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326896+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:29:29.326896+0000","last_peered":"2024-03-08T20:29:29.326896+0000","last_clean":"2024-03-08T20:29:29.326896+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:29:29.326896+0000","last_undegraded":"2024-03-08T20:29:29.326896+0000","last_fullsized":"2024-03-08T20:29:29.326896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692632+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:29:29.692632+0000","last_peered":"2024-03-08T20:29:29.692632+0000","last_clean":"2024-03-08T20:29:29.692632+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:29:29.692632+0000","last_undegraded":"2024-03-08T20:29:29.692632+0000","last_fullsized":"2024-03-08T20:29:29.692632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324493+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:29:29.324493+0000","last_peered":"2024-03-08T20:29:29.324493+0000","last_clean":"2024-03-08T20:29:29.324493+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:29:29.324493+0000","last_undegraded":"2024-03-08T20:29:29.324493+0000","last_fullsized":"2024-03-08T20:29:29.324493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604628+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:29:29.604628+0000","last_peered":"2024-03-08T20:29:29.604628+0000","last_clean":"2024-03-08T20:29:29.604628+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:29:29.604628+0000","last_undegraded":"2024-03-08T20:29:29.604628+0000","last_fullsized":"2024-03-08T20:29:29.604628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696589+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:29:29.696589+0000","last_peered":"2024-03-08T20:29:29.696589+0000","last_clean":"2024-03-08T20:29:29.696589+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:29:29.696589+0000","last_undegraded":"2024-03-08T20:29:29.696589+0000","last_fullsized":"2024-03-08T20:29:29.696589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325184+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:29:29.325184+0000","last_peered":"2024-03-08T20:29:29.325184+0000","last_clean":"2024-03-08T20:29:29.325184+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:29:29.325184+0000","last_undegraded":"2024-03-08T20:29:29.325184+0000","last_fullsized":"2024-03-08T20:29:29.325184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325117+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:29:29.325117+0000","last_peered":"2024-03-08T20:29:29.325117+0000","last_clean":"2024-03-08T20:29:29.325117+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:29:29.325117+0000","last_undegraded":"2024-03-08T20:29:29.325117+0000","last_fullsized":"2024-03-08T20:29:29.325117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323214+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:29:29.323214+0000","last_peered":"2024-03-08T20:29:29.323214+0000","last_clean":"2024-03-08T20:29:29.323214+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:29:29.323214+0000","last_undegraded":"2024-03-08T20:29:29.323214+0000","last_fullsized":"2024-03-08T20:29:29.323214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326675+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:29:29.326675+0000","last_peered":"2024-03-08T20:29:29.326675+0000","last_clean":"2024-03-08T20:29:29.326675+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:29:29.326675+0000","last_undegraded":"2024-03-08T20:29:29.326675+0000","last_fullsized":"2024-03-08T20:29:29.326675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692321+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692321+0000","last_peered":"2024-03-08T20:29:29.692321+0000","last_clean":"2024-03-08T20:29:29.692321+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:29:29.692321+0000","last_undegraded":"2024-03-08T20:29:29.692321+0000","last_fullsized":"2024-03-08T20:29:29.692321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695239+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:29:29.695239+0000","last_peered":"2024-03-08T20:29:29.695239+0000","last_clean":"2024-03-08T20:29:29.695239+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:29:29.695239+0000","last_undegraded":"2024-03-08T20:29:29.695239+0000","last_fullsized":"2024-03-08T20:29:29.695239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696160+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:29:29.696160+0000","last_peered":"2024-03-08T20:29:29.696160+0000","last_clean":"2024-03-08T20:29:29.696160+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:29:29.696160+0000","last_undegraded":"2024-03-08T20:29:29.696160+0000","last_fullsized":"2024-03-08T20:29:29.696160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629573+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:29:29.629573+0000","last_peered":"2024-03-08T20:29:29.629573+0000","last_clean":"2024-03-08T20:29:29.629573+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:29:29.629573+0000","last_undegraded":"2024-03-08T20:29:29.629573+0000","last_fullsized":"2024-03-08T20:29:29.629573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328419+0000","last_change":"2024-03-08T20:29:24.269658+0000","last_active":"2024-03-08T20:29:29.328419+0000","last_peered":"2024-03-08T20:29:29.328419+0000","last_clean":"2024-03-08T20:29:29.328419+0000","last_became_active":"2024-03-08T20:29:24.268813+0000","last_became_peered":"2024-03-08T20:29:24.268813+0000","last_unstale":"2024-03-08T20:29:29.328419+0000","last_undegraded":"2024-03-08T20:29:29.328419+0000","last_fullsized":"2024-03-08T20:29:29.328419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324804+0000","last_change":"2024-03-08T20:29:24.244300+0000","last_active":"2024-03-08T20:29:29.324804+0000","last_peered":"2024-03-08T20:29:29.324804+0000","last_clean":"2024-03-08T20:29:29.324804+0000","last_became_active":"2024-03-08T20:29:24.243929+0000","last_became_peered":"2024-03-08T20:29:24.243929+0000","last_unstale":"2024-03-08T20:29:29.324804+0000","last_undegraded":"2024-03-08T20:29:29.324804+0000","last_fullsized":"2024-03-08T20:29:29.324804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603720+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:29:29.603720+0000","last_peered":"2024-03-08T20:29:29.603720+0000","last_clean":"2024-03-08T20:29:29.603720+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:29:29.603720+0000","last_undegraded":"2024-03-08T20:29:29.603720+0000","last_fullsized":"2024-03-08T20:29:29.603720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692350+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:29:29.692350+0000","last_peered":"2024-03-08T20:29:29.692350+0000","last_clean":"2024-03-08T20:29:29.692350+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:29:29.692350+0000","last_undegraded":"2024-03-08T20:29:29.692350+0000","last_fullsized":"2024-03-08T20:29:29.692350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323559+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:29:29.323559+0000","last_peered":"2024-03-08T20:29:29.323559+0000","last_clean":"2024-03-08T20:29:29.323559+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:29:29.323559+0000","last_undegraded":"2024-03-08T20:29:29.323559+0000","last_fullsized":"2024-03-08T20:29:29.323559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330666+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:29:29.330666+0000","last_peered":"2024-03-08T20:29:29.330666+0000","last_clean":"2024-03-08T20:29:29.330666+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:29:29.330666+0000","last_undegraded":"2024-03-08T20:29:29.330666+0000","last_fullsized":"2024-03-08T20:29:29.330666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695621+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:29:29.695621+0000","last_peered":"2024-03-08T20:29:29.695621+0000","last_clean":"2024-03-08T20:29:29.695621+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:29:29.695621+0000","last_undegraded":"2024-03-08T20:29:29.695621+0000","last_fullsized":"2024-03-08T20:29:29.695621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696357+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:29:29.696357+0000","last_peered":"2024-03-08T20:29:29.696357+0000","last_clean":"2024-03-08T20:29:29.696357+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:29:29.696357+0000","last_undegraded":"2024-03-08T20:29:29.696357+0000","last_fullsized":"2024-03-08T20:29:29.696357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696755+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:29:29.696755+0000","last_peered":"2024-03-08T20:29:29.696755+0000","last_clean":"2024-03-08T20:29:29.696755+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:29:29.696755+0000","last_undegraded":"2024-03-08T20:29:29.696755+0000","last_fullsized":"2024-03-08T20:29:29.696755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322453+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:29:29.322453+0000","last_peered":"2024-03-08T20:29:29.322453+0000","last_clean":"2024-03-08T20:29:29.322453+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:29:29.322453+0000","last_undegraded":"2024-03-08T20:29:29.322453+0000","last_fullsized":"2024-03-08T20:29:29.322453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694028+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:29:29.694028+0000","last_peered":"2024-03-08T20:29:29.694028+0000","last_clean":"2024-03-08T20:29:29.694028+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:29:29.694028+0000","last_undegraded":"2024-03-08T20:29:29.694028+0000","last_fullsized":"2024-03-08T20:29:29.694028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326448+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:29:29.326448+0000","last_peered":"2024-03-08T20:29:29.326448+0000","last_clean":"2024-03-08T20:29:29.326448+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:29:29.326448+0000","last_undegraded":"2024-03-08T20:29:29.326448+0000","last_fullsized":"2024-03-08T20:29:29.326448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694256+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:29:29.694256+0000","last_peered":"2024-03-08T20:29:29.694256+0000","last_clean":"2024-03-08T20:29:29.694256+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:29:29.694256+0000","last_undegraded":"2024-03-08T20:29:29.694256+0000","last_fullsized":"2024-03-08T20:29:29.694256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327678+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:29:29.327678+0000","last_peered":"2024-03-08T20:29:29.327678+0000","last_clean":"2024-03-08T20:29:29.327678+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:29:29.327678+0000","last_undegraded":"2024-03-08T20:29:29.327678+0000","last_fullsized":"2024-03-08T20:29:29.327678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692705+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:29:29.692705+0000","last_peered":"2024-03-08T20:29:29.692705+0000","last_clean":"2024-03-08T20:29:29.692705+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:29:29.692705+0000","last_undegraded":"2024-03-08T20:29:29.692705+0000","last_fullsized":"2024-03-08T20:29:29.692705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605002+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:29:29.605002+0000","last_peered":"2024-03-08T20:29:29.605002+0000","last_clean":"2024-03-08T20:29:29.605002+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:29:29.605002+0000","last_undegraded":"2024-03-08T20:29:29.605002+0000","last_fullsized":"2024-03-08T20:29:29.605002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696518+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:29:29.696518+0000","last_peered":"2024-03-08T20:29:29.696518+0000","last_clean":"2024-03-08T20:29:29.696518+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:29:29.696518+0000","last_undegraded":"2024-03-08T20:29:29.696518+0000","last_fullsized":"2024-03-08T20:29:29.696518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:29:53.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:29:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.637+0000 7ffa66400640 1 Processor -- start 2024-03-08T20:29:53.636 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.637+0000 7ffa66400640 1 -- start start 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.638+0000 7ffa66400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa601525b0 0x7ffa600c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.638+0000 7ffa66400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6006e0d0 con 0x7ffa60155cd0 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.638+0000 7ffa66400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa600c0340 con 0x7ffa6006e750 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.638+0000 7ffa66400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600c0620 con 0x7ffa601525b0 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5fe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ffa60155cd0 0x7ffa6015f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58042/0 (socket says 172.21.15.118:58042) 2024-03-08T20:29:53.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5fe00640 1 -- 172.21.15.118:0/136380814 learned_addr learned my addr 172.21.15.118:0/136380814 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5f400640 1 --2- 172.21.15.118:0/136380814 >> v2:172.21.15.144:3300/0 conn(0x7ffa601525b0 0x7ffa600c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036630589 0 0) 0x7ffa58001490 con 0x7ffa60155cd0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa40003520 con 0x7ffa60155cd0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276604832 0 0) 0x7ffa40003520 con 0x7ffa60155cd0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 >> v2:172.21.15.144:3300/0 conn(0x7ffa601525b0 msgr2=0x7ffa600c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 --2- 172.21.15.118:0/136380814 >> v2:172.21.15.144:3300/0 conn(0x7ffa601525b0 0x7ffa600c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 >> v1:172.21.15.144:6789/0 conn(0x7ffa6006e750 legacy=0x7ffa601555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600c0900 con 0x7ffa60155cd0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7ffa58001bc0 con 0x7ffa60155cd0 2024-03-08T20:29:53.641 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.639+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 >> v1:172.21.15.118:6789/0 conn(0x7ffa60155cd0 legacy=0x7ffa6015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa400039b0 0x7ffa40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa40004800 0x7ffa40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600c0620 con 0x7ffa400051c0 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4000c160 con 0x7ffa400039b0 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4000c360 con 0x7ffa40004800 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa57e00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa40004800 0x7ffa40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5f400640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa400039b0 0x7ffa40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 -- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa40004800 msgr2=0x7ffa40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa40004800 0x7ffa40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 -- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa400039b0 msgr2=0x7ffa40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:53.642 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa400039b0 0x7ffa40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5fe00640 1 -- 172.21.15.118:0/136380814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40003520 con 0x7ffa400051c0 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa57e00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa40004800 0x7ffa40004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.640+0000 7ffa5f400640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa400039b0 0x7ffa40003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.641+0000 7ffa5fe00640 1 -- 172.21.15.118:0/136380814 reap_dead start 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.641+0000 7ffa5fe00640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa4000b9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800aa20 tx=0x7ffa40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7821edca16a491 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58038070 con 0x7ffa400051c0 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58033620 con 0x7ffa400051c0 2024-03-08T20:29:53.643 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa5ea00640 1 -- 172.21.15.118:0/136380814 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800a640 con 0x7ffa400051c0 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 -- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 msgr2=0x7ffa4000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa4000b9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800aa20 tx=0x7ffa40005830 comp rx=0 tx=0).stop 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 -- 172.21.15.118:0/136380814 shutdown_connections 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 --2- 172.21.15.118:0/136380814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa4000b9c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 -- 172.21.15.118:0/136380814 >> 172.21.15.118:0/136380814 conn(0x7ffa600a84c0 msgr2=0x7ffa600a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 -- 172.21.15.118:0/136380814 shutdown_connections 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.642+0000 7ffa66400640 1 -- 172.21.15.118:0/136380814 wait complete. 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.644+0000 7ffa66400640 1 Processor -- start 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.644+0000 7ffa66400640 1 -- start start 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa60071df0 0x7ffa60143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa6014d7a0 0x7ffa601444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600bfff0 con 0x7ffa400051c0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60152990 con 0x7ffa60071df0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa66400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600c0be0 con 0x7ffa6014d7a0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57084/0 (socket says 172.21.15.118:57084) 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 -- 172.21.15.118:0/698396879 learned_addr learned my addr 172.21.15.118:0/698396879 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa57e00640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa60071df0 0x7ffa60143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 -- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa6014d7a0 msgr2=0x7ffa601444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa6014d7a0 0x7ffa601444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 -- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa60071df0 msgr2=0x7ffa60143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa60071df0 0x7ffa60143fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.645+0000 7ffa5f400640 1 -- 172.21.15.118:0/698396879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600728a0 con 0x7ffa400051c0 2024-03-08T20:29:53.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa5f400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa500108b0 tx=0x7ffa50010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000f040 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000eb60 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5001c400 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa60072b80 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.646+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa60071b00 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.647+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60074a40 con 0x7ffa400051c0 2024-03-08T20:29:53.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.648+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ffa5001c5a0 con 0x7ffa400051c0 2024-03-08T20:29:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.650+0000 7ffa57400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 0x7ffa3c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.650+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffa5008b4a0 con 0x7ffa400051c0 2024-03-08T20:29:53.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.650+0000 7ffa57e00640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 0x7ffa3c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:53.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.650+0000 7ffa57e00640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 0x7ffa3c06e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:53.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.654+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ffa50018030 con 0x7ffa400051c0 2024-03-08T20:29:53.829 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.830+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa60072650 con 0x7ffa3c06bbd0 2024-03-08T20:29:53.853 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.854+0000 7ffa57400640 1 -- 172.21.15.118:0/698396879 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332615 (secure 0 0 0) 0x7ffa60072650 con 0x7ffa3c06bbd0 2024-03-08T20:29:53.855 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:53.860 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 msgr2=0x7ffa3c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 0x7ffa3c06e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa48000c00 tx=0x7ffa48009040 comp rx=0 tx=0).stop 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 msgr2=0x7ffa600715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa500108b0 tx=0x7ffa50010d70 comp rx=0 tx=0).stop 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 shutdown_connections 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ffa3c06bbd0 0x7ffa3c06e090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.861 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa6014d7a0 0x7ffa601444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa60071df0 0x7ffa60143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 --2- 172.21.15.118:0/698396879 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffa400051c0 0x7ffa600715c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:53.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 >> 172.21.15.118:0/698396879 conn(0x7ffa600a84c0 msgr2=0x7ffa60158570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:53.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 shutdown_connections 2024-03-08T20:29:53.862 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:53.860+0000 7ffa66400640 1 -- 172.21.15.118:0/698396879 wait complete. 2024-03-08T20:29:53.877 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-03-08T20:29:53.523785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222588,"kb_used_data":2272,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754752132,"statfs":{"total":773094113280,"available":772866183168,"internally_reserved":0,"allocated":2326528,"data_stored":2029432,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005099"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693297+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:29:29.693297+0000","last_peered":"2024-03-08T20:29:29.693297+0000","last_clean":"2024-03-08T20:29:29.693297+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:29:29.693297+0000","last_undegraded":"2024-03-08T20:29:29.693297+0000","last_fullsized":"2024-03-08T20:29:29.693297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324902+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:29:29.324902+0000","last_peered":"2024-03-08T20:29:29.324902+0000","last_clean":"2024-03-08T20:29:29.324902+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:29:29.324902+0000","last_undegraded":"2024-03-08T20:29:29.324902+0000","last_fullsized":"2024-03-08T20:29:29.324902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323005+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:29:29.323005+0000","last_peered":"2024-03-08T20:29:29.323005+0000","last_clean":"2024-03-08T20:29:29.323005+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:29:29.323005+0000","last_undegraded":"2024-03-08T20:29:29.323005+0000","last_fullsized":"2024-03-08T20:29:29.323005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324958+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:29:29.324958+0000","last_peered":"2024-03-08T20:29:29.324958+0000","last_clean":"2024-03-08T20:29:29.324958+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:29:29.324958+0000","last_undegraded":"2024-03-08T20:29:29.324958+0000","last_fullsized":"2024-03-08T20:29:29.324958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693020+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:29:29.693020+0000","last_peered":"2024-03-08T20:29:29.693020+0000","last_clean":"2024-03-08T20:29:29.693020+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:29:29.693020+0000","last_undegraded":"2024-03-08T20:29:29.693020+0000","last_fullsized":"2024-03-08T20:29:29.693020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326542+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:29:29.326542+0000","last_peered":"2024-03-08T20:29:29.326542+0000","last_clean":"2024-03-08T20:29:29.326542+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:29:29.326542+0000","last_undegraded":"2024-03-08T20:29:29.326542+0000","last_fullsized":"2024-03-08T20:29:29.326542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695864+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:29:29.695864+0000","last_peered":"2024-03-08T20:29:29.695864+0000","last_clean":"2024-03-08T20:29:29.695864+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:29:29.695864+0000","last_undegraded":"2024-03-08T20:29:29.695864+0000","last_fullsized":"2024-03-08T20:29:29.695864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327934+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:29:29.327934+0000","last_peered":"2024-03-08T20:29:29.327934+0000","last_clean":"2024-03-08T20:29:29.327934+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:29:29.327934+0000","last_undegraded":"2024-03-08T20:29:29.327934+0000","last_fullsized":"2024-03-08T20:29:29.327934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329741+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:29:29.329741+0000","last_peered":"2024-03-08T20:29:29.329741+0000","last_clean":"2024-03-08T20:29:29.329741+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:29:29.329741+0000","last_undegraded":"2024-03-08T20:29:29.329741+0000","last_fullsized":"2024-03-08T20:29:29.329741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695025+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:29:29.695025+0000","last_peered":"2024-03-08T20:29:29.695025+0000","last_clean":"2024-03-08T20:29:29.695025+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:29:29.695025+0000","last_undegraded":"2024-03-08T20:29:29.695025+0000","last_fullsized":"2024-03-08T20:29:29.695025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327560+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:29:29.327560+0000","last_peered":"2024-03-08T20:29:29.327560+0000","last_clean":"2024-03-08T20:29:29.327560+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:29:29.327560+0000","last_undegraded":"2024-03-08T20:29:29.327560+0000","last_fullsized":"2024-03-08T20:29:29.327560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328809+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:29:29.328809+0000","last_peered":"2024-03-08T20:29:29.328809+0000","last_clean":"2024-03-08T20:29:29.328809+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:29:29.328809+0000","last_undegraded":"2024-03-08T20:29:29.328809+0000","last_fullsized":"2024-03-08T20:29:29.328809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693380+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:29:29.693380+0000","last_peered":"2024-03-08T20:29:29.693380+0000","last_clean":"2024-03-08T20:29:29.693380+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:29:29.693380+0000","last_undegraded":"2024-03-08T20:29:29.693380+0000","last_fullsized":"2024-03-08T20:29:29.693380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694568+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:29:29.694568+0000","last_peered":"2024-03-08T20:29:29.694568+0000","last_clean":"2024-03-08T20:29:29.694568+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:29:29.694568+0000","last_undegraded":"2024-03-08T20:29:29.694568+0000","last_fullsized":"2024-03-08T20:29:29.694568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330807+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:29:29.330807+0000","last_peered":"2024-03-08T20:29:29.330807+0000","last_clean":"2024-03-08T20:29:29.330807+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:29:29.330807+0000","last_undegraded":"2024-03-08T20:29:29.330807+0000","last_fullsized":"2024-03-08T20:29:29.330807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323615+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:29:29.323615+0000","last_peered":"2024-03-08T20:29:29.323615+0000","last_clean":"2024-03-08T20:29:29.323615+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:29:29.323615+0000","last_undegraded":"2024-03-08T20:29:29.323615+0000","last_fullsized":"2024-03-08T20:29:29.323615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604207+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:29:29.604207+0000","last_peered":"2024-03-08T20:29:29.604207+0000","last_clean":"2024-03-08T20:29:29.604207+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:29:29.604207+0000","last_undegraded":"2024-03-08T20:29:29.604207+0000","last_fullsized":"2024-03-08T20:29:29.604207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329605+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:29:29.329605+0000","last_peered":"2024-03-08T20:29:29.329605+0000","last_clean":"2024-03-08T20:29:29.329605+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:29:29.329605+0000","last_undegraded":"2024-03-08T20:29:29.329605+0000","last_fullsized":"2024-03-08T20:29:29.329605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323007+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:29:29.323007+0000","last_peered":"2024-03-08T20:29:29.323007+0000","last_clean":"2024-03-08T20:29:29.323007+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:29:29.323007+0000","last_undegraded":"2024-03-08T20:29:29.323007+0000","last_fullsized":"2024-03-08T20:29:29.323007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603803+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:29:29.603803+0000","last_peered":"2024-03-08T20:29:29.603803+0000","last_clean":"2024-03-08T20:29:29.603803+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:29:29.603803+0000","last_undegraded":"2024-03-08T20:29:29.603803+0000","last_fullsized":"2024-03-08T20:29:29.603803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605139+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:29:29.605139+0000","last_peered":"2024-03-08T20:29:29.605139+0000","last_clean":"2024-03-08T20:29:29.605139+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:29:29.605139+0000","last_undegraded":"2024-03-08T20:29:29.605139+0000","last_fullsized":"2024-03-08T20:29:29.605139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327305+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:29:29.327305+0000","last_peered":"2024-03-08T20:29:29.327305+0000","last_clean":"2024-03-08T20:29:29.327305+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:29:29.327305+0000","last_undegraded":"2024-03-08T20:29:29.327305+0000","last_fullsized":"2024-03-08T20:29:29.327305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693787+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:29:29.693787+0000","last_peered":"2024-03-08T20:29:29.693787+0000","last_clean":"2024-03-08T20:29:29.693787+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:29:29.693787+0000","last_undegraded":"2024-03-08T20:29:29.693787+0000","last_fullsized":"2024-03-08T20:29:29.693787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330826+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:29:29.330826+0000","last_peered":"2024-03-08T20:29:29.330826+0000","last_clean":"2024-03-08T20:29:29.330826+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:29:29.330826+0000","last_undegraded":"2024-03-08T20:29:29.330826+0000","last_fullsized":"2024-03-08T20:29:29.330826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693630+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:29:29.693630+0000","last_peered":"2024-03-08T20:29:29.693630+0000","last_clean":"2024-03-08T20:29:29.693630+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:29:29.693630+0000","last_undegraded":"2024-03-08T20:29:29.693630+0000","last_fullsized":"2024-03-08T20:29:29.693630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697621+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:29:29.697621+0000","last_peered":"2024-03-08T20:29:29.697621+0000","last_clean":"2024-03-08T20:29:29.697621+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:29:29.697621+0000","last_undegraded":"2024-03-08T20:29:29.697621+0000","last_fullsized":"2024-03-08T20:29:29.697621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326730+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:29:29.326730+0000","last_peered":"2024-03-08T20:29:29.326730+0000","last_clean":"2024-03-08T20:29:29.326730+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:29:29.326730+0000","last_undegraded":"2024-03-08T20:29:29.326730+0000","last_fullsized":"2024-03-08T20:29:29.326730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325381+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:29:29.325381+0000","last_peered":"2024-03-08T20:29:29.325381+0000","last_clean":"2024-03-08T20:29:29.325381+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:29:29.325381+0000","last_undegraded":"2024-03-08T20:29:29.325381+0000","last_fullsized":"2024-03-08T20:29:29.325381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605003+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:29:29.605003+0000","last_peered":"2024-03-08T20:29:29.605003+0000","last_clean":"2024-03-08T20:29:29.605003+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:29:29.605003+0000","last_undegraded":"2024-03-08T20:29:29.605003+0000","last_fullsized":"2024-03-08T20:29:29.605003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322436+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.322436+0000","last_peered":"2024-03-08T20:29:29.322436+0000","last_clean":"2024-03-08T20:29:29.322436+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:29:29.322436+0000","last_undegraded":"2024-03-08T20:29:29.322436+0000","last_fullsized":"2024-03-08T20:29:29.322436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604521+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:29:29.604521+0000","last_peered":"2024-03-08T20:29:29.604521+0000","last_clean":"2024-03-08T20:29:29.604521+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:29:29.604521+0000","last_undegraded":"2024-03-08T20:29:29.604521+0000","last_fullsized":"2024-03-08T20:29:29.604521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696204+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:29:29.696204+0000","last_peered":"2024-03-08T20:29:29.696204+0000","last_clean":"2024-03-08T20:29:29.696204+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:29:29.696204+0000","last_undegraded":"2024-03-08T20:29:29.696204+0000","last_fullsized":"2024-03-08T20:29:29.696204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692264+0000","last_change":"2024-03-08T20:29:28.297105+0000","last_active":"2024-03-08T20:29:29.692264+0000","last_peered":"2024-03-08T20:29:29.692264+0000","last_clean":"2024-03-08T20:29:29.692264+0000","last_became_active":"2024-03-08T20:29:28.296730+0000","last_became_peered":"2024-03-08T20:29:28.296730+0000","last_unstale":"2024-03-08T20:29:29.692264+0000","last_undegraded":"2024-03-08T20:29:29.692264+0000","last_fullsized":"2024-03-08T20:29:29.692264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327764+0000","last_change":"2024-03-08T20:29:24.251656+0000","last_active":"2024-03-08T20:29:29.327764+0000","last_peered":"2024-03-08T20:29:29.327764+0000","last_clean":"2024-03-08T20:29:29.327764+0000","last_became_active":"2024-03-08T20:29:24.251207+0000","last_became_peered":"2024-03-08T20:29:24.251207+0000","last_unstale":"2024-03-08T20:29:29.327764+0000","last_undegraded":"2024-03-08T20:29:29.327764+0000","last_fullsized":"2024-03-08T20:29:29.327764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604653+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:29:29.604653+0000","last_peered":"2024-03-08T20:29:29.604653+0000","last_clean":"2024-03-08T20:29:29.604653+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:29:29.604653+0000","last_undegraded":"2024-03-08T20:29:29.604653+0000","last_fullsized":"2024-03-08T20:29:29.604653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604080+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:29:29.604080+0000","last_peered":"2024-03-08T20:29:29.604080+0000","last_clean":"2024-03-08T20:29:29.604080+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:29:29.604080+0000","last_undegraded":"2024-03-08T20:29:29.604080+0000","last_fullsized":"2024-03-08T20:29:29.604080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330165+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:29:29.330165+0000","last_peered":"2024-03-08T20:29:29.330165+0000","last_clean":"2024-03-08T20:29:29.330165+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:29:29.330165+0000","last_undegraded":"2024-03-08T20:29:29.330165+0000","last_fullsized":"2024-03-08T20:29:29.330165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327392+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:29:29.327392+0000","last_peered":"2024-03-08T20:29:29.327392+0000","last_clean":"2024-03-08T20:29:29.327392+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:29:29.327392+0000","last_undegraded":"2024-03-08T20:29:29.327392+0000","last_fullsized":"2024-03-08T20:29:29.327392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604568+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:29:29.604568+0000","last_peered":"2024-03-08T20:29:29.604568+0000","last_clean":"2024-03-08T20:29:29.604568+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:29:29.604568+0000","last_undegraded":"2024-03-08T20:29:29.604568+0000","last_fullsized":"2024-03-08T20:29:29.604568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603861+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:29:29.603861+0000","last_peered":"2024-03-08T20:29:29.603861+0000","last_clean":"2024-03-08T20:29:29.603861+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:29:29.603861+0000","last_undegraded":"2024-03-08T20:29:29.603861+0000","last_fullsized":"2024-03-08T20:29:29.603861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629162+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:29:29.629162+0000","last_peered":"2024-03-08T20:29:29.629162+0000","last_clean":"2024-03-08T20:29:29.629162+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:29:29.629162+0000","last_undegraded":"2024-03-08T20:29:29.629162+0000","last_fullsized":"2024-03-08T20:29:29.629162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605161+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:29:29.605161+0000","last_peered":"2024-03-08T20:29:29.605161+0000","last_clean":"2024-03-08T20:29:29.605161+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:29:29.605161+0000","last_undegraded":"2024-03-08T20:29:29.605161+0000","last_fullsized":"2024-03-08T20:29:29.605161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.691864+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:29:29.691864+0000","last_peered":"2024-03-08T20:29:29.691864+0000","last_clean":"2024-03-08T20:29:29.691864+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:29:29.691864+0000","last_undegraded":"2024-03-08T20:29:29.691864+0000","last_fullsized":"2024-03-08T20:29:29.691864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694114+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:29:29.694114+0000","last_peered":"2024-03-08T20:29:29.694114+0000","last_clean":"2024-03-08T20:29:29.694114+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:29:29.694114+0000","last_undegraded":"2024-03-08T20:29:29.694114+0000","last_fullsized":"2024-03-08T20:29:29.694114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693453+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:29:29.693453+0000","last_peered":"2024-03-08T20:29:29.693453+0000","last_clean":"2024-03-08T20:29:29.693453+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:29:29.693453+0000","last_undegraded":"2024-03-08T20:29:29.693453+0000","last_fullsized":"2024-03-08T20:29:29.693453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323324+0000","last_change":"2024-03-08T20:29:24.260255+0000","last_active":"2024-03-08T20:29:29.323324+0000","last_peered":"2024-03-08T20:29:29.323324+0000","last_clean":"2024-03-08T20:29:29.323324+0000","last_became_active":"2024-03-08T20:29:24.259145+0000","last_became_peered":"2024-03-08T20:29:24.259145+0000","last_unstale":"2024-03-08T20:29:29.323324+0000","last_undegraded":"2024-03-08T20:29:29.323324+0000","last_fullsized":"2024-03-08T20:29:29.323324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325886+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:29:29.325886+0000","last_peered":"2024-03-08T20:29:29.325886+0000","last_clean":"2024-03-08T20:29:29.325886+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:29:29.325886+0000","last_undegraded":"2024-03-08T20:29:29.325886+0000","last_fullsized":"2024-03-08T20:29:29.325886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694395+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:29:29.694395+0000","last_peered":"2024-03-08T20:29:29.694395+0000","last_clean":"2024-03-08T20:29:29.694395+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:29:29.694395+0000","last_undegraded":"2024-03-08T20:29:29.694395+0000","last_fullsized":"2024-03-08T20:29:29.694395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:29:29.695250+0000","last_peered":"2024-03-08T20:29:29.695250+0000","last_clean":"2024-03-08T20:29:29.695250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:29:29.695250+0000","last_undegraded":"2024-03-08T20:29:29.695250+0000","last_fullsized":"2024-03-08T20:29:29.695250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695382+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:29:29.695382+0000","last_peered":"2024-03-08T20:29:29.695382+0000","last_clean":"2024-03-08T20:29:29.695382+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:29:29.695382+0000","last_undegraded":"2024-03-08T20:29:29.695382+0000","last_fullsized":"2024-03-08T20:29:29.695382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629459+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:29:29.629459+0000","last_peered":"2024-03-08T20:29:29.629459+0000","last_clean":"2024-03-08T20:29:29.629459+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:29:29.629459+0000","last_undegraded":"2024-03-08T20:29:29.629459+0000","last_fullsized":"2024-03-08T20:29:29.629459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694813+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:29:29.694813+0000","last_peered":"2024-03-08T20:29:29.694813+0000","last_clean":"2024-03-08T20:29:29.694813+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:29:29.694813+0000","last_undegraded":"2024-03-08T20:29:29.694813+0000","last_fullsized":"2024-03-08T20:29:29.694813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328751+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:29:29.328751+0000","last_peered":"2024-03-08T20:29:29.328751+0000","last_clean":"2024-03-08T20:29:29.328751+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:29:29.328751+0000","last_undegraded":"2024-03-08T20:29:29.328751+0000","last_fullsized":"2024-03-08T20:29:29.328751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604775+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:29:29.604775+0000","last_peered":"2024-03-08T20:29:29.604775+0000","last_clean":"2024-03-08T20:29:29.604775+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:29:29.604775+0000","last_undegraded":"2024-03-08T20:29:29.604775+0000","last_fullsized":"2024-03-08T20:29:29.604775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692533+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:29:29.692533+0000","last_peered":"2024-03-08T20:29:29.692533+0000","last_clean":"2024-03-08T20:29:29.692533+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:29:29.692533+0000","last_undegraded":"2024-03-08T20:29:29.692533+0000","last_fullsized":"2024-03-08T20:29:29.692533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696871+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:29:29.696871+0000","last_peered":"2024-03-08T20:29:29.696871+0000","last_clean":"2024-03-08T20:29:29.696871+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:29:29.696871+0000","last_undegraded":"2024-03-08T20:29:29.696871+0000","last_fullsized":"2024-03-08T20:29:29.696871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629717+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:29:29.629717+0000","last_peered":"2024-03-08T20:29:29.629717+0000","last_clean":"2024-03-08T20:29:29.629717+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:29:29.629717+0000","last_undegraded":"2024-03-08T20:29:29.629717+0000","last_fullsized":"2024-03-08T20:29:29.629717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328240+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:29:29.328240+0000","last_peered":"2024-03-08T20:29:29.328240+0000","last_clean":"2024-03-08T20:29:29.328240+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:29:29.328240+0000","last_undegraded":"2024-03-08T20:29:29.328240+0000","last_fullsized":"2024-03-08T20:29:29.328240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696081+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:29:29.696081+0000","last_peered":"2024-03-08T20:29:29.696081+0000","last_clean":"2024-03-08T20:29:29.696081+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:29:29.696081+0000","last_undegraded":"2024-03-08T20:29:29.696081+0000","last_fullsized":"2024-03-08T20:29:29.696081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.331585+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:29:29.331585+0000","last_peered":"2024-03-08T20:29:29.331585+0000","last_clean":"2024-03-08T20:29:29.331585+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:29:29.331585+0000","last_undegraded":"2024-03-08T20:29:29.331585+0000","last_fullsized":"2024-03-08T20:29:29.331585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326308+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:29:29.326308+0000","last_peered":"2024-03-08T20:29:29.326308+0000","last_clean":"2024-03-08T20:29:29.326308+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:29:29.326308+0000","last_undegraded":"2024-03-08T20:29:29.326308+0000","last_fullsized":"2024-03-08T20:29:29.326308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694312+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:29:29.694312+0000","last_peered":"2024-03-08T20:29:29.694312+0000","last_clean":"2024-03-08T20:29:29.694312+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:29:29.694312+0000","last_undegraded":"2024-03-08T20:29:29.694312+0000","last_fullsized":"2024-03-08T20:29:29.694312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.628871+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:29:29.628871+0000","last_peered":"2024-03-08T20:29:29.628871+0000","last_clean":"2024-03-08T20:29:29.628871+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:29:29.628871+0000","last_undegraded":"2024-03-08T20:29:29.628871+0000","last_fullsized":"2024-03-08T20:29:29.628871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693296+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:29:29.693296+0000","last_peered":"2024-03-08T20:29:29.693296+0000","last_clean":"2024-03-08T20:29:29.693296+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:29:29.693296+0000","last_undegraded":"2024-03-08T20:29:29.693296+0000","last_fullsized":"2024-03-08T20:29:29.693296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693106+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:29:29.693106+0000","last_peered":"2024-03-08T20:29:29.693106+0000","last_clean":"2024-03-08T20:29:29.693106+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:29:29.693106+0000","last_undegraded":"2024-03-08T20:29:29.693106+0000","last_fullsized":"2024-03-08T20:29:29.693106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693542+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:29:29.693542+0000","last_peered":"2024-03-08T20:29:29.693542+0000","last_clean":"2024-03-08T20:29:29.693542+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:29:29.693542+0000","last_undegraded":"2024-03-08T20:29:29.693542+0000","last_fullsized":"2024-03-08T20:29:29.693542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325186+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:29:29.325186+0000","last_peered":"2024-03-08T20:29:29.325186+0000","last_clean":"2024-03-08T20:29:29.325186+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:29:29.325186+0000","last_undegraded":"2024-03-08T20:29:29.325186+0000","last_fullsized":"2024-03-08T20:29:29.325186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694546+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:29:29.694546+0000","last_peered":"2024-03-08T20:29:29.694546+0000","last_clean":"2024-03-08T20:29:29.694546+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:29:29.694546+0000","last_undegraded":"2024-03-08T20:29:29.694546+0000","last_fullsized":"2024-03-08T20:29:29.694546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327131+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:29:29.327131+0000","last_peered":"2024-03-08T20:29:29.327131+0000","last_clean":"2024-03-08T20:29:29.327131+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:29:29.327131+0000","last_undegraded":"2024-03-08T20:29:29.327131+0000","last_fullsized":"2024-03-08T20:29:29.327131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324284+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:29:29.324284+0000","last_peered":"2024-03-08T20:29:29.324284+0000","last_clean":"2024-03-08T20:29:29.324284+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:29:29.324284+0000","last_undegraded":"2024-03-08T20:29:29.324284+0000","last_fullsized":"2024-03-08T20:29:29.324284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692438+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692438+0000","last_peered":"2024-03-08T20:29:29.692438+0000","last_clean":"2024-03-08T20:29:29.692438+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:29:29.692438+0000","last_undegraded":"2024-03-08T20:29:29.692438+0000","last_fullsized":"2024-03-08T20:29:29.692438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692729+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:29:29.692729+0000","last_peered":"2024-03-08T20:29:29.692729+0000","last_clean":"2024-03-08T20:29:29.692729+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:29:29.692729+0000","last_undegraded":"2024-03-08T20:29:29.692729+0000","last_fullsized":"2024-03-08T20:29:29.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327436+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:29:29.327436+0000","last_peered":"2024-03-08T20:29:29.327436+0000","last_clean":"2024-03-08T20:29:29.327436+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:29:29.327436+0000","last_undegraded":"2024-03-08T20:29:29.327436+0000","last_fullsized":"2024-03-08T20:29:29.327436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695853+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:29:29.695853+0000","last_peered":"2024-03-08T20:29:29.695853+0000","last_clean":"2024-03-08T20:29:29.695853+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:29:29.695853+0000","last_undegraded":"2024-03-08T20:29:29.695853+0000","last_fullsized":"2024-03-08T20:29:29.695853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:42.977992+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:29:42.977992+0000","last_peered":"2024-03-08T20:29:42.977992+0000","last_clean":"2024-03-08T20:29:42.977992+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:29:42.977992+0000","last_undegraded":"2024-03-08T20:29:42.977992+0000","last_fullsized":"2024-03-08T20:29:42.977992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604126+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:29:29.604126+0000","last_peered":"2024-03-08T20:29:29.604126+0000","last_clean":"2024-03-08T20:29:29.604126+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:29:29.604126+0000","last_undegraded":"2024-03-08T20:29:29.604126+0000","last_fullsized":"2024-03-08T20:29:29.604126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330303+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:29:29.330303+0000","last_peered":"2024-03-08T20:29:29.330303+0000","last_clean":"2024-03-08T20:29:29.330303+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:29:29.330303+0000","last_undegraded":"2024-03-08T20:29:29.330303+0000","last_fullsized":"2024-03-08T20:29:29.330303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604749+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:29:29.604749+0000","last_peered":"2024-03-08T20:29:29.604749+0000","last_clean":"2024-03-08T20:29:29.604749+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:29:29.604749+0000","last_undegraded":"2024-03-08T20:29:29.604749+0000","last_fullsized":"2024-03-08T20:29:29.604749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329992+0000","last_change":"2024-03-08T20:29:28.284054+0000","last_active":"2024-03-08T20:29:29.329992+0000","last_peered":"2024-03-08T20:29:29.329992+0000","last_clean":"2024-03-08T20:29:29.329992+0000","last_became_active":"2024-03-08T20:29:28.282361+0000","last_became_peered":"2024-03-08T20:29:28.282361+0000","last_unstale":"2024-03-08T20:29:29.329992+0000","last_undegraded":"2024-03-08T20:29:29.329992+0000","last_fullsized":"2024-03-08T20:29:29.329992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.693127+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:29:29.693127+0000","last_peered":"2024-03-08T20:29:29.693127+0000","last_clean":"2024-03-08T20:29:29.693127+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:29:29.693127+0000","last_undegraded":"2024-03-08T20:29:29.693127+0000","last_fullsized":"2024-03-08T20:29:29.693127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328317+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:29:29.328317+0000","last_peered":"2024-03-08T20:29:29.328317+0000","last_clean":"2024-03-08T20:29:29.328317+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:29:29.328317+0000","last_undegraded":"2024-03-08T20:29:29.328317+0000","last_fullsized":"2024-03-08T20:29:29.328317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322805+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:29:29.322805+0000","last_peered":"2024-03-08T20:29:29.322805+0000","last_clean":"2024-03-08T20:29:29.322805+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:29:29.322805+0000","last_undegraded":"2024-03-08T20:29:29.322805+0000","last_fullsized":"2024-03-08T20:29:29.322805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328142+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:29:29.328142+0000","last_peered":"2024-03-08T20:29:29.328142+0000","last_clean":"2024-03-08T20:29:29.328142+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:29:29.328142+0000","last_undegraded":"2024-03-08T20:29:29.328142+0000","last_fullsized":"2024-03-08T20:29:29.328142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697363+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:29:29.697363+0000","last_peered":"2024-03-08T20:29:29.697363+0000","last_clean":"2024-03-08T20:29:29.697363+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:29:29.697363+0000","last_undegraded":"2024-03-08T20:29:29.697363+0000","last_fullsized":"2024-03-08T20:29:29.697363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322850+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:29:29.322850+0000","last_peered":"2024-03-08T20:29:29.322850+0000","last_clean":"2024-03-08T20:29:29.322850+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:29:29.322850+0000","last_undegraded":"2024-03-08T20:29:29.322850+0000","last_fullsized":"2024-03-08T20:29:29.322850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692999+0000","last_change":"2024-03-08T20:29:28.304811+0000","last_active":"2024-03-08T20:29:29.692999+0000","last_peered":"2024-03-08T20:29:29.692999+0000","last_clean":"2024-03-08T20:29:29.692999+0000","last_became_active":"2024-03-08T20:29:28.304218+0000","last_became_peered":"2024-03-08T20:29:28.304218+0000","last_unstale":"2024-03-08T20:29:29.692999+0000","last_undegraded":"2024-03-08T20:29:29.692999+0000","last_fullsized":"2024-03-08T20:29:29.692999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603670+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:29:29.603670+0000","last_peered":"2024-03-08T20:29:29.603670+0000","last_clean":"2024-03-08T20:29:29.603670+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:29:29.603670+0000","last_undegraded":"2024-03-08T20:29:29.603670+0000","last_fullsized":"2024-03-08T20:29:29.603670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325365+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:29:29.325365+0000","last_peered":"2024-03-08T20:29:29.325365+0000","last_clean":"2024-03-08T20:29:29.325365+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:29:29.325365+0000","last_undegraded":"2024-03-08T20:29:29.325365+0000","last_fullsized":"2024-03-08T20:29:29.325365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.697547+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:29:29.697547+0000","last_peered":"2024-03-08T20:29:29.697547+0000","last_clean":"2024-03-08T20:29:29.697547+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:29:29.697547+0000","last_undegraded":"2024-03-08T20:29:29.697547+0000","last_fullsized":"2024-03-08T20:29:29.697547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322791+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:29:29.322791+0000","last_peered":"2024-03-08T20:29:29.322791+0000","last_clean":"2024-03-08T20:29:29.322791+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:29:29.322791+0000","last_undegraded":"2024-03-08T20:29:29.322791+0000","last_fullsized":"2024-03-08T20:29:29.322791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323271+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:29:29.323271+0000","last_peered":"2024-03-08T20:29:29.323271+0000","last_clean":"2024-03-08T20:29:29.323271+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:29:29.323271+0000","last_undegraded":"2024-03-08T20:29:29.323271+0000","last_fullsized":"2024-03-08T20:29:29.323271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695741+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:29:29.695741+0000","last_peered":"2024-03-08T20:29:29.695741+0000","last_clean":"2024-03-08T20:29:29.695741+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:29:29.695741+0000","last_undegraded":"2024-03-08T20:29:29.695741+0000","last_fullsized":"2024-03-08T20:29:29.695741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692624+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:29:29.692624+0000","last_peered":"2024-03-08T20:29:29.692624+0000","last_clean":"2024-03-08T20:29:29.692624+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:29:29.692624+0000","last_undegraded":"2024-03-08T20:29:29.692624+0000","last_fullsized":"2024-03-08T20:29:29.692624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629301+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:29:29.629301+0000","last_peered":"2024-03-08T20:29:29.629301+0000","last_clean":"2024-03-08T20:29:29.629301+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:29:29.629301+0000","last_undegraded":"2024-03-08T20:29:29.629301+0000","last_fullsized":"2024-03-08T20:29:29.629301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323851+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:29:29.323851+0000","last_peered":"2024-03-08T20:29:29.323851+0000","last_clean":"2024-03-08T20:29:29.323851+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:29:29.323851+0000","last_undegraded":"2024-03-08T20:29:29.323851+0000","last_fullsized":"2024-03-08T20:29:29.323851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.329117+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:29:29.329117+0000","last_peered":"2024-03-08T20:29:29.329117+0000","last_clean":"2024-03-08T20:29:29.329117+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:29:29.329117+0000","last_undegraded":"2024-03-08T20:29:29.329117+0000","last_fullsized":"2024-03-08T20:29:29.329117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324482+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:29:29.324482+0000","last_peered":"2024-03-08T20:29:29.324482+0000","last_clean":"2024-03-08T20:29:29.324482+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:29:29.324482+0000","last_undegraded":"2024-03-08T20:29:29.324482+0000","last_fullsized":"2024-03-08T20:29:29.324482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692905+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:29:29.692905+0000","last_peered":"2024-03-08T20:29:29.692905+0000","last_clean":"2024-03-08T20:29:29.692905+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:29:29.692905+0000","last_undegraded":"2024-03-08T20:29:29.692905+0000","last_fullsized":"2024-03-08T20:29:29.692905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629275+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:29:29.629275+0000","last_peered":"2024-03-08T20:29:29.629275+0000","last_clean":"2024-03-08T20:29:29.629275+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:29:29.629275+0000","last_undegraded":"2024-03-08T20:29:29.629275+0000","last_fullsized":"2024-03-08T20:29:29.629275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326896+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:29:29.326896+0000","last_peered":"2024-03-08T20:29:29.326896+0000","last_clean":"2024-03-08T20:29:29.326896+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:29:29.326896+0000","last_undegraded":"2024-03-08T20:29:29.326896+0000","last_fullsized":"2024-03-08T20:29:29.326896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692632+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:29:29.692632+0000","last_peered":"2024-03-08T20:29:29.692632+0000","last_clean":"2024-03-08T20:29:29.692632+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:29:29.692632+0000","last_undegraded":"2024-03-08T20:29:29.692632+0000","last_fullsized":"2024-03-08T20:29:29.692632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324493+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:29:29.324493+0000","last_peered":"2024-03-08T20:29:29.324493+0000","last_clean":"2024-03-08T20:29:29.324493+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:29:29.324493+0000","last_undegraded":"2024-03-08T20:29:29.324493+0000","last_fullsized":"2024-03-08T20:29:29.324493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.604628+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:29:29.604628+0000","last_peered":"2024-03-08T20:29:29.604628+0000","last_clean":"2024-03-08T20:29:29.604628+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:29:29.604628+0000","last_undegraded":"2024-03-08T20:29:29.604628+0000","last_fullsized":"2024-03-08T20:29:29.604628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696589+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:29:29.696589+0000","last_peered":"2024-03-08T20:29:29.696589+0000","last_clean":"2024-03-08T20:29:29.696589+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:29:29.696589+0000","last_undegraded":"2024-03-08T20:29:29.696589+0000","last_fullsized":"2024-03-08T20:29:29.696589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325184+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:29:29.325184+0000","last_peered":"2024-03-08T20:29:29.325184+0000","last_clean":"2024-03-08T20:29:29.325184+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:29:29.325184+0000","last_undegraded":"2024-03-08T20:29:29.325184+0000","last_fullsized":"2024-03-08T20:29:29.325184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.325117+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:29:29.325117+0000","last_peered":"2024-03-08T20:29:29.325117+0000","last_clean":"2024-03-08T20:29:29.325117+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:29:29.325117+0000","last_undegraded":"2024-03-08T20:29:29.325117+0000","last_fullsized":"2024-03-08T20:29:29.325117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323214+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:29:29.323214+0000","last_peered":"2024-03-08T20:29:29.323214+0000","last_clean":"2024-03-08T20:29:29.323214+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:29:29.323214+0000","last_undegraded":"2024-03-08T20:29:29.323214+0000","last_fullsized":"2024-03-08T20:29:29.323214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326675+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:29:29.326675+0000","last_peered":"2024-03-08T20:29:29.326675+0000","last_clean":"2024-03-08T20:29:29.326675+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:29:29.326675+0000","last_undegraded":"2024-03-08T20:29:29.326675+0000","last_fullsized":"2024-03-08T20:29:29.326675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692321+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:29:29.692321+0000","last_peered":"2024-03-08T20:29:29.692321+0000","last_clean":"2024-03-08T20:29:29.692321+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:29:29.692321+0000","last_undegraded":"2024-03-08T20:29:29.692321+0000","last_fullsized":"2024-03-08T20:29:29.692321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695239+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:29:29.695239+0000","last_peered":"2024-03-08T20:29:29.695239+0000","last_clean":"2024-03-08T20:29:29.695239+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:29:29.695239+0000","last_undegraded":"2024-03-08T20:29:29.695239+0000","last_fullsized":"2024-03-08T20:29:29.695239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696160+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:29:29.696160+0000","last_peered":"2024-03-08T20:29:29.696160+0000","last_clean":"2024-03-08T20:29:29.696160+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:29:29.696160+0000","last_undegraded":"2024-03-08T20:29:29.696160+0000","last_fullsized":"2024-03-08T20:29:29.696160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.629573+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:29:29.629573+0000","last_peered":"2024-03-08T20:29:29.629573+0000","last_clean":"2024-03-08T20:29:29.629573+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:29:29.629573+0000","last_undegraded":"2024-03-08T20:29:29.629573+0000","last_fullsized":"2024-03-08T20:29:29.629573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.328419+0000","last_change":"2024-03-08T20:29:24.269658+0000","last_active":"2024-03-08T20:29:29.328419+0000","last_peered":"2024-03-08T20:29:29.328419+0000","last_clean":"2024-03-08T20:29:29.328419+0000","last_became_active":"2024-03-08T20:29:24.268813+0000","last_became_peered":"2024-03-08T20:29:24.268813+0000","last_unstale":"2024-03-08T20:29:29.328419+0000","last_undegraded":"2024-03-08T20:29:29.328419+0000","last_fullsized":"2024-03-08T20:29:29.328419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.324804+0000","last_change":"2024-03-08T20:29:24.244300+0000","last_active":"2024-03-08T20:29:29.324804+0000","last_peered":"2024-03-08T20:29:29.324804+0000","last_clean":"2024-03-08T20:29:29.324804+0000","last_became_active":"2024-03-08T20:29:24.243929+0000","last_became_peered":"2024-03-08T20:29:24.243929+0000","last_unstale":"2024-03-08T20:29:29.324804+0000","last_undegraded":"2024-03-08T20:29:29.324804+0000","last_fullsized":"2024-03-08T20:29:29.324804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.603720+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:29:29.603720+0000","last_peered":"2024-03-08T20:29:29.603720+0000","last_clean":"2024-03-08T20:29:29.603720+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:29:29.603720+0000","last_undegraded":"2024-03-08T20:29:29.603720+0000","last_fullsized":"2024-03-08T20:29:29.603720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692350+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:29:29.692350+0000","last_peered":"2024-03-08T20:29:29.692350+0000","last_clean":"2024-03-08T20:29:29.692350+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:29:29.692350+0000","last_undegraded":"2024-03-08T20:29:29.692350+0000","last_fullsized":"2024-03-08T20:29:29.692350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.323559+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:29:29.323559+0000","last_peered":"2024-03-08T20:29:29.323559+0000","last_clean":"2024-03-08T20:29:29.323559+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:29:29.323559+0000","last_undegraded":"2024-03-08T20:29:29.323559+0000","last_fullsized":"2024-03-08T20:29:29.323559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.330666+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:29:29.330666+0000","last_peered":"2024-03-08T20:29:29.330666+0000","last_clean":"2024-03-08T20:29:29.330666+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:29:29.330666+0000","last_undegraded":"2024-03-08T20:29:29.330666+0000","last_fullsized":"2024-03-08T20:29:29.330666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.695621+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:29:29.695621+0000","last_peered":"2024-03-08T20:29:29.695621+0000","last_clean":"2024-03-08T20:29:29.695621+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:29:29.695621+0000","last_undegraded":"2024-03-08T20:29:29.695621+0000","last_fullsized":"2024-03-08T20:29:29.695621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696357+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:29:29.696357+0000","last_peered":"2024-03-08T20:29:29.696357+0000","last_clean":"2024-03-08T20:29:29.696357+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:29:29.696357+0000","last_undegraded":"2024-03-08T20:29:29.696357+0000","last_fullsized":"2024-03-08T20:29:29.696357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696755+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:29:29.696755+0000","last_peered":"2024-03-08T20:29:29.696755+0000","last_clean":"2024-03-08T20:29:29.696755+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:29:29.696755+0000","last_undegraded":"2024-03-08T20:29:29.696755+0000","last_fullsized":"2024-03-08T20:29:29.696755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.322453+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:29:29.322453+0000","last_peered":"2024-03-08T20:29:29.322453+0000","last_clean":"2024-03-08T20:29:29.322453+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:29:29.322453+0000","last_undegraded":"2024-03-08T20:29:29.322453+0000","last_fullsized":"2024-03-08T20:29:29.322453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694028+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:29:29.694028+0000","last_peered":"2024-03-08T20:29:29.694028+0000","last_clean":"2024-03-08T20:29:29.694028+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:29:29.694028+0000","last_undegraded":"2024-03-08T20:29:29.694028+0000","last_fullsized":"2024-03-08T20:29:29.694028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.326448+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:29:29.326448+0000","last_peered":"2024-03-08T20:29:29.326448+0000","last_clean":"2024-03-08T20:29:29.326448+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:29:29.326448+0000","last_undegraded":"2024-03-08T20:29:29.326448+0000","last_fullsized":"2024-03-08T20:29:29.326448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.694256+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:29:29.694256+0000","last_peered":"2024-03-08T20:29:29.694256+0000","last_clean":"2024-03-08T20:29:29.694256+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:29:29.694256+0000","last_undegraded":"2024-03-08T20:29:29.694256+0000","last_fullsized":"2024-03-08T20:29:29.694256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.327678+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:29:29.327678+0000","last_peered":"2024-03-08T20:29:29.327678+0000","last_clean":"2024-03-08T20:29:29.327678+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:29:29.327678+0000","last_undegraded":"2024-03-08T20:29:29.327678+0000","last_fullsized":"2024-03-08T20:29:29.327678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.692705+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:29:29.692705+0000","last_peered":"2024-03-08T20:29:29.692705+0000","last_clean":"2024-03-08T20:29:29.692705+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:29:29.692705+0000","last_undegraded":"2024-03-08T20:29:29.692705+0000","last_fullsized":"2024-03-08T20:29:29.692705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.605002+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:29:29.605002+0000","last_peered":"2024-03-08T20:29:29.605002+0000","last_clean":"2024-03-08T20:29:29.605002+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:29:29.605002+0000","last_undegraded":"2024-03-08T20:29:29.605002+0000","last_fullsized":"2024-03-08T20:29:29.605002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-08T20:29:29.696518+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:29:29.696518+0000","last_peered":"2024-03-08T20:29:29.696518+0000","last_clean":"2024-03-08T20:29:29.696518+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:29:29.696518+0000","last_undegraded":"2024-03-08T20:29:29.696518+0000","last_fullsized":"2024-03-08T20:29:29.696518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":695877,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":695933,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:29:53.883 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T20:29:53.883 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-08T20:29:53.883 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-08T20:29:53.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-08T20:29:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.120+0000 7f80d2800640 1 Processor -- start 2024-03-08T20:29:54.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.120+0000 7f80d2800640 1 -- start start 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80d2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80cc06af80 0x7f80cc06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80d2800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80cc06ebd0 0x7f80cc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80d2800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc0aa980 con 0x7f80cc150410 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80d2800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc1508a0 con 0x7f80cc06ebd0 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80d2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0aac60 con 0x7f80cc06af80 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80cc06ebd0 0x7f80cc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f80cc06ebd0 0x7f80cc14fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57098/0 (socket says 172.21.15.118:57098) 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 -- 172.21.15.118:0/2242210853 learned_addr learned my addr 172.21.15.118:0/2242210853 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80cb400640 1 --2- 172.21.15.118:0/2242210853 >> v2:172.21.15.144:3300/0 conn(0x7f80cc06af80 0x7f80cc06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 -- 172.21.15.118:0/2242210853 >> v2:172.21.15.144:3300/0 conn(0x7f80cc06af80 msgr2=0x7f80cc06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:54.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 --2- 172.21.15.118:0/2242210853 >> v2:172.21.15.144:3300/0 conn(0x7f80cc06af80 0x7f80cc06e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.122+0000 7f80caa00640 1 -- 172.21.15.118:0/2242210853 >> v1:172.21.15.144:6789/0 conn(0x7f80cc150410 legacy=0x7f80cc152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:54.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.123+0000 7f80caa00640 1 -- 172.21.15.118:0/2242210853 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc0aaf40 con 0x7f80cc06ebd0 2024-03-08T20:29:54.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80caa00640 1 --2- 172.21.15.118:0/2242210853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06ebd0 0x7f80cc14fed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0732d0 tx=0x7f80b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb70c6d5645b87ac server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80ca000640 1 -- 172.21.15.118:0/2242210853 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b402e070 con 0x7f80cc06ebd0 2024-03-08T20:29:54.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80ca000640 1 -- 172.21.15.118:0/2242210853 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4037070 con 0x7f80cc06ebd0 2024-03-08T20:29:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80ca000640 1 -- 172.21.15.118:0/2242210853 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031a00 con 0x7f80cc06ebd0 2024-03-08T20:29:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80d2800640 1 -- 172.21.15.118:0/2242210853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06ebd0 msgr2=0x7f80cc14fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.124+0000 7f80d2800640 1 --2- 172.21.15.118:0/2242210853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06ebd0 0x7f80cc14fed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0732d0 tx=0x7f80b402b880 comp rx=0 tx=0).stop 2024-03-08T20:29:54.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 -- 172.21.15.118:0/2242210853 shutdown_connections 2024-03-08T20:29:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 --2- 172.21.15.118:0/2242210853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06ebd0 0x7f80cc14fed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 --2- 172.21.15.118:0/2242210853 >> v2:172.21.15.144:3300/0 conn(0x7f80cc06af80 0x7f80cc06e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 -- 172.21.15.118:0/2242210853 >> 172.21.15.118:0/2242210853 conn(0x7f80cc0a84c0 msgr2=0x7f80cc0a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 -- 172.21.15.118:0/2242210853 shutdown_connections 2024-03-08T20:29:54.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.125+0000 7f80d2800640 1 -- 172.21.15.118:0/2242210853 wait complete. 2024-03-08T20:29:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.127+0000 7f80d2800640 1 Processor -- start 2024-03-08T20:29:54.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.127+0000 7f80d2800640 1 -- start start 2024-03-08T20:29:54.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 0x7f80cc1ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80cc150410 0x7f80cc1df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c3f90 con 0x7f80cc06af80 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0c3e10 con 0x7f80cc06ebd0 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80d2800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc06b360 con 0x7f80cc150410 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80cb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57114/0 (socket says 172.21.15.118:57114) 2024-03-08T20:29:54.128 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.128+0000 7f80cb400640 1 -- 172.21.15.118:0/3074747276 learned_addr learned my addr 172.21.15.118:0/3074747276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80caa00640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 0x7f80cc1ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 -- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80cc150410 msgr2=0x7f80cc1df610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cbe00640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80cc150410 0x7f80cc1df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.129 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80cc150410 0x7f80cc1df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 -- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 msgr2=0x7f80cc1ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 0x7f80cc1ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 -- 172.21.15.118:0/3074747276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc148cf0 con 0x7f80cc06af80 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80caa00640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 0x7f80cc1ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80cb400640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d800 tx=0x7f80bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00b6c0 con 0x7f80cc06af80 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc019070 con 0x7f80cc06af80 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc148a10 con 0x7f80cc06af80 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00ba80 con 0x7f80cc06af80 2024-03-08T20:29:54.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.129+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc1e0d00 con 0x7f80cc06af80 2024-03-08T20:29:54.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.130+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc074a40 con 0x7f80cc06af80 2024-03-08T20:29:54.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.131+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f80bc00bc20 con 0x7f80cc06af80 2024-03-08T20:29:54.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.132+0000 7f80c3400640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 0x7f80a806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.132+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80bc08b230 con 0x7f80cc06af80 2024-03-08T20:29:54.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.132+0000 7f80caa00640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 0x7f80a806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.133+0000 7f80caa00640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 0x7f80a806e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.137+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f80bc01c360 con 0x7f80cc06af80 2024-03-08T20:29:54.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.355+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f80cc1e0ed0 con 0x7f80cc06af80 2024-03-08T20:29:54.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.356+0000 7f80c3400640 1 -- 172.21.15.118:0/3074747276 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f80bc059a50 con 0x7f80cc06af80 2024-03-08T20:29:54.356 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:54.356 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.358+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 msgr2=0x7f80a806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.358+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 0x7f80a806e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b4008030 comp rx=0 tx=0).stop 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.358+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 msgr2=0x7f80cc14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.358+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d800 tx=0x7f80bc00dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 shutdown_connections 2024-03-08T20:29:54.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80a806bbd0 0x7f80a806e090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f80cc150410 0x7f80cc1df610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80cc06ebd0 0x7f80cc1ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 --2- 172.21.15.118:0/3074747276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f80cc06af80 0x7f80cc14c1c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 >> 172.21.15.118:0/3074747276 conn(0x7f80cc0a84c0 msgr2=0x7f80cc0c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 shutdown_connections 2024-03-08T20:29:54.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.359+0000 7f80d2800640 1 -- 172.21.15.118:0/3074747276 wait complete. 2024-03-08T20:29:54.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-08T20:29:54.375 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:54.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.575+0000 7f0fb9800640 1 Processor -- start 2024-03-08T20:29:54.575 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.575+0000 7f0fb9800640 1 -- start start 2024-03-08T20:29:54.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0fb4156a10 0x7f0fb40c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb9800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb4156df0 con 0x7f0fb406ad10 2024-03-08T20:29:54.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb9800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb406eca0 con 0x7f0fb406b170 2024-03-08T20:29:54.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb9800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb406ea50 con 0x7f0fb4156a10 2024-03-08T20:29:54.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb2000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0fb406ad10 0x7f0fb41596f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58052/0 (socket says 172.21.15.118:58052) 2024-03-08T20:29:54.577 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb2000640 1 -- 172.21.15.118:0/2406663584 learned_addr learned my addr 172.21.15.118:0/2406663584 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:54.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.577+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/2406663584 >> v2:172.21.15.144:3300/0 conn(0x7f0fb4156a10 0x7f0fb40c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.578 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136388321 0 0) 0x7f0fb4156df0 con 0x7f0fb406ad10 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f98003520 con 0x7f0fb406ad10 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1958422014 0 0) 0x7f0f98003520 con 0x7f0fb406ad10 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 >> v2:172.21.15.144:3300/0 conn(0x7f0fb4156a10 msgr2=0x7f0fb40c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 --2- 172.21.15.118:0/2406663584 >> v2:172.21.15.144:3300/0 conn(0x7f0fb4156a10 0x7f0fb40c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 >> v1:172.21.15.144:6789/0 conn(0x7f0fb406b170 legacy=0x7f0fb4163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb406ef80 con 0x7f0fb406ad10 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f0f9c001670 con 0x7f0fb406ad10 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 >> v1:172.21.15.118:6789/0 conn(0x7f0fb406ad10 legacy=0x7f0fb41596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 0x7f0f98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98004800 0x7f0f98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f98005210 0x7f0f9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406ea50 con 0x7f0f98003a00 2024-03-08T20:29:54.579 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9800c160 con 0x7f0f98004800 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9800c360 con 0x7f0f98005210 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.578+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 0x7f0f98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2000640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98004800 0x7f0f98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2a00640 1 -- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f98005210 msgr2=0x7f0f9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb3400640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f98005210 0x7f0f9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f98005210 0x7f0f9800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2a00640 1 -- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98004800 msgr2=0x7f0f98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98004800 0x7f0f98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb2a00640 1 -- 172.21.15.118:0/2406663584 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98003520 con 0x7f0f98003a00 2024-03-08T20:29:54.580 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.579+0000 7f0fb3400640 1 -- 172.21.15.118:0/2406663584 reap_dead start 2024-03-08T20:29:54.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.580+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 0x7f0f98003e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009f90 tx=0x7f0f98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1e119d23b51eef server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.580+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4039070 con 0x7f0f98003a00 2024-03-08T20:29:54.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.580+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa402cbf0 con 0x7f0f98003a00 2024-03-08T20:29:54.582 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.580+0000 7f0fb1600640 1 -- 172.21.15.118:0/2406663584 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4009c10 con 0x7f0f98003a00 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 -- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 msgr2=0x7f0f98003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 0x7f0f98003e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009f90 tx=0x7f0f98005830 comp rx=0 tx=0).stop 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 -- 172.21.15.118:0/2406663584 shutdown_connections 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 --2- 172.21.15.118:0/2406663584 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f98003a00 0x7f0f98003e20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 -- 172.21.15.118:0/2406663584 >> 172.21.15.118:0/2406663584 conn(0x7f0fb40a84c0 msgr2=0x7f0fb40a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 -- 172.21.15.118:0/2406663584 shutdown_connections 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.581+0000 7f0fb9800640 1 -- 172.21.15.118:0/2406663584 wait complete. 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.583+0000 7f0fb9800640 1 Processor -- start 2024-03-08T20:29:54.583 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.583+0000 7f0fb9800640 1 -- start start 2024-03-08T20:29:54.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98003a00 0x7f0fb41eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb40c6dd0 0x7f0fb414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.585 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406e5b0 con 0x7f0fb41f2910 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406e2d0 con 0x7f0f98003a00 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb9800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c2d70 con 0x7f0fb40c6dd0 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57142/0 (socket says 172.21.15.118:57142) 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 -- 172.21.15.118:0/1007800300 learned_addr learned my addr 172.21.15.118:0/1007800300 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb2000640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb40c6dd0 0x7f0fb414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 -- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb40c6dd0 msgr2=0x7f0fb414e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb40c6dd0 0x7f0fb414e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 -- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98003a00 msgr2=0x7f0fb41eece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98003a00 0x7f0fb41eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.584+0000 7f0fb3400640 1 -- 172.21.15.118:0/1007800300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4157710 con 0x7f0fb41f2910 2024-03-08T20:29:54.586 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0fb3400640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fb406bdb0 tx=0x7f0fac00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac018070 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac0052d0 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac003810 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb415b1e0 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.585+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb41f23f0 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.586+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb415b700 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.587+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0fac01b070 con 0x7f0fb41f2910 2024-03-08T20:29:54.587 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.588+0000 7f0faaa00640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 0x7f0f9006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:54.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.589+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0fac08a260 con 0x7f0fb41f2910 2024-03-08T20:29:54.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.589+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 0x7f0f9006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:54.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.589+0000 7f0fb2a00640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 0x7f0f9006e0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4036000 tx=0x7f0fa402e070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:54.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.593+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f0fb415b700 con 0x7f0fb41f2910 2024-03-08T20:29:54.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.789+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fb4074a40 con 0x7f0fb41f2910 2024-03-08T20:29:54.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.792+0000 7f0faaa00640 1 -- 172.21.15.118:0/1007800300 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f0fac058a00 con 0x7f0fb41f2910 2024-03-08T20:29:54.792 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:54.792 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 msgr2=0x7f0f9006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 0x7f0f9006e0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4036000 tx=0x7f0fa402e070 comp rx=0 tx=0).stop 2024-03-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 msgr2=0x7f0fb41f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fb406bdb0 tx=0x7f0fac00d890 comp rx=0 tx=0).stop 2024-03-08T20:29:54.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 shutdown_connections 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0f9006bc00 0x7f0f9006e0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fb41f2910 0x7f0fb41f2da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb40c6dd0 0x7f0fb414e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 --2- 172.21.15.118:0/1007800300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f98003a00 0x7f0fb41eece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 >> 172.21.15.118:0/1007800300 conn(0x7f0fb40a84c0 msgr2=0x7f0fb40c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:54.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 shutdown_connections 2024-03-08T20:29:54.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:54.796+0000 7f0fb9800640 1 -- 172.21.15.118:0/1007800300 wait complete. 2024-03-08T20:29:54.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:29:54.815 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:29:55.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.022+0000 7f3ed1c00640 1 Processor -- start 2024-03-08T20:29:55.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.022+0000 7f3ed1c00640 1 -- start start 2024-03-08T20:29:55.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.023+0000 7f3ed1c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc0c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.023+0000 7f3ed1c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ecc0c2390 0x7f3ecc0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.023+0000 7f3ed1c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc1550f0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ed1c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc1553d0 con 0x7f3ecc0c2390 2024-03-08T20:29:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ed1c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1556b0 con 0x7f3ecc14f230 2024-03-08T20:29:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ecc0c2390 0x7f3ecc0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3ecc0c2390 0x7f3ecc0c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57156/0 (socket says 172.21.15.118:57156) 2024-03-08T20:29:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 -- 172.21.15.118:0/2220560061 learned_addr learned my addr 172.21.15.118:0/2220560061 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:55.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecbe00640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc0c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 -- 172.21.15.118:0/2220560061 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 msgr2=0x7f3ecc0c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc0c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 -- 172.21.15.118:0/2220560061 >> v1:172.21.15.144:6789/0 conn(0x7f3ecc0c1e40 legacy=0x7f3ecc151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.024+0000 7f3ecb400640 1 -- 172.21.15.118:0/2220560061 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc155990 con 0x7f3ecc0c2390 2024-03-08T20:29:55.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.025+0000 7f3ecb400640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c1900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009870 tx=0x7f3eb802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e61568a77a042a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ecaa00640 1 -- 172.21.15.118:0/2220560061 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb802f830 con 0x7f3ecc0c2390 2024-03-08T20:29:55.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ecaa00640 1 -- 172.21.15.118:0/2220560061 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb802f9d0 con 0x7f3ecc0c2390 2024-03-08T20:29:55.026 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ecaa00640 1 -- 172.21.15.118:0/2220560061 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb802fda0 con 0x7f3ecc0c2390 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ed1c00640 1 -- 172.21.15.118:0/2220560061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c2390 msgr2=0x7f3ecc0c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c1900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009870 tx=0x7f3eb802ba10 comp rx=0 tx=0).stop 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ed1c00640 1 -- 172.21.15.118:0/2220560061 shutdown_connections 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.026+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c1900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.027+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/2220560061 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc0c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.027+0000 7f3ed1c00640 1 -- 172.21.15.118:0/2220560061 >> 172.21.15.118:0/2220560061 conn(0x7f3ecc0c6480 msgr2=0x7f3ecc0c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.027+0000 7f3ed1c00640 1 -- 172.21.15.118:0/2220560061 shutdown_connections 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.027+0000 7f3ed1c00640 1 -- 172.21.15.118:0/2220560061 wait complete. 2024-03-08T20:29:55.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.028+0000 7f3ed1c00640 1 Processor -- start 2024-03-08T20:29:55.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.028+0000 7f3ed1c00640 1 -- start start 2024-03-08T20:29:55.030 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc1e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc14f790 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc14f610 con 0x7f3ecc0c2390 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.029+0000 7f3ed1c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1522f0 con 0x7f3ecc14f230 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57164/0 (socket says 172.21.15.118:57164) 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 -- 172.21.15.118:0/1791252604 learned_addr learned my addr 172.21.15.118:0/1791252604 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 -- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 msgr2=0x7f3ecc1e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecb400640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ed1200640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc1e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc1e9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 -- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 msgr2=0x7f3ecc0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 -- 172.21.15.118:0/1791252604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc154aa0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecb400640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.030+0000 7f3ecbe00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00d600 tx=0x7f3ebc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.031+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0125f0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.031+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc019070 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.031+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0129f0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.031+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc150bc0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.031+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc1503d0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.032+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc074a40 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.033+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3ebc012b90 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.034+0000 7f3ec3e00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 0x7f3eac06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.034+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3ebc08b1e0 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.034+0000 7f3ecb400640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 0x7f3eac06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.034 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.035+0000 7f3ecb400640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 0x7f3eac06e0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8036000 tx=0x7f3eb8039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.038+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3ebc059990 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.234 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.235+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ecc06f240 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.235 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.236+0000 7f3ec3e00640 1 -- 172.21.15.118:0/1791252604 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ebc059290 con 0x7f3ecc0c1e40 2024-03-08T20:29:55.236 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 msgr2=0x7f3eac06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 0x7f3eac06e0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8036000 tx=0x7f3eb8039040 comp rx=0 tx=0).stop 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 msgr2=0x7f3ecc0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00d600 tx=0x7f3ebc00dac0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 shutdown_connections 2024-03-08T20:29:55.239 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f3eac06bc00 0x7f3eac06e0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ecc14f230 0x7f3ecc1e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ecc0c2390 0x7f3ecc0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 --2- 172.21.15.118:0/1791252604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3ecc0c1e40 0x7f3ecc0c4bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 >> 172.21.15.118:0/1791252604 conn(0x7f3ecc0c6480 msgr2=0x7f3ecc0a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 shutdown_connections 2024-03-08T20:29:55.240 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.239+0000 7f3ed1c00640 1 -- 172.21.15.118:0/1791252604 wait complete. 2024-03-08T20:29:55.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.463+0000 7fd984a00640 1 Processor -- start 2024-03-08T20:29:55.463 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.464+0000 7fd984a00640 1 -- start start 2024-03-08T20:29:55.464 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd984a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd980155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd984a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd980158440 0x7fd9801588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd984a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd980154ed0 con 0x7fd980152540 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd984a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800c8dc0 con 0x7fd980158440 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd984a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd980158e90 con 0x7fd980152920 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd97f400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd980152540 0x7fd9800c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58054/0 (socket says 172.21.15.118:58054) 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd97f400640 1 -- 172.21.15.118:0/3530437422 learned_addr learned my addr 172.21.15.118:0/3530437422 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:55.465 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.465+0000 7fd97fe00640 1 --2- 172.21.15.118:0/3530437422 >> v2:172.21.15.118:3300/0 conn(0x7fd980158440 0x7fd9801588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd977e00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd980155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97ea00640 1 -- 172.21.15.118:0/3530437422 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296819582 0 0) 0x7fd980154ed0 con 0x7fd980152540 2024-03-08T20:29:55.468 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97ea00640 1 -- 172.21.15.118:0/3530437422 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd964003520 con 0x7fd980152540 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97fe00640 1 -- 172.21.15.118:0/3530437422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 msgr2=0x7fd980155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97fe00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd980155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97fe00640 1 -- 172.21.15.118:0/3530437422 >> v1:172.21.15.118:6789/0 conn(0x7fd980152540 legacy=0x7fd9800c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.466+0000 7fd97fe00640 1 -- 172.21.15.118:0/3530437422 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980159170 con 0x7fd980158440 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.467+0000 7fd97fe00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9801588a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd978009d90 tx=0x7fd97802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ce5f619277c5e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.467+0000 7fd97ea00640 1 -- 172.21.15.118:0/3530437422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978039070 con 0x7fd980158440 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.467+0000 7fd97ea00640 1 -- 172.21.15.118:0/3530437422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97802cb30 con 0x7fd980158440 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.467+0000 7fd97ea00640 1 -- 172.21.15.118:0/3530437422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978034440 con 0x7fd980158440 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 -- 172.21.15.118:0/3530437422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 msgr2=0x7fd9801588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9801588a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd978009d90 tx=0x7fd97802bd80 comp rx=0 tx=0).stop 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 -- 172.21.15.118:0/3530437422 shutdown_connections 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9801588a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 --2- 172.21.15.118:0/3530437422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd980155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 -- 172.21.15.118:0/3530437422 >> 172.21.15.118:0/3530437422 conn(0x7fd9800ac290 msgr2=0x7fd9800ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 -- 172.21.15.118:0/3530437422 shutdown_connections 2024-03-08T20:29:55.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.468+0000 7fd984a00640 1 -- 172.21.15.118:0/3530437422 wait complete. 2024-03-08T20:29:55.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.470+0000 7fd984a00640 1 Processor -- start 2024-03-08T20:29:55.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.470+0000 7fd984a00640 1 -- start start 2024-03-08T20:29:55.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd980152540 0x7fd9800c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd98014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.473 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98006d900 con 0x7fd980158440 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980155470 con 0x7fd980152540 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd984a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98006da80 con 0x7fd980152920 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57176/0 (socket says 172.21.15.118:57176) 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 -- 172.21.15.118:0/919238851 learned_addr learned my addr 172.21.15.118:0/919238851 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97f400640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd980152540 0x7fd9800c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd977e00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd98014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 -- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 msgr2=0x7fd98014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd98014fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 -- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd980152540 msgr2=0x7fd9800c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd980152540 0x7fd9800c1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.474 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.471+0000 7fd97fe00640 1 -- 172.21.15.118:0/919238851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9801ee360 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd97fe00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd978009eb0 tx=0x7fd978004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978039050 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd978045070 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97803e850 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9800c2110 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.472+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9800c26d0 con 0x7fd980158440 2024-03-08T20:29:55.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.473+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd980074a40 con 0x7fd980158440 2024-03-08T20:29:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.474+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd97803e9f0 con 0x7fd980158440 2024-03-08T20:29:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.475+0000 7fd977400640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 0x7fd95c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.475+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd9780adbd0 con 0x7fd980158440 2024-03-08T20:29:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.476+0000 7fd97f400640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 0x7fd95c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.476+0000 7fd97f400640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 0x7fd95c06e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c74e0 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.482 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.482+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd978032e20 con 0x7fd980158440 2024-03-08T20:29:55.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.678+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9801502b0 con 0x7fd980158440 2024-03-08T20:29:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.679+0000 7fd977400640 1 -- 172.21.15.118:0/919238851 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd97807c490 con 0x7fd980158440 2024-03-08T20:29:55.678 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 msgr2=0x7fd95c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 0x7fd95c06e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c74e0 tx=0x7fd970009040 comp rx=0 tx=0).stop 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 msgr2=0x7fd9800c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd978009eb0 tx=0x7fd978004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 shutdown_connections 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd95c06bbd0 0x7fd95c06e090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd980158440 0x7fd9800c3c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd980152920 0x7fd98014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 --2- 172.21.15.118:0/919238851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd980152540 0x7fd9800c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 >> 172.21.15.118:0/919238851 conn(0x7fd9800ac290 msgr2=0x7fd9800c4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.681+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 shutdown_connections 2024-03-08T20:29:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.682+0000 7fd984a00640 1 -- 172.21.15.118:0/919238851 wait complete. 2024-03-08T20:29:55.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:29:55.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.908+0000 7f11a4000640 1 Processor -- start 2024-03-08T20:29:55.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.908+0000 7f11a4000640 1 -- start start 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.909+0000 7f11a4000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f119c0c5cb0 0x7f119c152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.909+0000 7f11a4000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c152d10 con 0x7f119c0c0f80 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.909+0000 7f11a4000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c0c4560 con 0x7f119c1528c0 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.909+0000 7f11a4000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c0c4840 con 0x7f119c0c5cb0 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.910+0000 7f11a0c00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f119c0c0f80 0x7f119c1588c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58066/0 (socket says 172.21.15.118:58066) 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.910+0000 7f11a0c00640 1 -- 172.21.15.118:0/3853188786 learned_addr learned my addr 172.21.15.118:0/3853188786 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.910+0000 7f11a1600640 1 --2- 172.21.15.118:0/3853188786 >> v2:172.21.15.144:3300/0 conn(0x7f119c0c5cb0 0x7f119c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.910+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116580167 0 0) 0x7f119c152d10 con 0x7f119c0c0f80 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.910+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1184003520 con 0x7f119c0c0f80 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698137970 0 0) 0x7f1184003520 con 0x7f119c0c0f80 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 >> v2:172.21.15.144:3300/0 conn(0x7f119c0c5cb0 msgr2=0x7f119c152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 --2- 172.21.15.118:0/3853188786 >> v2:172.21.15.144:3300/0 conn(0x7f119c0c5cb0 0x7f119c152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 >> v1:172.21.15.144:6789/0 conn(0x7f119c1528c0 legacy=0x7f119c15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0c4b20 con 0x7f119c0c0f80 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f1188001670 con 0x7f119c0c0f80 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 >> v1:172.21.15.118:6789/0 conn(0x7f119c0c0f80 legacy=0x7f119c1588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 0x7f1184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004800 0x7f1184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11840052e0 0x7f118400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0c4840 con 0x7f11840039b0 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118400c1b0 con 0x7f11840052e0 2024-03-08T20:29:55.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118400c3b0 con 0x7f1184004800 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 0x7f1184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 -- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004800 msgr2=0x7f1184004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1184004800 0x7f1184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 -- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11840052e0 msgr2=0x7f118400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11840052e0 0x7f118400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a1600640 1 -- 172.21.15.118:0/3853188786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184003520 con 0x7f11840039b0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.911+0000 7f11a2000640 1 -- 172.21.15.118:0/3853188786 reap_dead start 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.912+0000 7f11a1600640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 0x7f1184003dd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1190009a90 tx=0x7f1184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb4b2e6a3c8ff68 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190039070 con 0x7f11840039b0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119002c6b0 con 0x7f11840039b0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f119be00640 1 -- 172.21.15.118:0/3853188786 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190009690 con 0x7f11840039b0 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 -- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 msgr2=0x7f1184003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 0x7f1184003dd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1190009a90 tx=0x7f1184005830 comp rx=0 tx=0).stop 2024-03-08T20:29:55.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 -- 172.21.15.118:0/3853188786 shutdown_connections 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 --2- 172.21.15.118:0/3853188786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f11840039b0 0x7f1184003dd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 -- 172.21.15.118:0/3853188786 >> 172.21.15.118:0/3853188786 conn(0x7f119c06b720 msgr2=0x7f119c0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 -- 172.21.15.118:0/3853188786 shutdown_connections 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.913+0000 7f11a4000640 1 -- 172.21.15.118:0/3853188786 wait complete. 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.915+0000 7f11a4000640 1 Processor -- start 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.915+0000 7f11a4000640 1 -- start start 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11840039b0 0x7f119c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 0x7f119c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0c1a70 con 0x7f119c071220 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0c50e0 con 0x7f119c0aabc0 2024-03-08T20:29:55.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a4000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0c1bf0 con 0x7f11840039b0 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57184/0 (socket says 172.21.15.118:57184) 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 -- 172.21.15.118:0/121451092 learned_addr learned my addr 172.21.15.118:0/121451092 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a1600640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11840039b0 0x7f119c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a2000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 0x7f119c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 -- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11840039b0 msgr2=0x7f119c0aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11840039b0 0x7f119c0aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.916+0000 7f11a0c00640 1 -- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 msgr2=0x7f119c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a0c00640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 0x7f119c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a0c00640 1 -- 172.21.15.118:0/121451092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c156e60 con 0x7f119c071220 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a2000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 0x7f119c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a0c00640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f118800c7a0 tx=0x7f118800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188018070 con 0x7f119c071220 2024-03-08T20:29:55.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800ce50 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c1eba00 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880047e0 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.917+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c1eaf20 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.918+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c074a40 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.919+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f118801b070 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.920+0000 7f1199600640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 0x7f117c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.920+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f118808a300 con 0x7f119c071220 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.920+0000 7f11a1600640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 0x7f117c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.921+0000 7f11a1600640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 0x7f117c06e0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1190036000 tx=0x7f1190030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:55.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:55.924+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f119c156e60 con 0x7f119c071220 2024-03-08T20:29:56.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.118+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f119c0c3cd0 con 0x7f119c071220 2024-03-08T20:29:56.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.119+0000 7f1199600640 1 -- 172.21.15.118:0/121451092 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1188058aa0 con 0x7f119c071220 2024-03-08T20:29:56.119 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:29:56.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.121+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 msgr2=0x7f117c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.121+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 0x7f117c06e0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1190036000 tx=0x7f1190030000 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.121+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 msgr2=0x7f119c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.121+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f118800c7a0 tx=0x7f118800cc60 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 shutdown_connections 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f117c06bc00 0x7f117c06e0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f119c0aabc0 0x7f119c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f119c071220 0x7f119c1563e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 --2- 172.21.15.118:0/121451092 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11840039b0 0x7f119c0aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 >> 172.21.15.118:0/121451092 conn(0x7f119c06b720 msgr2=0x7f119c150770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 shutdown_connections 2024-03-08T20:29:56.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.122+0000 7f11a4000640 1 -- 172.21.15.118:0/121451092 wait complete. 2024-03-08T20:29:56.141 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:29:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.349+0000 7fadc1000640 1 Processor -- start 2024-03-08T20:29:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.349+0000 7fadc1000640 1 -- start start 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.350+0000 7fadc1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fadbc0c4480 0x7fadbc152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadc1000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc0c4980 con 0x7fadbc0c5a20 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadc1000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc0c4c60 con 0x7fadbc06e4b0 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadc1000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0c5590 con 0x7fadbc0c4480 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadba800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fadbc0c5a20 0x7fadbc06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58078/0 (socket says 172.21.15.118:58078) 2024-03-08T20:29:56.351 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadba800640 1 -- 172.21.15.118:0/1335281507 learned_addr learned my addr 172.21.15.118:0/1335281507 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadb9400640 1 --2- 172.21.15.118:0/1335281507 >> v2:172.21.15.144:3300/0 conn(0x7fadbc0c4480 0x7fadbc152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31819280 0 0) 0x7fadbc0c4980 con 0x7fadbc0c5a20 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.351+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada0003520 con 0x7fadbc0c5a20 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768192131 0 0) 0x7fada0003520 con 0x7fadbc0c5a20 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 >> v2:172.21.15.144:3300/0 conn(0x7fadbc0c4480 msgr2=0x7fadbc152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 --2- 172.21.15.118:0/1335281507 >> v2:172.21.15.144:3300/0 conn(0x7fadbc0c4480 0x7fadbc152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 >> v1:172.21.15.144:6789/0 conn(0x7fadbc06e4b0 legacy=0x7fadbc1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0c4f40 con 0x7fadbc0c5a20 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fadb40019f0 con 0x7fadbc0c5a20 2024-03-08T20:29:56.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 >> v1:172.21.15.118:6789/0 conn(0x7fadbc0c5a20 legacy=0x7fadbc06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 0x7fada0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada0004800 0x7fada0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada0005210 0x7fada000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0c5590 con 0x7fada00039b0 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada000c140 con 0x7fada0005210 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada000c340 con 0x7fada0004800 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 0x7fada0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb9400640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada0004800 0x7fada0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb9e00640 1 -- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada0004800 msgr2=0x7fada0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fada0004800 0x7fada0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.352+0000 7fadba800640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada0005210 0x7fada000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.353+0000 7fadb9e00640 1 -- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada0005210 msgr2=0x7fada000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.353+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada0005210 0x7fada000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.353+0000 7fadba800640 1 -- 172.21.15.118:0/1335281507 reap_dead start 2024-03-08T20:29:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.353+0000 7fadb9e00640 1 -- 172.21.15.118:0/1335281507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0003520 con 0x7fada00039b0 2024-03-08T20:29:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 0x7fada0003df0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadac001750 tx=0x7fada0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5811af5201d504a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac001370 con 0x7fada00039b0 2024-03-08T20:29:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac0052d0 con 0x7fada00039b0 2024-03-08T20:29:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadb8a00640 1 -- 172.21.15.118:0/1335281507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac003830 con 0x7fada00039b0 2024-03-08T20:29:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadc1000640 1 -- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 msgr2=0x7fada0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadc1000640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 0x7fada0003df0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadac001750 tx=0x7fada0005830 comp rx=0 tx=0).stop 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.354+0000 7fadc1000640 1 -- 172.21.15.118:0/1335281507 shutdown_connections 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.355+0000 7fadc1000640 1 --2- 172.21.15.118:0/1335281507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fada00039b0 0x7fada0003df0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.355+0000 7fadc1000640 1 -- 172.21.15.118:0/1335281507 >> 172.21.15.118:0/1335281507 conn(0x7fadbc06b720 msgr2=0x7fadbc0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.355+0000 7fadc1000640 1 -- 172.21.15.118:0/1335281507 shutdown_connections 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.355+0000 7fadc1000640 1 -- 172.21.15.118:0/1335281507 wait complete. 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.356+0000 7fadc1000640 1 Processor -- start 2024-03-08T20:29:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.356+0000 7fadc1000640 1 -- start start 2024-03-08T20:29:56.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.357+0000 7fadc1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada00039b0 0x7fadbc1e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.357+0000 7fadc1000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadbc0a7650 0x7fadbc1dc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.357+0000 7fadc1000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.357+0000 7fadc1000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0c5e40 con 0x7fadbc0aa380 2024-03-08T20:29:56.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.357+0000 7fadc1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1505f0 con 0x7fada00039b0 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadc1000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0a95c0 con 0x7fadbc0a7650 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57212/0 (socket says 172.21.15.118:57212) 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 -- 172.21.15.118:0/1683997799 learned_addr learned my addr 172.21.15.118:0/1683997799 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadb9400640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadbc0a7650 0x7fadbc1dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 -- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadbc0a7650 msgr2=0x7fadbc1dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadbc0a7650 0x7fadbc1dc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 -- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada00039b0 msgr2=0x7fadbc1e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada00039b0 0x7fadbc1e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada00039b0 0x7fadbc1e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 -- 172.21.15.118:0/1683997799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0a98a0 con 0x7fadbc0aa380 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.358+0000 7fadba800640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fadbc156230 tx=0x7fadb400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.359+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400b8d0 con 0x7fadbc0aa380 2024-03-08T20:29:56.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.359+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400ba90 con 0x7fadbc0aa380 2024-03-08T20:29:56.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.359+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc0a9b80 con 0x7fadbc0aa380 2024-03-08T20:29:56.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.359+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400be80 con 0x7fadbc0aa380 2024-03-08T20:29:56.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.359+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc1dcba0 con 0x7fadbc0aa380 2024-03-08T20:29:56.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.360+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc074a40 con 0x7fadbc0aa380 2024-03-08T20:29:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.361+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fadb401b020 con 0x7fadbc0aa380 2024-03-08T20:29:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.361+0000 7fadb2000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 0x7fad9c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.362+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fadb408ae50 con 0x7fadbc0aa380 2024-03-08T20:29:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.362+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 0x7fad9c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.362+0000 7fadb9e00640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 0x7fad9c06e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fadac033000 tx=0x7fadac009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.366 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.366+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fadb4059600 con 0x7fadbc0aa380 2024-03-08T20:29:56.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.548+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fadbc0c0c60 con 0x7fadbc0aa380 2024-03-08T20:29:56.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.549+0000 7fadb2000640 1 -- 172.21.15.118:0/1683997799 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fadb4058f00 con 0x7fadbc0aa380 2024-03-08T20:29:56.549 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.551+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 msgr2=0x7fad9c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.551+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 0x7fad9c06e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fadac033000 tx=0x7fadac009030 comp rx=0 tx=0).stop 2024-03-08T20:29:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.551+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 msgr2=0x7fadbc0aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.551+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fadbc156230 tx=0x7fadb400b0d0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 shutdown_connections 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fad9c06bc00 0x7fad9c06e0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fadbc0aa380 0x7fadbc0aa800 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadbc0a7650 0x7fadbc1dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 --2- 172.21.15.118:0/1683997799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fada00039b0 0x7fadbc1e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 >> 172.21.15.118:0/1683997799 conn(0x7fadbc06b720 msgr2=0x7fadbc152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 shutdown_connections 2024-03-08T20:29:56.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.552+0000 7fadc1000640 1 -- 172.21.15.118:0/1683997799 wait complete. 2024-03-08T20:29:56.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:56.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.776+0000 7fa4d7e00640 1 Processor -- start 2024-03-08T20:29:56.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.776+0000 7fa4d7e00640 1 -- start start 2024-03-08T20:29:56.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.777+0000 7fa4d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4d00c38b0 0x7fa4d01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.777+0000 7fa4d7e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00c3e90 con 0x7fa4d014f210 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4d7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00c1210 con 0x7fa4d00aa7e0 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4d7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00c14f0 con 0x7fa4d00c38b0 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4d5400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa4d014f210 0x7fa4d006ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58090/0 (socket says 172.21.15.118:58090) 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4d5400640 1 -- 172.21.15.118:0/1283045193 learned_addr learned my addr 172.21.15.118:0/1283045193 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/1283045193 >> v2:172.21.15.144:3300/0 conn(0x7fa4d00c38b0 0x7fa4d01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306306557 0 0) 0x7fa4d00c3e90 con 0x7fa4d014f210 2024-03-08T20:29:56.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.778+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b8005730 con 0x7fa4d014f210 2024-03-08T20:29:56.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 69586511 0 0) 0x7fa4b8005730 con 0x7fa4d014f210 2024-03-08T20:29:56.781 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 >> v2:172.21.15.144:3300/0 conn(0x7fa4d00c38b0 msgr2=0x7fa4d01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 --2- 172.21.15.118:0/1283045193 >> v2:172.21.15.144:3300/0 conn(0x7fa4d00c38b0 0x7fa4d01523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 >> v1:172.21.15.144:6789/0 conn(0x7fa4d00aa7e0 legacy=0x7fa4d0151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00c0cc0 con 0x7fa4d014f210 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fa4c4001670 con 0x7fa4d014f210 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 >> v1:172.21.15.118:6789/0 conn(0x7fa4d014f210 legacy=0x7fa4d006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b8005bc0 0x7fa4b8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4b8006a10 0x7fa4b8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 0x7fa4b800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c14f0 con 0x7fa4b80074f0 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b800e3c0 con 0x7fa4b8006a10 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b800e5c0 con 0x7fa4b8005bc0 2024-03-08T20:29:56.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 0x7fa4b800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5400640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b8005bc0 0x7fa4b8005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d4a00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4b8006a10 0x7fa4b8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5e00640 1 -- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b8005bc0 msgr2=0x7fa4b8005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b8005bc0 0x7fa4b8005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5e00640 1 -- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4b8006a10 msgr2=0x7fa4b8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.779+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4b8006a10 0x7fa4b8006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.780+0000 7fa4d5e00640 1 -- 172.21.15.118:0/1283045193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8005730 con 0x7fa4b80074f0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.780+0000 7fa4d5e00640 1 -- 172.21.15.118:0/1283045193 reap_dead start 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 0x7fa4b800dbd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009f90 tx=0x7fa4b8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55752f862b32eea3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8009c10 con 0x7fa4b80074f0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c802cc20 con 0x7fa4b80074f0 2024-03-08T20:29:56.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4cfe00640 1 -- 172.21.15.118:0/1283045193 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8003990 con 0x7fa4b80074f0 2024-03-08T20:29:56.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4d7e00640 1 -- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 msgr2=0x7fa4b800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.781+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 0x7fa4b800dbd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009f90 tx=0x7fa4b8007a40 comp rx=0 tx=0).stop 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.782+0000 7fa4d7e00640 1 -- 172.21.15.118:0/1283045193 shutdown_connections 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.782+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/1283045193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4b80074f0 0x7fa4b800dbd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.782+0000 7fa4d7e00640 1 -- 172.21.15.118:0/1283045193 >> 172.21.15.118:0/1283045193 conn(0x7fa4d00a84c0 msgr2=0x7fa4d00a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.782+0000 7fa4d7e00640 1 -- 172.21.15.118:0/1283045193 shutdown_connections 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.782+0000 7fa4d7e00640 1 -- 172.21.15.118:0/1283045193 wait complete. 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.783+0000 7fa4d7e00640 1 Processor -- start 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.783+0000 7fa4d7e00640 1 -- start start 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b80074f0 0x7fa4d0150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d014e3e0 0x7fa4d013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.786 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014f5f0 con 0x7fa4d01db340 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d006ad10 con 0x7fa4d014e3e0 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.784+0000 7fa4d7e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01ea540 con 0x7fa4b80074f0 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57230/0 (socket says 172.21.15.118:57230) 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 -- 172.21.15.118:0/3201537676 learned_addr learned my addr 172.21.15.118:0/3201537676 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d4a00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d014e3e0 0x7fa4d013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5400640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b80074f0 0x7fa4d0150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 -- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b80074f0 msgr2=0x7fa4d0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b80074f0 0x7fa4d0150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 -- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d014e3e0 msgr2=0x7fa4d013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d014e3e0 0x7fa4d013f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 -- 172.21.15.118:0/3201537676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0151940 con 0x7fa4d01db340 2024-03-08T20:29:56.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.785+0000 7fa4d5e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa4c802c690 tx=0x7fa4c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.786+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c802ca20 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.786+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8044070 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.786+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d01ea7e0 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.786+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8004820 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.786+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d0149520 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.787+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0074a40 con 0x7fa4d01db340 2024-03-08T20:29:56.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.788+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa4c803d040 con 0x7fa4d01db340 2024-03-08T20:29:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.789+0000 7fa4cd600640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 0x7fa4b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.789+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa4c80ad280 con 0x7fa4d01db340 2024-03-08T20:29:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.789+0000 7fa4d5400640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 0x7fa4b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:56.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.789+0000 7fa4d5400640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 0x7fa4b406e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4001200 tx=0x7fa4c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:56.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:56.793+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa4c807ba20 con 0x7fa4d01db340 2024-03-08T20:29:57.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.027+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d0151ba0 con 0x7fa4d01db340 2024-03-08T20:29:57.029 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.029+0000 7fa4cd600640 1 -- 172.21.15.118:0/3201537676 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fa4c807b320 con 0x7fa4d01db340 2024-03-08T20:29:57.029 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:57.029 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:29:57.030 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:29:57.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 msgr2=0x7fa4b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.031 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 0x7fa4b406e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4001200 tx=0x7fa4c4009040 comp rx=0 tx=0).stop 2024-03-08T20:29:57.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 msgr2=0x7fa4d01dd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa4c802c690 tx=0x7fa4c8009750 comp rx=0 tx=0).stop 2024-03-08T20:29:57.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 shutdown_connections 2024-03-08T20:29:57.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa4b406bbd0 0x7fa4b406e090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.032 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4d01db340 0x7fa4d01dd6d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d014e3e0 0x7fa4d013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 --2- 172.21.15.118:0/3201537676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4b80074f0 0x7fa4d0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.031+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 >> 172.21.15.118:0/3201537676 conn(0x7fa4d00a84c0 msgr2=0x7fa4d006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:57.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.032+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 shutdown_connections 2024-03-08T20:29:57.033 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.032+0000 7fa4d7e00640 1 -- 172.21.15.118:0/3201537676 wait complete. 2024-03-08T20:29:57.050 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:57.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.248+0000 7fb389c00640 1 Processor -- start 2024-03-08T20:29:57.249 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.248+0000 7fb389c00640 1 -- start start 2024-03-08T20:29:57.250 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb389c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406af80 0x7fb38406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb389c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb3841505e0 0x7fb384152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb389c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3840aa980 con 0x7fb38406ebd0 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb389c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3840aac60 con 0x7fb3841505e0 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb389c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840aaf40 con 0x7fb38406af80 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb383400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb3841505e0 0x7fb384152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb383400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb3841505e0 0x7fb384152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57238/0 (socket says 172.21.15.118:57238) 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb383400640 1 -- 172.21.15.118:0/735674366 learned_addr learned my addr 172.21.15.118:0/735674366 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:57.251 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.250+0000 7fb382a00640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406af80 0x7fb38406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.251+0000 7fb383400640 1 -- 172.21.15.118:0/735674366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406af80 msgr2=0x7fb38406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.251+0000 7fb383400640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406af80 0x7fb38406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.251+0000 7fb383400640 1 -- 172.21.15.118:0/735674366 >> v1:172.21.15.144:6789/0 conn(0x7fb38406ebd0 legacy=0x7fb38414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.251+0000 7fb383400640 1 -- 172.21.15.118:0/735674366 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840ab220 con 0x7fb3841505e0 2024-03-08T20:29:57.252 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.252+0000 7fb383400640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3841505e0 0x7fb384152e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e50 tx=0x7fb37c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5e97cd5b07d1b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.252+0000 7fb381600640 1 -- 172.21.15.118:0/735674366 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c02ca80 con 0x7fb3841505e0 2024-03-08T20:29:57.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.252+0000 7fb381600640 1 -- 172.21.15.118:0/735674366 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c02cc20 con 0x7fb3841505e0 2024-03-08T20:29:57.253 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.252+0000 7fb381600640 1 -- 172.21.15.118:0/735674366 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0343f0 con 0x7fb3841505e0 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 -- 172.21.15.118:0/735674366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3841505e0 msgr2=0x7fb384152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3841505e0 0x7fb384152e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e50 tx=0x7fb37c02bee0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 -- 172.21.15.118:0/735674366 shutdown_connections 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb3841505e0 0x7fb384152e10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 --2- 172.21.15.118:0/735674366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406af80 0x7fb38406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 -- 172.21.15.118:0/735674366 >> 172.21.15.118:0/735674366 conn(0x7fb3840a84c0 msgr2=0x7fb3840a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 -- 172.21.15.118:0/735674366 shutdown_connections 2024-03-08T20:29:57.254 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.253+0000 7fb389c00640 1 -- 172.21.15.118:0/735674366 wait complete. 2024-03-08T20:29:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.255+0000 7fb389c00640 1 Processor -- start 2024-03-08T20:29:57.255 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.255+0000 7fb389c00640 1 -- start start 2024-03-08T20:29:57.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406ebd0 0x7fb384145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.257 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3841505e0 0x7fb3840c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38406b4e0 con 0x7fb38406af80 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38406b360 con 0x7fb3841505e0 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb389c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb384153350 con 0x7fb38406ebd0 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57252/0 (socket says 172.21.15.118:57252) 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 -- 172.21.15.118:0/3905037671 learned_addr learned my addr 172.21.15.118:0/3905037671 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 -- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406ebd0 msgr2=0x7fb384145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb383400640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3841505e0 0x7fb3840c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406ebd0 0x7fb384145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 -- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3841505e0 msgr2=0x7fb3840c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.258 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3841505e0 0x7fb3840c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 -- 172.21.15.118:0/3905037671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384145540 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.256+0000 7fb382a00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d800 tx=0x7fb37400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.257+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400b6c0 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.257+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374019070 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.257+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3840bfd10 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.257+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400bac0 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.257+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb384146fc0 con 0x7fb38406af80 2024-03-08T20:29:57.259 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.258+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384074a40 con 0x7fb38406af80 2024-03-08T20:29:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.259+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb37400bc60 con 0x7fb38406af80 2024-03-08T20:29:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.260+0000 7fb37aa00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 0x7fb36406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.260+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb37408b2d0 con 0x7fb38406af80 2024-03-08T20:29:57.260 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.260+0000 7fb382000640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 0x7fb36406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.261 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.261+0000 7fb382000640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 0x7fb36406e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb370000f60 tx=0x7fb3700079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.264 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.264+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb374059a70 con 0x7fb38406af80 2024-03-08T20:29:57.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.448+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb38406e880 con 0x7fb38406af80 2024-03-08T20:29:57.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.450+0000 7fb37aa00640 1 -- 172.21.15.118:0/3905037671 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7fb374059370 con 0x7fb38406af80 2024-03-08T20:29:57.451 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:57.451 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 msgr2=0x7fb36406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 0x7fb36406e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb370000f60 tx=0x7fb3700079d0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 msgr2=0x7fb3841ee7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb37400d800 tx=0x7fb37400dcc0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 shutdown_connections 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb36406bbd0 0x7fb36406e090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3841505e0 0x7fb3840c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb38406ebd0 0x7fb384145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 --2- 172.21.15.118:0/3905037671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb38406af80 0x7fb3841ee7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.452+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 >> 172.21.15.118:0/3905037671 conn(0x7fb3840a84c0 msgr2=0x7fb3840c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:57.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.453+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 shutdown_connections 2024-03-08T20:29:57.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.453+0000 7fb389c00640 1 -- 172.21.15.118:0/3905037671 wait complete. 2024-03-08T20:29:57.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:29:57.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:29:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.672+0000 7f7d7d000640 1 Processor -- start 2024-03-08T20:29:57.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.672+0000 7f7d7d000640 1 -- start start 2024-03-08T20:29:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d78152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 0x7f7d781541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d780c5a20 0x7f7d7806e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d780c5590 con 0x7f7d780c5a20 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d78154710 con 0x7f7d780c4480 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d7d000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c4980 con 0x7f7d7806e4b0 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d76800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d780c5a20 0x7f7d7806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d76800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7d780c5a20 0x7f7d7806e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57264/0 (socket says 172.21.15.118:57264) 2024-03-08T20:29:57.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d76800640 1 -- 172.21.15.118:0/1631918416 learned_addr learned my addr 172.21.15.118:0/1631918416 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d75400640 1 --2- 172.21.15.118:0/1631918416 >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 0x7f7d781541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d75e00640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d78152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.674+0000 7f7d76800640 1 -- 172.21.15.118:0/1631918416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 msgr2=0x7f7d78152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d76800640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d78152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d76800640 1 -- 172.21.15.118:0/1631918416 >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 msgr2=0x7f7d781541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d76800640 1 --2- 172.21.15.118:0/1631918416 >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 0x7f7d781541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d76800640 1 -- 172.21.15.118:0/1631918416 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780c4c60 con 0x7f7d780c5a20 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d75400640 1 --2- 172.21.15.118:0/1631918416 >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 0x7f7d781541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.675+0000 7f7d75e00640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d78152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.676+0000 7f7d76800640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d7806e890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d780c7640 tx=0x7f7d6802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e930073ffb9b99d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.676+0000 7f7d74a00640 1 -- 172.21.15.118:0/1631918416 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6802c9f0 con 0x7f7d780c5a20 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.676+0000 7f7d74a00640 1 -- 172.21.15.118:0/1631918416 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6802cb90 con 0x7f7d780c5a20 2024-03-08T20:29:57.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.676+0000 7f7d74a00640 1 -- 172.21.15.118:0/1631918416 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680343f0 con 0x7f7d780c5a20 2024-03-08T20:29:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 -- 172.21.15.118:0/1631918416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 msgr2=0x7f7d7806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d7806e890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d780c7640 tx=0x7f7d6802be50 comp rx=0 tx=0).stop 2024-03-08T20:29:57.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 -- 172.21.15.118:0/1631918416 shutdown_connections 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d7806e890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 --2- 172.21.15.118:0/1631918416 >> v2:172.21.15.144:3300/0 conn(0x7f7d780c4480 0x7f7d781541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 --2- 172.21.15.118:0/1631918416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d78152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 -- 172.21.15.118:0/1631918416 >> 172.21.15.118:0/1631918416 conn(0x7f7d7806b720 msgr2=0x7f7d780c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 -- 172.21.15.118:0/1631918416 shutdown_connections 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.677+0000 7f7d7d000640 1 -- 172.21.15.118:0/1631918416 wait complete. 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.679+0000 7f7d7d000640 1 Processor -- start 2024-03-08T20:29:57.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.679+0000 7f7d7d000640 1 -- start start 2024-03-08T20:29:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d780c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d780c4480 0x7f7d781eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c5e70 con 0x7f7d780c5a20 2024-03-08T20:29:57.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780c5220 con 0x7f7d780c4480 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d7d000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d781505f0 con 0x7f7d7806e4b0 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d76800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d76800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57266/0 (socket says 172.21.15.118:57266) 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d76800640 1 -- 172.21.15.118:0/2016946193 learned_addr learned my addr 172.21.15.118:0/2016946193 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d75e00640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d780c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.680+0000 7f7d75400640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d780c4480 0x7f7d781eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 -- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 msgr2=0x7f7d780c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d780c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 -- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d780c4480 msgr2=0x7f7d781eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d780c4480 0x7f7d781eae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 -- 172.21.15.118:0/2016946193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d781eb900 con 0x7f7d780c5a20 2024-03-08T20:29:57.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d76800640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009f40 tx=0x7f7d68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68043020 con 0x7f7d780c5a20 2024-03-08T20:29:57.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6803e450 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68009510 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d781dc4e0 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.681+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d781ea9d0 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.682+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7804f0b0 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.683+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7d68046020 con 0x7f7d780c5a20 2024-03-08T20:29:57.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.684+0000 7f7d6e000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 0x7f7d5406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.684+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7d680ad750 con 0x7f7d780c5a20 2024-03-08T20:29:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.684+0000 7f7d75e00640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 0x7f7d5406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:57.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.685+0000 7f7d75e00640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 0x7f7d5406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d780c32d0 tx=0x7f7d70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:57.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.689+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7d7804f0b0 con 0x7f7d780c5a20 2024-03-08T20:29:57.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.881+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d78074a40 con 0x7f7d780c5a20 2024-03-08T20:29:57.882 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.882+0000 7f7d6e000640 1 -- 172.21.15.118:0/2016946193 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d6804d030 con 0x7f7d780c5a20 2024-03-08T20:29:57.883 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:29:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 msgr2=0x7f7d5406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 0x7f7d5406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d780c32d0 tx=0x7f7d70008040 comp rx=0 tx=0).stop 2024-03-08T20:29:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 msgr2=0x7f7d781eb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009f40 tx=0x7f7d68004a40 comp rx=0 tx=0).stop 2024-03-08T20:29:57.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 shutdown_connections 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7d5406bbd0 0x7f7d5406e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7d780c5a20 0x7f7d781eb3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d780c4480 0x7f7d781eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 --2- 172.21.15.118:0/2016946193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d7806e4b0 0x7f7d780c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 >> 172.21.15.118:0/2016946193 conn(0x7f7d7806b720 msgr2=0x7f7d78072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 shutdown_connections 2024-03-08T20:29:57.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:57.885+0000 7f7d7d000640 1 -- 172.21.15.118:0/2016946193 wait complete. 2024-03-08T20:29:57.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:29:58.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.112+0000 7fdf11400640 1 Processor -- start 2024-03-08T20:29:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.112+0000 7fdf11400640 1 -- start start 2024-03-08T20:29:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.113+0000 7fdf11400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf0c0c4480 0x7fdf0c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.113+0000 7fdf11400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c4980 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.113+0000 7fdf11400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c4c60 con 0x7fdf0c06e4b0 2024-03-08T20:29:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.113+0000 7fdf11400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c5590 con 0x7fdf0c0c4480 2024-03-08T20:29:58.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.114+0000 7fdf0b200640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fdf0c0c5a20 0x7fdf0c06e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58098/0 (socket says 172.21.15.118:58098) 2024-03-08T20:29:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.114+0000 7fdf0b200640 1 -- 172.21.15.118:0/2809461711 learned_addr learned my addr 172.21.15.118:0/2809461711 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.114+0000 7fdf09e00640 1 --2- 172.21.15.118:0/2809461711 >> v2:172.21.15.144:3300/0 conn(0x7fdf0c0c4480 0x7fdf0c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.114+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220962183 0 0) 0x7fdf0c0c4980 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.114+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef0003520 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020257107 0 0) 0x7fdef0003520 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 >> v2:172.21.15.144:3300/0 conn(0x7fdf0c0c4480 msgr2=0x7fdf0c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 --2- 172.21.15.118:0/2809461711 >> v2:172.21.15.144:3300/0 conn(0x7fdf0c0c4480 0x7fdf0c152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 >> v1:172.21.15.144:6789/0 conn(0x7fdf0c06e4b0 legacy=0x7fdf0c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0c4f40 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fdf040019f0 con 0x7fdf0c0c5a20 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 >> v1:172.21.15.118:6789/0 conn(0x7fdf0c0c5a20 legacy=0x7fdf0c06e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0003a00 0x7fdef0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef0004800 0x7fdef0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 0x7fdef000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c5590 con 0x7fdef0005230 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000c190 con 0x7fdef0004800 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000c390 con 0x7fdef0003a00 2024-03-08T20:29:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf09e00640 1 --2- 172.21.15.118:0/2809461711 >> v2:172.21.15.144:3300/0 conn(0x7fdf0c0c4480 0x7fdf0c152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.115+0000 7fdf0b200640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 0x7fdef000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0a800640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0003a00 0x7fdef0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf09e00640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef0004800 0x7fdef0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0b200640 1 -- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0003a00 msgr2=0x7fdef0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0b200640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0003a00 0x7fdef0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0b200640 1 -- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef0004800 msgr2=0x7fdef0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0b200640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef0004800 0x7fdef0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.116+0000 7fdf0b200640 1 -- 172.21.15.118:0/2809461711 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0003520 con 0x7fdef0005230 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.117+0000 7fdf0b200640 1 -- 172.21.15.118:0/2809461711 reap_dead start 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.117+0000 7fdf0b200640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 0x7fdef000b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400a770 tx=0x7fdef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c0a110fc1bf288 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.117+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400a390 con 0x7fdef0005230 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.117+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04034650 con 0x7fdef0005230 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.117+0000 7fdf09400640 1 -- 172.21.15.118:0/2809461711 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04034a40 con 0x7fdef0005230 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 -- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 msgr2=0x7fdef000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 0x7fdef000b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400a770 tx=0x7fdef0005830 comp rx=0 tx=0).stop 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 -- 172.21.15.118:0/2809461711 shutdown_connections 2024-03-08T20:29:58.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 --2- 172.21.15.118:0/2809461711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdef0005230 0x7fdef000b9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 -- 172.21.15.118:0/2809461711 >> 172.21.15.118:0/2809461711 conn(0x7fdf0c06b720 msgr2=0x7fdf0c0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 -- 172.21.15.118:0/2809461711 shutdown_connections 2024-03-08T20:29:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.118+0000 7fdf11400640 1 -- 172.21.15.118:0/2809461711 wait complete. 2024-03-08T20:29:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.120+0000 7fdf11400640 1 Processor -- start 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.120+0000 7fdf11400640 1 -- start start 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 0x7fdf0c1df990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 0x7fdf0c0bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c5e40 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1505f0 con 0x7fdf0c14cf90 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf11400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0bdf30 con 0x7fdef0005230 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57288/0 (socket says 172.21.15.118:57288) 2024-03-08T20:29:58.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 -- 172.21.15.118:0/526303518 learned_addr learned my addr 172.21.15.118:0/526303518 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf0a800640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 0x7fdf0c1df990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf0b200640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 0x7fdf0c0bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 -- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 msgr2=0x7fdf0c1df990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 0x7fdf0c1df990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 -- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 msgr2=0x7fdf0c0bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.121+0000 7fdf09e00640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 0x7fdf0c0bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf09e00640 1 -- 172.21.15.118:0/526303518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c14d410 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf0a800640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 0x7fdf0c1df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf0b200640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 0x7fdf0c0bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf09e00640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdef8011720 tx=0x7fdef8011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800f960 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800fb00 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1e9b00 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8015460 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.122+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1df080 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.124+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c074a40 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.124+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdef8015600 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.125+0000 7fdf02a00640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 0x7fdeec06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.125+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdef808b7b0 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.126+0000 7fdf0a800640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 0x7fdeec06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.126+0000 7fdf0a800640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 0x7fdeec06e0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdefc000c00 tx=0x7fdefc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.130+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fdef8019030 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.326+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf0c0c0f10 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.327+0000 7fdf02a00640 1 -- 172.21.15.118:0/526303518 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdef8059ff0 con 0x7fdf0c1dfed0 2024-03-08T20:29:58.327 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:58.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 msgr2=0x7fdeec06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 0x7fdeec06e0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdefc000c00 tx=0x7fdefc009040 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 msgr2=0x7fdf0c14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdef8011720 tx=0x7fdef8011be0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 shutdown_connections 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fdeec06bc00 0x7fdeec06e0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf0c14cf90 0x7fdf0c0bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf0c1dfed0 0x7fdf0c14ca50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 --2- 172.21.15.118:0/526303518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdef0005230 0x7fdf0c1df990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 >> 172.21.15.118:0/526303518 conn(0x7fdf0c06b720 msgr2=0x7fdf0c1540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 shutdown_connections 2024-03-08T20:29:58.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.330+0000 7fdf11400640 1 -- 172.21.15.118:0/526303518 wait complete. 2024-03-08T20:29:58.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:29:58.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.559+0000 7fb18c800640 1 Processor -- start 2024-03-08T20:29:58.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.559+0000 7fb18c800640 1 -- start start 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb184152570 0x7fb1840caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1840bde90 0x7fb1841554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb184158e30 con 0x7fb1840bde90 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb184159360 con 0x7fb184152570 2024-03-08T20:29:58.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18c800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184159080 con 0x7fb1840c8700 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18a800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1840bde90 0x7fb1841554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18a800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1840bde90 0x7fb1841554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57292/0 (socket says 172.21.15.118:57292) 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb18a800640 1 -- 172.21.15.118:0/445230376 learned_addr learned my addr 172.21.15.118:0/445230376 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb189e00640 1 --2- 172.21.15.118:0/445230376 >> v2:172.21.15.144:3300/0 conn(0x7fb184152570 0x7fb1840caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.561+0000 7fb189400640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.562+0000 7fb18a800640 1 -- 172.21.15.118:0/445230376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 msgr2=0x7fb184154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.562+0000 7fb18a800640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.562+0000 7fb18a800640 1 -- 172.21.15.118:0/445230376 >> v2:172.21.15.144:3300/0 conn(0x7fb184152570 msgr2=0x7fb1840caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.562+0000 7fb18a800640 1 --2- 172.21.15.118:0/445230376 >> v2:172.21.15.144:3300/0 conn(0x7fb184152570 0x7fb1840caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.563 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.562+0000 7fb18a800640 1 -- 172.21.15.118:0/445230376 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840c52b0 con 0x7fb1840bde90 2024-03-08T20:29:58.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.563+0000 7fb18a800640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb1841554c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb1840673b0 tx=0x7fb18002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bb752009230b7f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.563+0000 7fb188a00640 1 -- 172.21.15.118:0/445230376 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180038070 con 0x7fb1840bde90 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.563+0000 7fb188a00640 1 -- 172.21.15.118:0/445230376 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18002f050 con 0x7fb1840bde90 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.563+0000 7fb188a00640 1 -- 172.21.15.118:0/445230376 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180031970 con 0x7fb1840bde90 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 -- 172.21.15.118:0/445230376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 msgr2=0x7fb1841554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb1841554c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb1840673b0 tx=0x7fb18002b7f0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 -- 172.21.15.118:0/445230376 shutdown_connections 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb1841554c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 --2- 172.21.15.118:0/445230376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 --2- 172.21.15.118:0/445230376 >> v2:172.21.15.144:3300/0 conn(0x7fb184152570 0x7fb1840caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 -- 172.21.15.118:0/445230376 >> 172.21.15.118:0/445230376 conn(0x7fb184072620 msgr2=0x7fb184072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 -- 172.21.15.118:0/445230376 shutdown_connections 2024-03-08T20:29:58.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.564+0000 7fb18c800640 1 -- 172.21.15.118:0/445230376 wait complete. 2024-03-08T20:29:58.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.566+0000 7fb18c800640 1 Processor -- start 2024-03-08T20:29:58.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.566+0000 7fb18c800640 1 -- start start 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184152570 0x7fb18414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184155a00 con 0x7fb1840bde90 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18406dcd0 con 0x7fb184152570 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18c800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184155b80 con 0x7fb1840c8700 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb189e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb189e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57308/0 (socket says 172.21.15.118:57308) 2024-03-08T20:29:58.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb189e00640 1 -- 172.21.15.118:0/852201509 learned_addr learned my addr 172.21.15.118:0/852201509 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb189400640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.567+0000 7fb18a800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184152570 0x7fb18414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 -- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 msgr2=0x7fb184156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 -- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184152570 msgr2=0x7fb18414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184152570 0x7fb18414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 -- 172.21.15.118:0/852201509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1841579e0 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb189e00640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009d10 tx=0x7fb17c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c018020 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c014480 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c014830 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1840ab430 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.568+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb184148430 con 0x7fb1840bde90 2024-03-08T20:29:58.570 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.569+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18404f0f0 con 0x7fb1840bde90 2024-03-08T20:29:58.571 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.570+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb17c005d10 con 0x7fb1840bde90 2024-03-08T20:29:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.571+0000 7fb17a000640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 0x7fb16806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.571+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb17c08b970 con 0x7fb1840bde90 2024-03-08T20:29:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.572+0000 7fb189400640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 0x7fb16806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:58.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.572+0000 7fb189400640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 0x7fb16806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb184157f00 tx=0x7fb174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:58.576 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.575+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fb18404f0f0 con 0x7fb1840bde90 2024-03-08T20:29:58.773 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.773+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb184074a40 con 0x7fb1840bde90 2024-03-08T20:29:58.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.774+0000 7fb17a000640 1 -- 172.21.15.118:0/852201509 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb17c022070 con 0x7fb1840bde90 2024-03-08T20:29:58.774 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:29:58.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 msgr2=0x7fb16806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 0x7fb16806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb184157f00 tx=0x7fb174008040 comp rx=0 tx=0).stop 2024-03-08T20:29:58.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 msgr2=0x7fb184147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:58.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009d10 tx=0x7fb17c00c490 comp rx=0 tx=0).stop 2024-03-08T20:29:58.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 shutdown_connections 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fb16806bbd0 0x7fb16806e090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184152570 0x7fb18414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1840c8700 0x7fb184156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 --2- 172.21.15.118:0/852201509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1840bde90 0x7fb184147ef0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.776+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 >> 172.21.15.118:0/852201509 conn(0x7fb184072620 msgr2=0x7fb1841501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.777+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 shutdown_connections 2024-03-08T20:29:58.778 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:58.777+0000 7fb18c800640 1 -- 172.21.15.118:0/852201509 wait complete. 2024-03-08T20:29:58.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:29:59.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.002+0000 7f8107200640 1 Processor -- start 2024-03-08T20:29:59.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.002+0000 7f8107200640 1 -- start start 2024-03-08T20:29:59.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.003+0000 7f8107200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8100150240 0x7f810006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8107200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100156160 0x7f81001565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8107200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8100152b70 con 0x7f810006dcd0 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8107200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8100152e30 con 0x7f8100150240 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8107200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8100153110 con 0x7f8100156160 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8105e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8100150240 0x7f810006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8105e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8100150240 0x7f810006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57318/0 (socket says 172.21.15.118:57318) 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8105e00640 1 -- 172.21.15.118:0/1528013145 learned_addr learned my addr 172.21.15.118:0/1528013145 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:59.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8106800640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100156160 0x7f81001565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.004+0000 7f8105e00640 1 -- 172.21.15.118:0/1528013145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100156160 msgr2=0x7f81001565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.005+0000 7f8105e00640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100156160 0x7f81001565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.005+0000 7f8105e00640 1 -- 172.21.15.118:0/1528013145 >> v1:172.21.15.144:6789/0 conn(0x7f810006dcd0 legacy=0x7f81000c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.005+0000 7f8105e00640 1 -- 172.21.15.118:0/1528013145 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81001533f0 con 0x7f8100150240 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.006+0000 7f8105e00640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100150240 0x7f810006e610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009870 tx=0x7f80f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c91d0163fd9dff server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.006+0000 7f8104a00640 1 -- 172.21.15.118:0/1528013145 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4035020 con 0x7f8100150240 2024-03-08T20:29:59.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.006+0000 7f8104a00640 1 -- 172.21.15.118:0/1528013145 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4031640 con 0x7f8100150240 2024-03-08T20:29:59.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.006+0000 7f8104a00640 1 -- 172.21.15.118:0/1528013145 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f402d040 con 0x7f8100150240 2024-03-08T20:29:59.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 -- 172.21.15.118:0/1528013145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100150240 msgr2=0x7f810006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100150240 0x7f810006e610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009870 tx=0x7f80f402b8f0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 -- 172.21.15.118:0/1528013145 shutdown_connections 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100156160 0x7f81001565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 --2- 172.21.15.118:0/1528013145 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100150240 0x7f810006e610 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 -- 172.21.15.118:0/1528013145 >> 172.21.15.118:0/1528013145 conn(0x7f81000c6480 msgr2=0x7f81000c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 -- 172.21.15.118:0/1528013145 shutdown_connections 2024-03-08T20:29:59.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.007+0000 7f8107200640 1 -- 172.21.15.118:0/1528013145 wait complete. 2024-03-08T20:29:59.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.008+0000 7f8107200640 1 Processor -- start 2024-03-08T20:29:59.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.008+0000 7f8107200640 1 -- start start 2024-03-08T20:29:59.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 0x7f81000a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100150240 0x7f81001542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c2b50 con 0x7f8100156160 2024-03-08T20:29:59.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c29d0 con 0x7f810006dcd0 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.009+0000 7f8107200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810006eb50 con 0x7f8100150240 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57324/0 (socket says 172.21.15.118:57324) 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 -- 172.21.15.118:0/3080162612 learned_addr learned my addr 172.21.15.118:0/3080162612 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8105400640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100150240 0x7f81001542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8105e00640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 0x7f81000a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 -- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100150240 msgr2=0x7f81001542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100150240 0x7f81001542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 -- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 msgr2=0x7f81000a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 0x7f81000a8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 -- 172.21.15.118:0/3080162612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81001484f0 con 0x7f8100156160 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8105e00640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 0x7f81000a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.010+0000 7f8106800640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007d20 tx=0x7f80fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.011+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc014420 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.011+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc019070 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.011+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc014820 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.011+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81001487d0 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.011+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810014f730 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.012+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8100074a40 con 0x7f8100156160 2024-03-08T20:29:59.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.013+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f80fc0149c0 con 0x7f8100156160 2024-03-08T20:29:59.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.014+0000 7f80fa000640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 0x7f80e006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.014+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f80fc08b5c0 con 0x7f8100156160 2024-03-08T20:29:59.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.014+0000 7f8105e00640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 0x7f80e006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.015+0000 7f8105e00640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 0x7f80e006e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80f4036000 tx=0x7f80f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.018+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f80fc059d60 con 0x7f8100156160 2024-03-08T20:29:59.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.214+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f810006e0e0 con 0x7f8100156160 2024-03-08T20:29:59.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.215+0000 7f80fa000640 1 -- 172.21.15.118:0/3080162612 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f80fc059660 con 0x7f8100156160 2024-03-08T20:29:59.215 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:29:59.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.217+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 msgr2=0x7f80e006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 0x7f80e006e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80f4036000 tx=0x7f80f4008030 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 msgr2=0x7f8100154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007d20 tx=0x7f80fc00e4b0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 shutdown_connections 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f80e006bbd0 0x7f80e006e090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8100156160 0x7f8100154810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8100150240 0x7f81001542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 --2- 172.21.15.118:0/3080162612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f810006dcd0 0x7f81000a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 >> 172.21.15.118:0/3080162612 conn(0x7f81000c6480 msgr2=0x7f81001565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 shutdown_connections 2024-03-08T20:29:59.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.218+0000 7f8107200640 1 -- 172.21.15.118:0/3080162612 wait complete. 2024-03-08T20:29:59.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:29:59.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.444+0000 7f5a6e800640 1 Processor -- start 2024-03-08T20:29:59.445 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.444+0000 7f5a6e800640 1 -- start start 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.445+0000 7f5a6e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a68153520 0x7f5a68150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.445+0000 7f5a6e800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680aa980 con 0x7f5a6806af80 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.445+0000 7f5a6e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680aac60 con 0x7f5a6814fed0 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.445+0000 7f5a6e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a68150870 con 0x7f5a68153520 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a67400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5a6806af80 0x7f5a6806e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:58114/0 (socket says 172.21.15.118:58114) 2024-03-08T20:29:59.446 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a67400640 1 -- 172.21.15.118:0/1014944744 learned_addr learned my addr 172.21.15.118:0/1014944744 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:29:59.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a67e00640 1 --2- 172.21.15.118:0/1014944744 >> v2:172.21.15.144:3300/0 conn(0x7f5a68153520 0x7f5a68150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772051881 0 0) 0x7f5a680aa980 con 0x7f5a6806af80 2024-03-08T20:29:59.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a4c003520 con 0x7f5a6806af80 2024-03-08T20:29:59.448 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1569629784 0 0) 0x7f5a4c003520 con 0x7f5a6806af80 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 >> v2:172.21.15.144:3300/0 conn(0x7f5a68153520 msgr2=0x7f5a68150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 --2- 172.21.15.118:0/1014944744 >> v2:172.21.15.144:3300/0 conn(0x7f5a68153520 0x7f5a68150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 >> v1:172.21.15.144:6789/0 conn(0x7f5a6814fed0 legacy=0x7f5a68152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.446+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680aaf40 con 0x7f5a6806af80 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f5a58001670 con 0x7f5a6806af80 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 >> v1:172.21.15.118:6789/0 conn(0x7f5a6806af80 legacy=0x7f5a6806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a4c0039b0 0x7f5a4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68150870 con 0x7f5a4c0052e0 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c00c1b0 con 0x7f5a4c004800 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c00c3b0 con 0x7f5a4c0039b0 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.449 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a66a00640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67400640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a4c0039b0 0x7f5a4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 -- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a4c0039b0 msgr2=0x7f5a4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a4c0039b0 0x7f5a4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 -- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a4c004800 msgr2=0x7f5a4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.450 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.447+0000 7f5a67e00640 1 -- 172.21.15.118:0/1014944744 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c003520 con 0x7f5a4c0052e0 2024-03-08T20:29:59.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.448+0000 7f5a67e00640 1 -- 172.21.15.118:0/1014944744 reap_dead start 2024-03-08T20:29:59.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.448+0000 7f5a67e00640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a4c00b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a60007330 tx=0x7f5a4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baff59b838bc25d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60009be0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6002ccd0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.451 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a66000640 1 -- 172.21.15.118:0/1014944744 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60003bd0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 -- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 msgr2=0x7f5a4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a4c00b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5a60007330 tx=0x7f5a4c005830 comp rx=0 tx=0).stop 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 -- 172.21.15.118:0/1014944744 shutdown_connections 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 --2- 172.21.15.118:0/1014944744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a4c00b9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 -- 172.21.15.118:0/1014944744 >> 172.21.15.118:0/1014944744 conn(0x7f5a680a84c0 msgr2=0x7f5a680a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.449+0000 7f5a6e800640 1 -- 172.21.15.118:0/1014944744 shutdown_connections 2024-03-08T20:29:59.452 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.450+0000 7f5a6e800640 1 -- 172.21.15.118:0/1014944744 wait complete. 2024-03-08T20:29:59.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.451+0000 7f5a6e800640 1 Processor -- start 2024-03-08T20:29:59.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 -- start start 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a680c5fc0 0x7f5a680c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a680c4230 0x7f5a680c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680c3e10 con 0x7f5a4c0052e0 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681539b0 con 0x7f5a680c4230 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.452+0000 7f5a6e800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680c3f90 con 0x7f5a680c5fc0 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57328/0 (socket says 172.21.15.118:57328) 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 -- 172.21.15.118:0/4270522437 learned_addr learned my addr 172.21.15.118:0/4270522437 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a66a00640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a680c5fc0 0x7f5a680c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 -- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a680c5fc0 msgr2=0x7f5a680c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a680c5fc0 0x7f5a680c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.454 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 -- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a680c4230 msgr2=0x7f5a680c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67e00640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a680c4230 0x7f5a680c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a680c4230 0x7f5a680c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 -- 172.21.15.118:0/4270522437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68149d80 con 0x7f5a4c0052e0 2024-03-08T20:29:59.455 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.453+0000 7f5a67400640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800e810 tx=0x7f5a5800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.454+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800c8d0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.454+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58018070 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.454+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800ccb0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.454+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6814a260 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.454+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680c7240 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.455+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680c7440 con 0x7f5a4c0052e0 2024-03-08T20:29:59.456 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.456+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5a58013420 con 0x7f5a4c0052e0 2024-03-08T20:29:59.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.457+0000 7f5a5f400640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 0x7f5a4806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.457+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5a5808a9c0 con 0x7f5a4c0052e0 2024-03-08T20:29:59.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.457+0000 7f5a66a00640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 0x7f5a4806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.458+0000 7f5a66a00640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 0x7f5a4806e0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a54000c00 tx=0x7f5a54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.462 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.462+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5a58059160 con 0x7f5a4c0052e0 2024-03-08T20:29:59.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.695+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a68149f50 con 0x7f5a4c0052e0 2024-03-08T20:29:59.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.697+0000 7f5a5f400640 1 -- 172.21.15.118:0/4270522437 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f5a58058a60 con 0x7f5a4c0052e0 2024-03-08T20:29:59.697 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:29:59.697 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:29:59.698 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 msgr2=0x7f5a4806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 0x7f5a4806e0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a54000c00 tx=0x7f5a54009040 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 msgr2=0x7f5a68152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800e810 tx=0x7f5a5800ecd0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 shutdown_connections 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5a4806bc00 0x7f5a4806e0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a680c4230 0x7f5a680c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a680c5fc0 0x7f5a680c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 --2- 172.21.15.118:0/4270522437 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a4c0052e0 0x7f5a68152980 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 >> 172.21.15.118:0/4270522437 conn(0x7f5a680a84c0 msgr2=0x7f5a6814f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 shutdown_connections 2024-03-08T20:29:59.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.699+0000 7f5a6e800640 1 -- 172.21.15.118:0/4270522437 wait complete. 2024-03-08T20:29:59.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:29:59.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.923+0000 7f17c4e00640 1 Processor -- start 2024-03-08T20:29:59.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.923+0000 7f17c4e00640 1 -- start start 2024-03-08T20:29:59.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17c4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 0x7f17c00c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17c4e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17c01582c0 0x7f17c00c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17c4e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c013acb0 con 0x7f17c00c1ae0 2024-03-08T20:29:59.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17c4e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006c590 con 0x7f17c01582c0 2024-03-08T20:29:59.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17c4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006e4b0 con 0x7f17c013a4f0 2024-03-08T20:29:59.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17c01582c0 0x7f17c00c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17c01582c0 0x7f17c00c02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59760/0 (socket says 172.21.15.118:59760) 2024-03-08T20:29:59.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 -- 172.21.15.118:0/279175959 learned_addr learned my addr 172.21.15.118:0/279175959 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bf400640 1 --2- 172.21.15.118:0/279175959 >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 0x7f17c00c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 -- 172.21.15.118:0/279175959 >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 msgr2=0x7f17c00c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 --2- 172.21.15.118:0/279175959 >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 0x7f17c00c15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 -- 172.21.15.118:0/279175959 >> v1:172.21.15.144:6789/0 conn(0x7f17c00c1ae0 legacy=0x7f17c006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bea00640 1 -- 172.21.15.118:0/279175959 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c006e700 con 0x7f17c01582c0 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.925+0000 7f17bf400640 1 --2- 172.21.15.118:0/279175959 >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 0x7f17c00c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:29:59.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.927+0000 7f17bea00640 1 --2- 172.21.15.118:0/279175959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c01582c0 0x7f17c00c02a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f17c0066bb0 tx=0x7f17a802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb0a533999c1c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.927+0000 7f17be000640 1 -- 172.21.15.118:0/279175959 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8038070 con 0x7f17c01582c0 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.927+0000 7f17be000640 1 -- 172.21.15.118:0/279175959 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a802f050 con 0x7f17c01582c0 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.927+0000 7f17be000640 1 -- 172.21.15.118:0/279175959 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8031970 con 0x7f17c01582c0 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.927+0000 7f17c4e00640 1 -- 172.21.15.118:0/279175959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c01582c0 msgr2=0x7f17c00c02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 --2- 172.21.15.118:0/279175959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c01582c0 0x7f17c00c02a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f17c0066bb0 tx=0x7f17a802b7f0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 -- 172.21.15.118:0/279175959 shutdown_connections 2024-03-08T20:29:59.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 --2- 172.21.15.118:0/279175959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c01582c0 0x7f17c00c02a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 --2- 172.21.15.118:0/279175959 >> v2:172.21.15.144:3300/0 conn(0x7f17c013a4f0 0x7f17c00c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 -- 172.21.15.118:0/279175959 >> 172.21.15.118:0/279175959 conn(0x7f17c00c3880 msgr2=0x7f17c00c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:29:59.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 -- 172.21.15.118:0/279175959 shutdown_connections 2024-03-08T20:29:59.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.928+0000 7f17c4e00640 1 -- 172.21.15.118:0/279175959 wait complete. 2024-03-08T20:29:59.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.929+0000 7f17c4e00640 1 Processor -- start 2024-03-08T20:29:59.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 -- start start 2024-03-08T20:29:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c013a4f0 0x7f17c01ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c01582c0 0x7f17c01ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c013a8d0 con 0x7f17c00c1ae0 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c006e9e0 con 0x7f17c01582c0 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.930+0000 7f17c4e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c013aa50 con 0x7f17c013a4f0 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59768/0 (socket says 172.21.15.118:59768) 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 -- 172.21.15.118:0/1345255053 learned_addr learned my addr 172.21.15.118:0/1345255053 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 -- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c013a4f0 msgr2=0x7f17c01ebbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c013a4f0 0x7f17c01ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 -- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c01582c0 msgr2=0x7f17c01ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c01582c0 0x7f17c01ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 -- 172.21.15.118:0/1345255053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c01ee940 con 0x7f17c00c1ae0 2024-03-08T20:29:59.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.931+0000 7f17bf400640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f17b000cf60 tx=0x7f17b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.932+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b001a070 con 0x7f17c00c1ae0 2024-03-08T20:29:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.932+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b000d840 con 0x7f17c00c1ae0 2024-03-08T20:29:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.932+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b000dc10 con 0x7f17c00c1ae0 2024-03-08T20:29:59.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.932+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c01dec70 con 0x7f17c00c1ae0 2024-03-08T20:29:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.932+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c01ee5d0 con 0x7f17c00c1ae0 2024-03-08T20:29:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.933+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c0074a40 con 0x7f17c00c1ae0 2024-03-08T20:29:59.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.934+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f17b001d070 con 0x7f17c00c1ae0 2024-03-08T20:29:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.935+0000 7f17b7400640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 0x7f179c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:29:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.935+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f17b008b4f0 con 0x7f17c00c1ae0 2024-03-08T20:29:59.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.935+0000 7f17bea00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 0x7f179c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:29:59.936 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.936+0000 7f17bea00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 0x7f179c06e0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17a8035000 tx=0x7f17a8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:29:59.940 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:29:59.940+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f17b0059640 con 0x7f17c00c1ae0 2024-03-08T20:30:00.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.135+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17c006bd20 con 0x7f17c00c1ae0 2024-03-08T20:30:00.138 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.138+0000 7f17b7400640 1 -- 172.21.15.118:0/1345255053 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18562 (secure 0 0 0) 0x7f17b005d6e0 con 0x7f17c00c1ae0 2024-03-08T20:30:00.139 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:30:00.139 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":25,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:29:28.732648+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:30:00.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 msgr2=0x7f179c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 0x7f179c06e0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17a8035000 tx=0x7f17a8030000 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 msgr2=0x7f17c006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f17b000cf60 tx=0x7f17b000cf90 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 shutdown_connections 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f179c06bc00 0x7f179c06e0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c01582c0 0x7f17c01ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c013a4f0 0x7f17c01ebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 --2- 172.21.15.118:0/1345255053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17c00c1ae0 0x7f17c006ee00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 >> 172.21.15.118:0/1345255053 conn(0x7f17c00c3880 msgr2=0x7f17c013d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 shutdown_connections 2024-03-08T20:30:00.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.141+0000 7f17c4e00640 1 -- 172.21.15.118:0/1345255053 wait complete. 2024-03-08T20:30:00.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:30:00.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.376+0000 7ff816200640 1 Processor -- start 2024-03-08T20:30:00.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.376+0000 7ff816200640 1 -- start start 2024-03-08T20:30:00.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff81006e3d0 0x7ff810151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8100c1090 0x7ff8101549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff810151f40 con 0x7ff81006e3d0 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff810072c20 con 0x7ff8100c1090 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.377+0000 7ff816200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff810072f00 con 0x7ff810151620 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff81006e3d0 0x7ff810151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff81006e3d0 0x7ff810151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59774/0 (socket says 172.21.15.118:59774) 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 -- 172.21.15.118:0/3234542576 learned_addr learned my addr 172.21.15.118:0/3234542576 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff80fe00640 1 --2- 172.21.15.118:0/3234542576 >> v2:172.21.15.144:3300/0 conn(0x7ff8100c1090 0x7ff8101549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 -- 172.21.15.118:0/3234542576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 msgr2=0x7ff8100c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff80f400640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 -- 172.21.15.118:0/3234542576 >> v2:172.21.15.144:3300/0 conn(0x7ff8100c1090 msgr2=0x7ff8101549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 --2- 172.21.15.118:0/3234542576 >> v2:172.21.15.144:3300/0 conn(0x7ff8100c1090 0x7ff8101549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff806a00640 1 -- 172.21.15.118:0/3234542576 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810152180 con 0x7ff81006e3d0 2024-03-08T20:30:00.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.378+0000 7ff80f400640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.379+0000 7ff806a00640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff810151a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff81006bad0 tx=0x7ff7f802cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5876b4ead0e5ee45 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff80ea00640 1 -- 172.21.15.118:0/3234542576 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f803a070 con 0x7ff81006e3d0 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff80ea00640 1 -- 172.21.15.118:0/3234542576 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f802db90 con 0x7ff81006e3d0 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff80ea00640 1 -- 172.21.15.118:0/3234542576 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800b040 con 0x7ff81006e3d0 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 -- 172.21.15.118:0/3234542576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 msgr2=0x7ff810151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff810151a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff81006bad0 tx=0x7ff7f802cde0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 -- 172.21.15.118:0/3234542576 shutdown_connections 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 --2- 172.21.15.118:0/3234542576 >> v2:172.21.15.144:3300/0 conn(0x7ff8100c1090 0x7ff8101549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff810151a00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 --2- 172.21.15.118:0/3234542576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 -- 172.21.15.118:0/3234542576 >> 172.21.15.118:0/3234542576 conn(0x7ff8100a84c0 msgr2=0x7ff8100a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 -- 172.21.15.118:0/3234542576 shutdown_connections 2024-03-08T20:30:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.380+0000 7ff816200640 1 -- 172.21.15.118:0/3234542576 wait complete. 2024-03-08T20:30:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.382+0000 7ff816200640 1 Processor -- start 2024-03-08T20:30:00.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.382+0000 7ff816200640 1 -- start start 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8100c1090 0x7ff8100bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810154f10 con 0x7ff81006e3d0 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100c1500 con 0x7ff8100c1090 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff816200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff810155090 con 0x7ff810151620 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff80f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff80f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59776/0 (socket says 172.21.15.118:59776) 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff80f400640 1 -- 172.21.15.118:0/4204671872 learned_addr learned my addr 172.21.15.118:0/4204671872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.383+0000 7ff806a00640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8100c1090 0x7ff8100bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80fe00640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 -- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 msgr2=0x7ff8100c01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 -- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8100c1090 msgr2=0x7ff8100bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8100c1090 0x7ff8100bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 -- 172.21.15.118:0/4204671872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100c0720 con 0x7ff81006e3d0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff80f400640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff80000c820 tx=0x7ff80000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800015070 con 0x7ff81006e3d0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800007a30 con 0x7ff81006e3d0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800007e00 con 0x7ff81006e3d0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8100c4280 con 0x7ff81006e3d0 2024-03-08T20:30:00.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.384+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8100c4820 con 0x7ff81006e3d0 2024-03-08T20:30:00.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.386+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810074a40 con 0x7ff81006e3d0 2024-03-08T20:30:00.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.386+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff800018070 con 0x7ff81006e3d0 2024-03-08T20:30:00.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.387+0000 7ff807e00640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 0x7ff7ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:00.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.387+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff80008ac70 con 0x7ff81006e3d0 2024-03-08T20:30:00.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.388+0000 7ff806a00640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 0x7ff7ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:00.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.388+0000 7ff806a00640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 0x7ff7ec06e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8037000 tx=0x7ff7f8031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:00.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.392+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ff8000594b0 con 0x7ff81006e3d0 2024-03-08T20:30:00.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.630+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8100c09a0 con 0x7ff81006e3d0 2024-03-08T20:30:00.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.631+0000 7ff807e00640 1 -- 172.21.15.118:0/4204671872 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7ff80005de20 con 0x7ff81006e3d0 2024-03-08T20:30:00.632 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:30:00.632 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:30:00.632 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:30:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 msgr2=0x7ff7ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 0x7ff7ec06e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8037000 tx=0x7ff7f8031000 comp rx=0 tx=0).stop 2024-03-08T20:30:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 msgr2=0x7ff81014d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:00.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff80000c820 tx=0x7ff80000cc20 comp rx=0 tx=0).stop 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 shutdown_connections 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff7ec06bbd0 0x7ff7ec06e090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff810151620 0x7ff8100c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8100c1090 0x7ff8100bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 --2- 172.21.15.118:0/4204671872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff81006e3d0 0x7ff81014d800 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 >> 172.21.15.118:0/4204671872 conn(0x7ff8100a84c0 msgr2=0x7ff8100a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 shutdown_connections 2024-03-08T20:30:00.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:00.634+0000 7ff816200640 1 -- 172.21.15.118:0/4204671872 wait complete. 2024-03-08T20:30:01.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T20:29:23.681785+0000', 'modified': '2024-03-08T20:29:45.888293+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6834/3218952395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 3218952395}, {'type': 'v1', 'addr': '172.21.15.144:6834', 'nonce': 3218952395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-08T20:30:01.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T20:30:01.057 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-08T20:30:01.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.274+0000 7f3209c00640 1 Processor -- start 2024-03-08T20:30:01.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.274+0000 7f3209c00640 1 -- start start 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.275+0000 7f3209c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32040c2750 0x7f32040c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3209c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f320406e6a0 0x7f320406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3209c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3204155d20 con 0x7f32040c3970 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3209c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040c34e0 con 0x7f320406e6a0 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3209c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3204156000 con 0x7f32040c2750 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f320406e6a0 0x7f320406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f320406e6a0 0x7f320406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59784/0 (socket says 172.21.15.118:59784) 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 -- 172.21.15.118:0/2015389761 learned_addr learned my addr 172.21.15.118:0/2015389761 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3202a00640 1 --2- 172.21.15.118:0/2015389761 >> v2:172.21.15.144:3300/0 conn(0x7f32040c2750 0x7f32040c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 -- 172.21.15.118:0/2015389761 >> v2:172.21.15.144:3300/0 conn(0x7f32040c2750 msgr2=0x7f32040c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 --2- 172.21.15.118:0/2015389761 >> v2:172.21.15.144:3300/0 conn(0x7f32040c2750 0x7f32040c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.276+0000 7f3203400640 1 -- 172.21.15.118:0/2015389761 >> v1:172.21.15.144:6789/0 conn(0x7f32040c3970 legacy=0x7f3204072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.277+0000 7f3203400640 1 -- 172.21.15.118:0/2015389761 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040c3170 con 0x7f320406e6a0 2024-03-08T20:30:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.278+0000 7f3203400640 1 --2- 172.21.15.118:0/2015389761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320406e6a0 0x7f320406eb30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f320406f450 tx=0x7f31fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7605b7c90df0c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.278+0000 7f3201600640 1 -- 172.21.15.118:0/2015389761 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc035020 con 0x7f320406e6a0 2024-03-08T20:30:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.278+0000 7f3201600640 1 -- 172.21.15.118:0/2015389761 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc031870 con 0x7f320406e6a0 2024-03-08T20:30:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.278+0000 7f3201600640 1 -- 172.21.15.118:0/2015389761 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc031c40 con 0x7f320406e6a0 2024-03-08T20:30:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 -- 172.21.15.118:0/2015389761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320406e6a0 msgr2=0x7f320406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 --2- 172.21.15.118:0/2015389761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320406e6a0 0x7f320406eb30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f320406f450 tx=0x7f31fc02b910 comp rx=0 tx=0).stop 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 -- 172.21.15.118:0/2015389761 shutdown_connections 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 --2- 172.21.15.118:0/2015389761 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f320406e6a0 0x7f320406eb30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 --2- 172.21.15.118:0/2015389761 >> v2:172.21.15.144:3300/0 conn(0x7f32040c2750 0x7f32040c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 -- 172.21.15.118:0/2015389761 >> 172.21.15.118:0/2015389761 conn(0x7f32040c6760 msgr2=0x7f32040c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 -- 172.21.15.118:0/2015389761 shutdown_connections 2024-03-08T20:30:01.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.279+0000 7f3209c00640 1 -- 172.21.15.118:0/2015389761 wait complete. 2024-03-08T20:30:01.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.281+0000 7f3209c00640 1 Processor -- start 2024-03-08T20:30:01.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.281+0000 7f3209c00640 1 -- start start 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f320406e6a0 0x7f32040ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 0x7f32040ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204151f90 con 0x7f32040c3970 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204151e10 con 0x7f320406e6a0 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3209c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3204155250 con 0x7f32040c2750 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59800/0 (socket says 172.21.15.118:59800) 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3203400640 1 -- 172.21.15.118:0/424697900 learned_addr learned my addr 172.21.15.118:0/424697900 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3202a00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f320406e6a0 0x7f32040ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.282+0000 7f3202000640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 0x7f32040ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 -- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 msgr2=0x7f32040ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 0x7f32040ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 -- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f320406e6a0 msgr2=0x7f32040ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f320406e6a0 0x7f32040ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 -- 172.21.15.118:0/424697900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320414d190 con 0x7f32040c3970 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3202000640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 0x7f32040ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3203400640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009960 tx=0x7f31fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f31faa00640 1 -- 172.21.15.118:0/424697900 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc040070 con 0x7f32040c3970 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f31faa00640 1 -- 172.21.15.118:0/424697900 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc030d00 con 0x7f32040c3970 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32041db3d0 con 0x7f32040c3970 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f31faa00640 1 -- 172.21.15.118:0/424697900 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc035040 con 0x7f32040c3970 2024-03-08T20:30:01.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.283+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040ac880 con 0x7f32040c3970 2024-03-08T20:30:01.286 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.286+0000 7f31faa00640 1 -- 172.21.15.118:0/424697900 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f31fc038020 con 0x7f32040c3970 2024-03-08T20:30:01.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.286+0000 7f31faa00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 0x7f31e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.287+0000 7f31faa00640 1 -- 172.21.15.118:0/424697900 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f31fc0acbf0 con 0x7f32040c3970 2024-03-08T20:30:01.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.287+0000 7f3202a00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 0x7f31e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.287+0000 7f320c99a740 1 Processor -- start 2024-03-08T20:30:01.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.287+0000 7f320c99a740 1 -- start start 2024-03-08T20:30:01.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.287+0000 7f3202a00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 0x7f31e406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b261aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.289 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 0x5574b261a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b25436f0 con 0x5574b261cec0 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b24ec9e0 con 0x5574b25e00f0 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574b253f790 con 0x5574b2619d50 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59808/0 (socket says 172.21.15.118:59808) 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.288+0000 7f3203400640 1 -- 172.21.15.118:0/3119202888 learned_addr learned my addr 172.21.15.118:0/3119202888 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3202000640 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 0x5574b261a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 -- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 msgr2=0x5574b261aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b261aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 -- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 msgr2=0x5574b261a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 0x5574b261a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.290 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 -- 172.21.15.118:0/3119202888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574b24e0720 con 0x5574b261cec0 2024-03-08T20:30:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3202000640 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 0x5574b261a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:30:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f3203400640 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31fc07ac20 tx=0x7f31fc031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170419cdc064fdd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f31ef400640 1 -- 172.21.15.118:0/3119202888 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc07b390 con 0x5574b261cec0 2024-03-08T20:30:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f31ef400640 1 -- 172.21.15.118:0/3119202888 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc07ac90 con 0x5574b261cec0 2024-03-08T20:30:01.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.289+0000 7f31ef400640 1 -- 172.21.15.118:0/3119202888 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc07ede0 con 0x5574b261cec0 2024-03-08T20:30:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 -- 172.21.15.118:0/3119202888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 msgr2=0x5574b25dee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31fc07ac20 tx=0x7f31fc031870 comp rx=0 tx=0).stop 2024-03-08T20:30:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 -- 172.21.15.118:0/3119202888 shutdown_connections 2024-03-08T20:30:01.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b25dee70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b25e00f0 0x5574b261a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 --2- 172.21.15.118:0/3119202888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b261aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 -- 172.21.15.118:0/3119202888 >> 172.21.15.118:0/3119202888 conn(0x5574b25db730 msgr2=0x5574b2600140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 -- 172.21.15.118:0/3119202888 shutdown_connections 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.290+0000 7f320c99a740 1 -- 172.21.15.118:0/3119202888 wait complete. 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.291+0000 7f320c99a740 1 -- start start 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.291+0000 7f320c99a740 1 Processor -- start 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b2620d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b25fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b25436f0 con 0x5574b261cec0 2024-03-08T20:30:01.295 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b24ffe20 con 0x5574b262e930 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574b261ca30 con 0x5574b2619d50 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f320c99a740 10 client.0 _ll_register_callbacks cb 0x5574b253a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f3202000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f3202000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59822/0 (socket says 172.21.15.118:59822) 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f3202000640 1 -- 172.21.15.118:0/2082024423 learned_addr learned my addr 172.21.15.118:0/2082024423 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f3203400640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b25fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.292+0000 7f3202a00640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b2620d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 -- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 msgr2=0x5574b2620d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b2620d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 -- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 msgr2=0x5574b25fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b25fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 -- 172.21.15.118:0/2082024423 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574b22582d0 con 0x5574b261cec0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f3202000640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d9e0 tx=0x7f31f000dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4454d9c02bf57e30 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.296 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f31e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000bd10 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f31f0017420 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31fc07ac90 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31f0021050 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f320c99a740 10 client.4836 fetch_fsmap learned FSMap version 9 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.293+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5574b23226b0 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc07ac90 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f31f0024020 con 0x5574b261cec0 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 10 client.4836 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 20 client.4836 populate_metadata read hostname 'smithi118' 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2620210 0x5574b2639a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 4 client.4836 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T20:30:01.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 --> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574b2550c30 con 0x5574b2620210 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.294+0000 7f3202a00640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2620210 0x5574b2639a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.295+0000 7f3202a00640 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2620210 0x5574b2639a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f3a5cae8489906 server_cookie=9473aabb99cfb084 in_seq=0 out_seq=0 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.295+0000 7f31e3e00640 10 client.4836 ms_handle_connect on v2:172.21.15.144:6832/3218952395 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f31e3e00640 1 -- 172.21.15.118:0/2082024423 <== mds.0 v2:172.21.15.144:6832/3218952395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5574b2550c30 con 0x5574b2620210 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f31e3e00640 10 client.4836 handle_command_reply: tid=0 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 client.4836 shutdown 2024-03-08T20:30:01.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 msgr2=0x5574b262e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d9e0 tx=0x7f31f000dea0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 shutdown_connections 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2620210 0x5574b2639a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b25fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b262e3f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 --2- 172.21.15.118:0/2082024423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b2620d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 >> 172.21.15.118:0/2082024423 conn(0x5574b25e00f0 msgr2=0x5574b261b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f31e3e00640 0 client.4836 ms_handle_reset on v2:172.21.15.144:6832/3218952395 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 shutdown_connections 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.297+0000 7f320c99a740 1 -- 172.21.15.118:0/2082024423 wait complete. 2024-03-08T20:30:01.300 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.298+0000 7f320c99a740 20 client.4836 trim_cache size 0 max 16384 2024-03-08T20:30:01.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.314+0000 7f320c99a740 1 Processor -- start 2024-03-08T20:30:01.315 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 -- start start 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b25dab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b263da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041f5a70 con 0x5574b261cec0 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041ec700 con 0x5574b262e930 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.315+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32041f5470 con 0x5574b2619d50 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59824/0 (socket says 172.21.15.118:59824) 2024-03-08T20:30:01.317 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 -- 172.21.15.118:0/816835431 learned_addr learned my addr 172.21.15.118:0/816835431 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 -- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 msgr2=0x5574b25dab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202a00640 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b25dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3203400640 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b263da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b25dab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 -- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 msgr2=0x5574b263da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b263da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 -- 172.21.15.118:0/816835431 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574b261c9c0 con 0x5574b261cec0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.316+0000 7f3202000640 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e010 tx=0x7f31f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12f8cf10ce29f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f31eea00640 1 -- 172.21.15.118:0/816835431 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0003970 con 0x5574b261cec0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f31eea00640 1 -- 172.21.15.118:0/816835431 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0003b30 con 0x5574b261cec0 2024-03-08T20:30:01.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f31eea00640 1 -- 172.21.15.118:0/816835431 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0004020 con 0x5574b261cec0 2024-03-08T20:30:01.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 -- 172.21.15.118:0/816835431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 msgr2=0x5574b261b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e010 tx=0x7f31f0012000 comp rx=0 tx=0).stop 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 -- 172.21.15.118:0/816835431 shutdown_connections 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b262e930 0x5574b263da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b261cec0 0x5574b261b450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 --2- 172.21.15.118:0/816835431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b2619d50 0x5574b25dab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 -- 172.21.15.118:0/816835431 >> 172.21.15.118:0/816835431 conn(0x5574b25e00f0 msgr2=0x5574b25fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 -- 172.21.15.118:0/816835431 shutdown_connections 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.317+0000 7f320c99a740 1 -- 172.21.15.118:0/816835431 wait complete. 2024-03-08T20:30:01.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.318+0000 7f320c99a740 1 -- start start 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.318+0000 7f320c99a740 1 Processor -- start 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b2619d50 0x5574b261b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b261cec0 0x5574b262b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b25fd830 con 0x5574b262e930 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574b25ff3c0 con 0x5574b2619d50 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574b2612170 con 0x5574b261cec0 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f320c99a740 10 client.0 _ll_register_callbacks cb 0x7f31fc006bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f3203400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59828/0 (socket says 172.21.15.118:59828) 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.319+0000 7f3203400640 1 -- 172.21.15.118:0/3242406509 learned_addr learned my addr 172.21.15.118:0/3242406509 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3202000640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b261cec0 0x5574b262b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.323 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3202a00640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b2619d50 0x5574b261b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 -- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b261cec0 msgr2=0x5574b262b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b261cec0 0x5574b262b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 -- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b2619d50 msgr2=0x5574b261b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b2619d50 0x5574b261b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 -- 172.21.15.118:0/3242406509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574b26125c0 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f3203400640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0770a0 tx=0x7f31fc045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01a9dc6c671d67a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f31e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.118:3300/0 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc07a2e0 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mon.0 v2:172.21.15.118:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f31fc0769e0 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31f0003b30 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31fc0810b0 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f320c99a740 10 client.4842 fetch_fsmap learned FSMap version 9 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.320+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5574b26125c0 con 0x5574b262e930 2024-03-08T20:30:01.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mon.0 v2:172.21.15.118:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0003b30 con 0x5574b262e930 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mon.0 v2:172.21.15.118:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f31fc079b50 con 0x5574b262e930 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 10 client.4842 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 20 client.4842 populate_metadata read hostname 'smithi118' 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2687bc0 0x5574b2627ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 4 client.4842 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 --> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574b254af80 con 0x5574b2687bc0 2024-03-08T20:30:01.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.321+0000 7f3202a00640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2687bc0 0x5574b2627ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.322+0000 7f3202a00640 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2687bc0 0x5574b2627ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d38e807e12f507ea server_cookie=b7159cf4fb93039 in_seq=0 out_seq=0 2024-03-08T20:30:01.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.322+0000 7f31e3e00640 10 client.4842 ms_handle_connect on v2:172.21.15.144:6832/3218952395 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f31e3e00640 1 -- 172.21.15.118:0/3242406509 <== mds.0 v2:172.21.15.144:6832/3218952395 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5574b254af80 con 0x5574b2687bc0 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f31e3e00640 10 client.4842 handle_command_reply: tid=0 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 client.4842 shutdown 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 msgr2=0x5574b2687680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0770a0 tx=0x7f31fc045000 comp rx=0 tx=0).stop 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 shutdown_connections 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:6832/3218952395,v1:172.21.15.144:6834/3218952395] conn(0x5574b2687bc0 0x5574b2627ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5574b262e930 0x5574b2687680 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5574b261cec0 0x5574b262b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 --2- 172.21.15.118:0/3242406509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574b2619d50 0x5574b261b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f31e3e00640 0 client.4842 ms_handle_reset on v2:172.21.15.144:6832/3218952395 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 >> 172.21.15.118:0/3242406509 conn(0x5574b25e00f0 msgr2=0x5574b25df050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 shutdown_connections 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.323+0000 7f320c99a740 1 -- 172.21.15.118:0/3242406509 wait complete. 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f320c99a740 20 client.4842 trim_cache size 0 max 16384 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "cluster_fsid": "ac17b673-6e59-4db3-9519-ba644ea1ee5b", 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "whoami": 0, 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4278, 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "want_state": "up:active", 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "state": "up:active", 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs", 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "rank_uptime": 37.109288131, 2024-03-08T20:30:01.328 INFO:teuthology.orchestra.run.smithi118.stdout: "mdsmap_epoch": 9, 2024-03-08T20:30:01.329 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch": 25, 2024-03-08T20:30:01.329 INFO:teuthology.orchestra.run.smithi118.stdout: "osdmap_epoch_barrier": 25, 2024-03-08T20:30:01.329 INFO:teuthology.orchestra.run.smithi118.stdout: "uptime": 44.734413513 2024-03-08T20:30:01.329 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 msgr2=0x7f31e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 0x7f31e406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31f4006fd0 tx=0x7f31f4008040 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 msgr2=0x7f320413e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009960 tx=0x7f31fc0046c0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 shutdown_connections 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f31e406bbd0 0x7f31e406e090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32040c3970 0x7f320413e6b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32040c2750 0x7f32040ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 --2- 172.21.15.118:0/424697900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f320406e6a0 0x7f32040ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 >> 172.21.15.118:0/424697900 conn(0x7f32040c6760 msgr2=0x7f32040a8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 shutdown_connections 2024-03-08T20:30:01.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.324+0000 7f3209c00640 1 -- 172.21.15.118:0/424697900 wait complete. 2024-03-08T20:30:01.342 INFO:teuthology.run_tasks:Running task parallel... 2024-03-08T20:30:01.352 INFO:teuthology.task.parallel:starting parallel... 2024-03-08T20:30:01.353 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-08T20:30:01.353 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2024-03-08T20:30:01.355 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-08T20:30:01.355 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-08T20:30:01.355 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-08T20:30:01.355 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T20:30:01.355 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:01.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:01.356 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-08T20:30:01.356 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-08T20:30:01.356 INFO:teuthology.task.sequential:In sequential, running task kclient... 2024-03-08T20:30:01.360 INFO:tasks.kclient:Mounting kernel clients... 2024-03-08T20:30:01.360 INFO:tasks.kclient:config is {'client.1': {}} 2024-03-08T20:30:01.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:01.360 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-03-08T20:30:01.410 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-08T20:30:01.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:01.411 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-08T20:30:01.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:01.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-03-08T20:30:01.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:01.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-03-08T20:30:01.518 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-03-08T20:30:01.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:30:01.522 INFO:tasks.kclient:client.1 config is {} 2024-03-08T20:30:01.523 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T20:30:01.523 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:01.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T20:30:01.625 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-08T20:30:01.626 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T20:30:01.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.752+0000 7f524da00640 1 Processor -- start 2024-03-08T20:30:01.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.752+0000 7f524da00640 1 -- start start 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f524da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f524814fed0 0x7f5248150330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f524da00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5248152e10 0x7f52481532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f524da00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52480aa980 con 0x7f524806af80 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f524da00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5248150870 con 0x7f5248152e10 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f524da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480aac60 con 0x7f524814fed0 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f5247400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5248152e10 0x7f52481532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f5246a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f524806af80 0x7f524806e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34300/0 (socket says 172.21.15.118:34300) 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f5246a00640 1 -- 172.21.15.118:0/1889242141 learned_addr learned my addr 172.21.15.118:0/1889242141 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:30:01.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.754+0000 7f5246000640 1 --2- 172.21.15.118:0/1889242141 >> v2:172.21.15.144:3300/0 conn(0x7f524814fed0 0x7f5248150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.755+0000 7f5247400640 1 -- 172.21.15.118:0/1889242141 >> v2:172.21.15.144:3300/0 conn(0x7f524814fed0 msgr2=0x7f5248150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:30:01.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.755+0000 7f5247400640 1 --2- 172.21.15.118:0/1889242141 >> v2:172.21.15.144:3300/0 conn(0x7f524814fed0 0x7f5248150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.755+0000 7f5247400640 1 -- 172.21.15.118:0/1889242141 >> v1:172.21.15.118:6789/0 conn(0x7f524806af80 legacy=0x7f524806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.755+0000 7f5247400640 1 -- 172.21.15.118:0/1889242141 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480aaf40 con 0x7f5248152e10 2024-03-08T20:30:01.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.756+0000 7f5247400640 1 --2- 172.21.15.118:0/1889242141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f52481532a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52480c7730 tx=0x7f524002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fff1fe00d10e3ef server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.756+0000 7f5245600640 1 -- 172.21.15.118:0/1889242141 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240039070 con 0x7f5248152e10 2024-03-08T20:30:01.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.756+0000 7f5245600640 1 -- 172.21.15.118:0/1889242141 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524002cbf0 con 0x7f5248152e10 2024-03-08T20:30:01.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.756+0000 7f5245600640 1 -- 172.21.15.118:0/1889242141 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240034440 con 0x7f5248152e10 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 -- 172.21.15.118:0/1889242141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 msgr2=0x7f52481532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 --2- 172.21.15.118:0/1889242141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f52481532a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52480c7730 tx=0x7f524002be40 comp rx=0 tx=0).stop 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 -- 172.21.15.118:0/1889242141 shutdown_connections 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 --2- 172.21.15.118:0/1889242141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f52481532a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 --2- 172.21.15.118:0/1889242141 >> v2:172.21.15.144:3300/0 conn(0x7f524814fed0 0x7f5248150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 -- 172.21.15.118:0/1889242141 >> 172.21.15.118:0/1889242141 conn(0x7f52480a84c0 msgr2=0x7f52480a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 -- 172.21.15.118:0/1889242141 shutdown_connections 2024-03-08T20:30:01.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.757+0000 7f524da00640 1 -- 172.21.15.118:0/1889242141 wait complete. 2024-03-08T20:30:01.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.759+0000 7f524da00640 1 Processor -- start 2024-03-08T20:30:01.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.759+0000 7f524da00640 1 -- start start 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524806af80 0x7f524814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 0x7f524814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480c3f90 con 0x7f5248152e10 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480c3e10 con 0x7f524806af80 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f524da00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524806eda0 con 0x7f524814fed0 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59860/0 (socket says 172.21.15.118:59860) 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 -- 172.21.15.118:0/163777602 learned_addr learned my addr 172.21.15.118:0/163777602 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5246a00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524806af80 0x7f524814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5246000640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 0x7f524814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.761 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 -- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 msgr2=0x7f524814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 0x7f524814a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 -- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524806af80 msgr2=0x7f524814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524806af80 0x7f524814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5247400640 1 -- 172.21.15.118:0/163777602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524814ae60 con 0x7f5248152e10 2024-03-08T20:30:01.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.760+0000 7f5246000640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 0x7f524814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f5247400640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f524002c450 tx=0x7f5240004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240044020 con 0x7f5248152e10 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524003f470 con 0x7f5248152e10 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52481452e0 con 0x7f5248152e10 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240039040 con 0x7f5248152e10 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.761+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5248145000 con 0x7f5248152e10 2024-03-08T20:30:01.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.762+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524814b920 con 0x7f5248152e10 2024-03-08T20:30:01.764 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.764+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5240047020 con 0x7f5248152e10 2024-03-08T20:30:01.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.765+0000 7f523ea00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 0x7f522806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.765 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.765+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f52400ad490 con 0x7f5248152e10 2024-03-08T20:30:01.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.765+0000 7f5246a00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 0x7f522806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.766 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.766+0000 7f5246a00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 0x7f522806e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5248151550 tx=0x7f5238007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.770 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.770+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f524004e070 con 0x7f5248152e10 2024-03-08T20:30:01.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.806+0000 7f9f1fc00640 1 Processor -- start 2024-03-08T20:30:01.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.806+0000 7f9f1fc00640 1 -- start start 2024-03-08T20:30:01.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1fc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f180c8730 0x7f9f180c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.807 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1fc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f18155e20 con 0x7f9f180bde30 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1fc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f180c72c0 con 0x7f9f180c5120 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1fc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f180c75a0 con 0x7f9f180c8730 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f17e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f180c8730 0x7f9f180c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1dc00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f9f180bde30 0x7f9f1806cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34310/0 (socket says 172.21.15.118:34310) 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.807+0000 7f9f1dc00640 1 -- 172.21.15.118:0/2637669228 learned_addr learned my addr 172.21.15.118:0/2637669228 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.808+0000 7f9f17e00640 1 -- 172.21.15.118:0/2637669228 >> v1:172.21.15.144:6789/0 conn(0x7f9f180c5120 legacy=0x7f9f1806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.808+0000 7f9f17e00640 1 -- 172.21.15.118:0/2637669228 >> v1:172.21.15.118:6789/0 conn(0x7f9f180bde30 legacy=0x7f9f1806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.808+0000 7f9f17e00640 1 -- 172.21.15.118:0/2637669228 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180c7880 con 0x7f9f180c8730 2024-03-08T20:30:01.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.809+0000 7f9f17e00640 1 --2- 172.21.15.118:0/2637669228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c8730 0x7f9f180c5500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f040097a0 tx=0x7f9f0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c715c97fb53272 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.809+0000 7f9f17400640 1 -- 172.21.15.118:0/2637669228 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04035020 con 0x7f9f180c8730 2024-03-08T20:30:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.809+0000 7f9f17400640 1 -- 172.21.15.118:0/2637669228 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04031830 con 0x7f9f180c8730 2024-03-08T20:30:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.809+0000 7f9f17400640 1 -- 172.21.15.118:0/2637669228 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04031c00 con 0x7f9f180c8730 2024-03-08T20:30:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 -- 172.21.15.118:0/2637669228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c8730 msgr2=0x7f9f180c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/2637669228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c8730 0x7f9f180c5500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f040097a0 tx=0x7f9f0402b8d0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 -- 172.21.15.118:0/2637669228 shutdown_connections 2024-03-08T20:30:01.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/2637669228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c8730 0x7f9f180c5500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 -- 172.21.15.118:0/2637669228 >> 172.21.15.118:0/2637669228 conn(0x7f9f18072cc0 msgr2=0x7f9f180ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:01.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 -- 172.21.15.118:0/2637669228 shutdown_connections 2024-03-08T20:30:01.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.810+0000 7f9f1fc00640 1 -- 172.21.15.118:0/2637669228 wait complete. 2024-03-08T20:30:01.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.811+0000 7f9f1fc00640 1 Processor -- start 2024-03-08T20:30:01.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 -- start start 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 0x7f9f180afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f180c8730 0x7f9f1814bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18155a30 con 0x7f9f180c5120 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181558b0 con 0x7f9f180bde30 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.812+0000 7f9f1fc00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18155bb0 con 0x7f9f180c8730 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.813 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:59882/0 (socket says 172.21.15.118:59882) 2024-03-08T20:30:01.814 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 -- 172.21.15.118:0/4183748038 learned_addr learned my addr 172.21.15.118:0/4183748038 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 -- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f180c8730 msgr2=0x7f9f1814bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f1dc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f180c8730 0x7f9f1814bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f1d200640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 0x7f9f180afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f180c8730 0x7f9f1814bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 -- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 msgr2=0x7f9f180afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 0x7f9f180afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 -- 172.21.15.118:0/4183748038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180c9c40 con 0x7f9f180c5120 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f1d200640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 0x7f9f180afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.813+0000 7f9f17e00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000c00 tx=0x7f9f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.814+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04040070 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.814+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04039960 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.814+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04035040 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.814+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f181ee6d0 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.814+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f181eec90 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.815+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f18074a40 con 0x7f9f180c5120 2024-03-08T20:30:01.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.816+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9f0404b060 con 0x7f9f180c5120 2024-03-08T20:30:01.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.817+0000 7f9f14c00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 0x7f9ef806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:30:01.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.817+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9f040ac830 con 0x7f9f180c5120 2024-03-08T20:30:01.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.817+0000 7f9f1d200640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 0x7f9ef806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:30:01.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.818+0000 7f9f1d200640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 0x7f9ef806e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000f60 tx=0x7f9f0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:30:01.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:01.821+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f9f0407af40 con 0x7f9f180c5120 2024-03-08T20:30:02.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.008+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5248074a40 con 0x7f5248152e10 2024-03-08T20:30:02.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.009+0000 7f523ea00640 1 -- 172.21.15.118:0/163777602 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f524007bcd0 con 0x7f5248152e10 2024-03-08T20:30:02.011 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-08T20:30:02.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 msgr2=0x7f522806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:02.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 0x7f522806e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5248151550 tx=0x7f5238007e80 comp rx=0 tx=0).stop 2024-03-08T20:30:02.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 msgr2=0x7f524814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:02.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f524002c450 tx=0x7f5240004a40 comp rx=0 tx=0).stop 2024-03-08T20:30:02.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 shutdown_connections 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f522806bc00 0x7f522806e0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5248152e10 0x7f524814a920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f524814fed0 0x7f524814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 --2- 172.21.15.118:0/163777602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f524806af80 0x7f524814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 >> 172.21.15.118:0/163777602 conn(0x7f52480a84c0 msgr2=0x7f52480c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.011+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 shutdown_connections 2024-03-08T20:30:02.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.012+0000 7f524da00640 1 -- 172.21.15.118:0/163777602 wait complete. 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T20:30:02.029 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T20:30:02.030 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-08T20:30:02.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.030 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-03-08T20:30:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.060+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f1806d6c0 con 0x7f9f180c5120 2024-03-08T20:30:02.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.061+0000 7f9f14c00640 1 -- 172.21.15.118:0/4183748038 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9f0407a840 con 0x7f9f180c5120 2024-03-08T20:30:02.062 INFO:teuthology.orchestra.run.smithi118.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-08T20:30:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.063+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 msgr2=0x7f9ef806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:02.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 0x7f9ef806e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000f60 tx=0x7f9f0c009040 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 msgr2=0x7f9f18154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000c00 tx=0x7f9f040046c0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 shutdown_connections 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9ef806bbd0 0x7f9ef806e090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f180c8730 0x7f9f1814bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f180c5120 0x7f9f18154320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 --2- 172.21.15.118:0/4183748038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f180bde30 0x7f9f180afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 >> 172.21.15.118:0/4183748038 conn(0x7f9f18072cc0 msgr2=0x7f9f1814da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 shutdown_connections 2024-03-08T20:30:02.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:02.064+0000 7f9f1fc00640 1 -- 172.21.15.118:0/4183748038 wait complete. 2024-03-08T20:30:02.078 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T20:30:02.078 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T20:30:02.079 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.080 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-08T20:30:02.080 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42516sec preferred_lft 42516sec 2024-03-08T20:30:02.080 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-03-08T20:30:02.080 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T20:30:02.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T20:30:02.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-03-08T20:30:02.081 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-08T20:30:02.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:02.082 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T20:30:02.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T20:30:02.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T20:30:02.082 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T20:30:02.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.082 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-03-08T20:30:02.082 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T20:30:02.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.083 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2024-03-08T20:30:02.083 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-03-08T20:30:02.083 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-03-08T20:30:02.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-03-08T20:30:02.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-03-08T20:30:02.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T20:30:02.084 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.175 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42540sec preferred_lft 42540sec 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-03-08T20:30:02.176 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-08T20:30:02.177 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T20:30:02.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.177 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T20:30:02.178 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:30:02.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.392 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T20:30:02.465 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-03-08T20:30:02.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.469 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-03-08T20:30:02.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.508 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T20:30:02.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.517 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:30:02.517 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:30:02.518 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-08T20:30:02.518 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-08T20:30:02.518 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-08T20:30:02.518 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:30:02.583 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-03-08T20:30:02.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.587 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-03-08T20:30:02.635 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-03-08T20:30:02.635 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T20:30:02.636 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-08T20:30:02.636 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-08T20:30:02.636 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T20:30:02.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-08T20:30:02.636 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-03-08T20:30:02.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.744 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-08T20:30:02.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.795 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-03-08T20:30:02.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:02.842 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:30:02.842 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:30:02.842 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:30:02.843 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-08T20:30:02.843 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:30:03.028 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-08T20:30:03.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-08T20:30:03.029 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:30:03.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.276 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec bash -c ' 2024-03-08T20:30:03.276 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-08T20:30:03.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-03-08T20:30:03.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T20:30:03.276 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-08T20:30:03.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.277 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-03-08T20:30:03.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.328 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-03-08T20:30:03.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.373 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2024-03-08T20:30:03.373 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-03-08T20:30:03.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T20:30:03.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-08T20:30:03.374 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-03-08T20:30:03.440 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-08T20:30:03.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:30:03.440 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:03.485 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-08T20:30:03.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:30:03.485 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:03.539 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-08T20:30:03.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-08T20:30:03.540 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-03-08T20:30:03.582 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-08T20:30:03.673 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-08T20:30:03.726 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-08T20:30:03.727 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:30:03.728 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:30:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.729 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-08T20:30:03.774 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-08T20:30:03.774 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-08T20:30:03.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.793 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2024-03-08T20:30:03.793 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-03-08T20:30:03.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-03-08T20:30:03.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T20:30:03.794 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-03-08T20:30:03.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-08T20:30:03.895 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T20:30:03.934 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-08T20:30:03.934 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-08T20:30:03.934 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-08T20:30:03.934 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-08T20:30:03.935 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-08T20:30:03.936 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:30:03.937 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:30:03.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:03.937 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-08T20:30:03.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:30:03.944 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:03.988 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-08T20:30:03.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T20:30:03.989 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:04.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:2024-03-08T20:30:04.004+0000 7fe162610480 -1 init, newargv = 0x55c0b15c75c0 newargc=15 2024-03-08T20:30:04.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[45695]: starting ceph client 2024-03-08T20:30:04.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[45695]: starting fuse 2024-03-08T20:30:04.024 INFO:teuthology.orchestra.run.smithi118.stdout:42 2024-03-08T20:30:04.024 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-08T20:30:04.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo stdin-killer -- python3 -c ' 2024-03-08T20:30:04.024 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2024-03-08T20:30:04.024 DEBUG:teuthology.orchestra.run.smithi118:> import re 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-08T20:30:04.025 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> return f 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.0")) 2024-03-08T20:30:04.026 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-03-08T20:30:04.076 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-08T20:30:04.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:04.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T20:30:04.210 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.0.45695.asok 2024-03-08T20:30:04.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-08T20:30:04.227 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45695.asok 2024-03-08T20:30:04.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:04.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45695.asok status 2024-03-08T20:30:04.252 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T20:30:04.252 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T20:30:04.446 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "7d63482aa89628d733e298984a762389b625c761", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.0.0-1965-g7d63482a (7d63482aa89628d733e298984a762389b625c761) squid (dev)", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "0", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "45695", 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2024-03-08T20:30:04.447 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4869, 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4869 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3463015894 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:30:04.448 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 3463015894 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4869 192.168.0.1:0/3463015894", 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/3463015894", 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 9, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 25, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2024-03-08T20:30:04.449 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:30:04.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:04.461 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2024-03-08T20:30:04.461 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.509 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2024-03-08T20:30:04.509 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:04.509 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.634 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-08T20:30:04.638 INFO:tasks.workunit:Pulling workunits from ref 7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:30:04.638 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-08T20:30:04.639 DEBUG:teuthology.orchestra.run.smithi118:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-08 20:29:24.218795057 +0000 2024-03-08T20:30:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-08 20:29:37.354998712 +0000 2024-03-08T20:30:04.683 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2024-03-08T20:30:04.683 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-08T20:30:04.683 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-08T20:30:04.815 INFO:tasks.workunit:timeout=3h 2024-03-08T20:30:04.815 INFO:tasks.workunit:cleanup=True 2024-03-08T20:30:04.815 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:30:04.866 INFO:tasks.workunit.client.0.smithi118.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-08T20:30:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T20:30:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T20:30:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.118:3300,172.21.15.144:3300,172.21.15.144:3301" 2024-03-08T20:30:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 1@ac17b673-6e59-4db3-9519-ba644ea1ee5b.cephfs=/ 2024-03-08T20:30:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.118:3300/172.21.15.144:3300/172.21.15.144:3301" will pass to kernel 2024-03-08T20:30:04.910 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-08T20:30:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-03-08T20:30:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T20:30:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T20:30:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T20:30:04.915 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T20:30:04.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:04.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:05.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:05.007 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T20:30:05.066 INFO:teuthology.orchestra.run.smithi144.stdout:client4872 2024-03-08T20:30:05.066 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:30:05.066 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:30:05.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:05.113 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T20:30:05.214 INFO:teuthology.orchestra.run.smithi144.stdout:client4872 2024-03-08T20:30:05.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:05.214 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T20:30:05.271 INFO:teuthology.orchestra.run.smithi144.stdout:client4872 2024-03-08T20:30:05.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:30:05.272 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ac17b673-6e59-4db3-9519-ba644ea1ee5b.client4872/status') 2024-03-08T20:30:05.361 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4872 (3)172.21.15.144:0/1026195770 2024-03-08T20:30:05.361 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-03-08T20:30:05.361 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-03-08T20:30:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-03-08T20:30:05.362 INFO:teuthology.orchestra.run.smithi144.stderr:71 bytes copied, 8.561e-05 s, 829 kB/s 2024-03-08T20:30:05.366 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-08T20:30:05.366 INFO:tasks.workunit:Pulling workunits from ref 7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:30:05.366 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-08T20:30:05.366 DEBUG:teuthology.orchestra.run.smithi144:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 29h/41d Inode: 1 Links: 3 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-03-08 20:30:04.803493189 +0000 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-03-08 20:30:04.803493189 +0000 2024-03-08T20:30:05.416 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-03-08 20:29:24.218795057 +0000 2024-03-08T20:30:05.416 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-08T20:30:05.417 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-08T20:30:05.520 INFO:tasks.workunit:timeout=3h 2024-03-08T20:30:05.520 INFO:tasks.workunit:cleanup=True 2024-03-08T20:30:05.520 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 7d63482aa89628d733e298984a762389b625c761 2024-03-08T20:30:05.577 INFO:tasks.workunit.client.1.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-08T20:30:22.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:30:22.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:30:52.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:30:52.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:31:22.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:31:22.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:31:36.756 INFO:tasks.workunit.client.0.smithi118.stderr:Updating files: 64% (7950/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr:Note: switching to '7d63482aa89628d733e298984a762389b625c761'. 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr:state without impacting any branches by switching back to a branch. 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.420 INFO:tasks.workunit.client.0.smithi118.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: git switch -c 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr:Or undo this operation with: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: git switch - 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:37.421 INFO:tasks.workunit.client.0.smithi118.stderr:HEAD is now at 7d63482aa89 Merge remote-tracking branch 'rishabh/fsshell-deprecation' into rishabh-2024mar8 2024-03-08T20:31:37.427 DEBUG:teuthology.orchestra.run.smithi118:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-08T20:31:37.495 INFO:tasks.workunit.client.0.smithi118.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-08T20:31:37.502 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-08T20:31:37.502 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-08T20:31:37.881 INFO:tasks.workunit.client.1.smithi144.stderr:Updating files: 64% (7912/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-08T20:31:38.341 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-08T20:31:38.456 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-08T20:31:38.542 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-08T20:31:38.546 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-08T20:31:38.546 INFO:tasks.workunit.client.0.smithi118.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:Note: switching to '7d63482aa89628d733e298984a762389b625c761'. 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:state without impacting any branches by switching back to a branch. 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-08T20:31:38.627 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: git switch -c 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr:Or undo this operation with: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: git switch - 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:38.628 INFO:tasks.workunit.client.1.smithi144.stderr:HEAD is now at 7d63482aa89 Merge remote-tracking branch 'rishabh/fsshell-deprecation' into rishabh-2024mar8 2024-03-08T20:31:38.630 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-08T20:31:38.634 DEBUG:teuthology.orchestra.run.smithi144:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-08T20:31:38.640 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:31:38.640 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-08T20:31:38.688 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-03-08T20:31:38.690 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-03-08T20:31:38.690 DEBUG:teuthology.orchestra.run.smithi118:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d63482aa89628d733e298984a762389b625c761 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-03-08T20:31:38.691 INFO:tasks.workunit.client.1.smithi144.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-08T20:31:38.694 INFO:tasks.workunit.client.1.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-08T20:31:38.694 INFO:tasks.workunit.client.1.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-08T20:31:38.824 INFO:tasks.workunit.client.0.smithi118.stdout:getting blogbench 2024-03-08T20:31:38.824 INFO:tasks.workunit.client.0.smithi118.stderr:+ echo 'getting blogbench' 2024-03-08T20:31:38.824 INFO:tasks.workunit.client.0.smithi118.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-03-08T20:31:38.874 INFO:tasks.workunit.client.0.smithi118.stderr:--2024-03-08 20:31:38-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-03-08T20:31:38.885 INFO:tasks.workunit.client.0.smithi118.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-08T20:31:38.906 INFO:tasks.workunit.client.0.smithi118.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-08T20:31:38.927 INFO:tasks.workunit.client.0.smithi118.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-08T20:31:38.928 INFO:tasks.workunit.client.0.smithi118.stderr:Length: 103355 (101K) [application/octet-stream] 2024-03-08T20:31:38.934 INFO:tasks.workunit.client.0.smithi118.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-03-08T20:31:38.944 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:38.970 INFO:tasks.workunit.client.0.smithi118.stderr: 0K .......... .......... .......... .......... .......... 49% 1.39M 0s 2024-03-08T20:31:39.010 INFO:tasks.workunit.client.0.smithi118.stderr: 50K .......... .......... .......... .......... .......... 99% 2.04M 0s 2024-03-08T20:31:39.010 INFO:tasks.workunit.client.0.smithi118.stderr: 100K 100% 59.8K=0.07s 2024-03-08T20:31:39.010 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:39.012 INFO:tasks.workunit.client.0.smithi118.stderr:2024-03-08 20:31:39 (1.32 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-03-08T20:31:39.012 INFO:tasks.workunit.client.0.smithi118.stderr: 2024-03-08T20:31:39.014 INFO:tasks.workunit.client.0.smithi118.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-03-08T20:31:39.060 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/ 2024-03-08T20:31:39.064 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/m4/ 2024-03-08T20:31:39.069 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-03-08T20:31:39.078 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/man/ 2024-03-08T20:31:39.086 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/man/blogbench.8 2024-03-08T20:31:39.096 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/man/Makefile.am 2024-03-08T20:31:39.103 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/man/Makefile.in 2024-03-08T20:31:39.112 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/ 2024-03-08T20:31:39.119 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/mysnprintf.c 2024-03-08T20:31:39.128 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/mysnprintf.h 2024-03-08T20:31:39.135 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/blogbench.c 2024-03-08T20:31:39.144 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/blogbench.h 2024-03-08T20:31:39.151 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/fakesnprintf.c 2024-03-08T20:31:39.160 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/fakesnprintf.h 2024-03-08T20:31:39.168 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/blogbench_p.h 2024-03-08T20:31:39.176 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-03-08T20:31:39.187 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-03-08T20:31:39.196 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/Makefile.am 2024-03-08T20:31:39.204 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/Makefile.in 2024-03-08T20:31:39.212 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/process.c 2024-03-08T20:31:39.220 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/globals.h 2024-03-08T20:31:39.226 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/commenter.c 2024-03-08T20:31:39.234 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/rewriter.c 2024-03-08T20:31:39.241 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/reader.c 2024-03-08T20:31:39.247 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/writer.c 2024-03-08T20:31:39.254 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/src/helpers.c 2024-03-08T20:31:39.260 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/NEWS 2024-03-08T20:31:39.267 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/compile 2024-03-08T20:31:39.271 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/depcomp 2024-03-08T20:31:39.277 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/aclocal.m4 2024-03-08T20:31:39.284 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/README 2024-03-08T20:31:39.289 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/configure 2024-03-08T20:31:39.322 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/configure.ac 2024-03-08T20:31:39.327 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/config.guess 2024-03-08T20:31:39.338 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/install-sh 2024-03-08T20:31:39.345 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/config.sub 2024-03-08T20:31:39.356 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/missing 2024-03-08T20:31:39.360 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/mkinstalldirs 2024-03-08T20:31:39.365 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/Makefile.am 2024-03-08T20:31:39.370 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/Makefile.in 2024-03-08T20:31:39.374 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/config.h.in 2024-03-08T20:31:39.379 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/AUTHORS 2024-03-08T20:31:39.384 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/INSTALL 2024-03-08T20:31:39.390 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/ChangeLog 2024-03-08T20:31:39.395 INFO:tasks.workunit.client.0.smithi118.stdout:blogbench-1.0/COPYING 2024-03-08T20:31:39.401 INFO:tasks.workunit.client.0.smithi118.stderr:+ cd blogbench-1.0/ 2024-03-08T20:31:39.407 INFO:tasks.workunit.client.0.smithi118.stdout:making blogbench 2024-03-08T20:31:39.407 INFO:tasks.workunit.client.0.smithi118.stderr:+ echo 'making blogbench' 2024-03-08T20:31:39.407 INFO:tasks.workunit.client.0.smithi118.stderr:+ ./configure 2024-03-08T20:31:39.586 INFO:tasks.workunit.client.1.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-08T20:31:39.701 INFO:tasks.workunit.client.1.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-08T20:31:39.735 INFO:tasks.workunit.client.0.smithi118.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-08T20:31:39.786 INFO:tasks.workunit.client.1.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-08T20:31:39.792 INFO:tasks.workunit.client.1.smithi144.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-08T20:31:39.792 INFO:tasks.workunit.client.1.smithi144.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-08T20:31:39.871 INFO:tasks.workunit.client.1.smithi144.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-08T20:31:39.881 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:31:39.881 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-08T20:31:39.930 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.1... 2024-03-08T20:31:39.931 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2024-03-08T20:31:39.931 DEBUG:teuthology.orchestra.run.smithi144:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d63482aa89628d733e298984a762389b625c761 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh 2024-03-08T20:31:40.041 INFO:tasks.workunit.client.1.smithi144.stderr:+ wget -O linux.tar.xz http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-03-08T20:31:40.086 INFO:tasks.workunit.client.1.smithi144.stderr:--2024-03-08 20:31:40-- http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-03-08T20:31:40.087 INFO:tasks.workunit.client.1.smithi144.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-08T20:31:40.124 INFO:tasks.workunit.client.1.smithi144.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-08T20:31:40.160 INFO:tasks.workunit.client.1.smithi144.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-08T20:31:40.160 INFO:tasks.workunit.client.1.smithi144.stderr:Length: 139010916 (133M) [application/octet-stream] 2024-03-08T20:31:40.160 INFO:tasks.workunit.client.1.smithi144.stderr:Saving to: ‘linux.tar.xz’ 2024-03-08T20:31:40.169 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:40.232 INFO:tasks.workunit.client.1.smithi144.stderr: 0K .......... .......... .......... .......... .......... 0% 701K 3m14s 2024-03-08T20:31:40.268 INFO:tasks.workunit.client.1.smithi144.stderr: 50K .......... .......... .......... .......... .......... 0% 1.35M 2m26s 2024-03-08T20:31:40.268 INFO:tasks.workunit.client.1.smithi144.stderr: 100K .......... .......... .......... .......... .......... 0% 51.7M 98s 2024-03-08T20:31:40.304 INFO:tasks.workunit.client.1.smithi144.stderr: 150K .......... .......... .......... .......... .......... 0% 1.40M 97s 2024-03-08T20:31:40.343 INFO:tasks.workunit.client.1.smithi144.stderr: 200K .......... .......... .......... .......... .......... 0% 1.35M 97s 2024-03-08T20:31:40.343 INFO:tasks.workunit.client.1.smithi144.stderr: 250K .......... .......... .......... .......... .......... 0% 86.4M 81s 2024-03-08T20:31:40.343 INFO:tasks.workunit.client.1.smithi144.stderr: 300K .......... .......... .......... .......... .......... 0% 85.0M 70s 2024-03-08T20:31:40.343 INFO:tasks.workunit.client.1.smithi144.stderr: 350K .......... .......... .......... .......... .......... 0% 78.2M 61s 2024-03-08T20:31:40.385 INFO:tasks.workunit.client.1.smithi144.stderr: 400K .......... .......... .......... .......... .......... 0% 1.40M 65s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 450K .......... .......... .......... .......... .......... 0% 34.0M 59s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 500K .......... .......... .......... .......... .......... 0% 68.8M 54s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 550K .......... .......... .......... .......... .......... 0% 88.6M 49s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 600K .......... .......... .......... .......... .......... 0% 86.2M 46s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 650K .......... .......... .......... .......... .......... 0% 77.9M 42s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 700K .......... .......... .......... .......... .......... 0% 87.3M 40s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 750K .......... .......... .......... .......... .......... 0% 88.2M 37s 2024-03-08T20:31:40.386 INFO:tasks.workunit.client.1.smithi144.stderr: 800K .......... .......... .......... .......... .......... 0% 86.1M 35s 2024-03-08T20:31:40.428 INFO:tasks.workunit.client.1.smithi144.stderr: 850K .......... .......... .......... .......... .......... 0% 1.58M 38s 2024-03-08T20:31:40.428 INFO:tasks.workunit.client.1.smithi144.stderr: 900K .......... .......... .......... .......... .......... 0% 58.0M 36s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 950K .......... .......... .......... .......... .......... 0% 55.9M 34s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1000K .......... .......... .......... .......... .......... 0% 59.0M 33s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1050K .......... .......... .......... .......... .......... 0% 59.7M 31s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1100K .......... .......... .......... .......... .......... 0% 55.0M 30s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1150K .......... .......... .......... .......... .......... 0% 62.4M 29s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1200K .......... .......... .......... .......... .......... 0% 65.1M 28s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1250K .......... .......... .......... .......... .......... 0% 66.0M 27s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1300K .......... .......... .......... .......... .......... 0% 48.2M 26s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1350K .......... .......... .......... .......... .......... 1% 64.2M 25s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1400K .......... .......... .......... .......... .......... 1% 63.8M 24s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1450K .......... .......... .......... .......... .......... 1% 66.2M 23s 2024-03-08T20:31:40.429 INFO:tasks.workunit.client.1.smithi144.stderr: 1500K .......... .......... .......... .......... .......... 1% 54.4M 23s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1550K .......... .......... .......... .......... .......... 1% 2.01M 24s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1600K .......... .......... .......... .......... .......... 1% 41.7M 23s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1650K .......... .......... .......... .......... .......... 1% 61.6M 23s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1700K .......... .......... .......... .......... .......... 1% 63.7M 22s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1750K .......... .......... .......... .......... .......... 1% 59.0M 22s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1800K .......... .......... .......... .......... .......... 1% 71.3M 21s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1850K .......... .......... .......... .......... .......... 1% 52.7M 21s 2024-03-08T20:31:40.464 INFO:tasks.workunit.client.1.smithi144.stderr: 1900K .......... .......... .......... .......... .......... 1% 65.5M 20s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 1950K .......... .......... .......... .......... .......... 1% 57.3M 20s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2000K .......... .......... .......... .......... .......... 1% 59.6M 19s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2050K .......... .......... .......... .......... .......... 1% 27.3M 19s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2100K .......... .......... .......... .......... .......... 1% 67.2M 19s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2150K .......... .......... .......... .......... .......... 1% 60.0M 18s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2200K .......... .......... .......... .......... .......... 1% 39.7M 18s 2024-03-08T20:31:40.465 INFO:tasks.workunit.client.1.smithi144.stderr: 2250K .......... .......... .......... .......... .......... 1% 75.6M 17s 2024-03-08T20:31:40.499 INFO:tasks.workunit.client.1.smithi144.stderr: 2300K .......... .......... .......... .......... .......... 1% 2.29M 18s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2350K .......... .......... .......... .......... .......... 1% 34.5M 18s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2400K .......... .......... .......... .......... .......... 1% 40.0M 18s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2450K .......... .......... .......... .......... .......... 1% 59.8M 17s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2500K .......... .......... .......... .......... .......... 1% 64.5M 17s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2550K .......... .......... .......... .......... .......... 1% 60.0M 17s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2600K .......... .......... .......... .......... .......... 1% 61.5M 16s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2650K .......... .......... .......... .......... .......... 1% 53.3M 16s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2700K .......... .......... .......... .......... .......... 2% 69.6M 16s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2750K .......... .......... .......... .......... .......... 2% 64.5M 16s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2800K .......... .......... .......... .......... .......... 2% 66.0M 15s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2850K .......... .......... .......... .......... .......... 2% 55.1M 15s 2024-03-08T20:31:40.500 INFO:tasks.workunit.client.1.smithi144.stderr: 2900K .......... .......... .......... .......... .......... 2% 63.6M 15s 2024-03-08T20:31:40.501 INFO:tasks.workunit.client.1.smithi144.stderr: 2950K .......... .......... .......... .......... .......... 2% 25.8M 15s 2024-03-08T20:31:40.501 INFO:tasks.workunit.client.1.smithi144.stderr: 3000K .......... .......... .......... .......... .......... 2% 34.4M 15s 2024-03-08T20:31:40.534 INFO:tasks.workunit.client.1.smithi144.stderr: 3050K .......... .......... .......... .......... .......... 2% 2.38M 15s 2024-03-08T20:31:40.534 INFO:tasks.workunit.client.1.smithi144.stderr: 3100K .......... .......... .......... .......... .......... 2% 28.4M 15s 2024-03-08T20:31:40.534 INFO:tasks.workunit.client.1.smithi144.stderr: 3150K .......... .......... .......... .......... .......... 2% 30.7M 15s 2024-03-08T20:31:40.534 INFO:tasks.workunit.client.1.smithi144.stderr: 3200K .......... .......... .......... .......... .......... 2% 43.6M 15s 2024-03-08T20:31:40.534 INFO:tasks.workunit.client.1.smithi144.stderr: 3250K .......... .......... .......... .......... .......... 2% 75.7M 15s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3300K .......... .......... .......... .......... .......... 2% 61.7M 14s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3350K .......... .......... .......... .......... .......... 2% 55.8M 14s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3400K .......... .......... .......... .......... .......... 2% 69.5M 14s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3450K .......... .......... .......... .......... .......... 2% 57.6M 14s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3500K .......... .......... .......... .......... .......... 2% 67.8M 14s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3550K .......... .......... .......... .......... .......... 2% 56.1M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3600K .......... .......... .......... .......... .......... 2% 70.2M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3650K .......... .......... .......... .......... .......... 2% 59.0M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3700K .......... .......... .......... .......... .......... 2% 34.7M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3750K .......... .......... .......... .......... .......... 2% 31.5M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3800K .......... .......... .......... .......... .......... 2% 27.5M 13s 2024-03-08T20:31:40.535 INFO:tasks.workunit.client.1.smithi144.stderr: 3850K .......... .......... .......... .......... .......... 2% 41.9M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 3900K .......... .......... .......... .......... .......... 2% 2.55M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 3950K .......... .......... .......... .......... .......... 2% 48.0M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4000K .......... .......... .......... .......... .......... 2% 72.8M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4050K .......... .......... .......... .......... .......... 3% 61.8M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4100K .......... .......... .......... .......... .......... 3% 73.4M 13s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4150K .......... .......... .......... .......... .......... 3% 77.2M 12s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4200K .......... .......... .......... .......... .......... 3% 89.9M 12s 2024-03-08T20:31:40.562 INFO:tasks.workunit.client.1.smithi144.stderr: 4250K .......... .......... .......... .......... .......... 3% 71.4M 12s 2024-03-08T20:31:40.563 INFO:tasks.workunit.client.1.smithi144.stderr: 4300K .......... .......... .......... .......... .......... 3% 82.4M 12s 2024-03-08T20:31:40.563 INFO:tasks.workunit.client.1.smithi144.stderr: 4350K .......... .......... .......... .......... .......... 3% 82.9M 12s 2024-03-08T20:31:40.563 INFO:tasks.workunit.client.1.smithi144.stderr: 4400K .......... .......... .......... .......... .......... 3% 29.8M 12s 2024-03-08T20:31:40.565 INFO:tasks.workunit.client.1.smithi144.stderr: 4450K .......... .......... .......... .......... .......... 3% 25.4M 12s 2024-03-08T20:31:40.565 INFO:tasks.workunit.client.1.smithi144.stderr: 4500K .......... .......... .......... .......... .......... 3% 33.1M 12s 2024-03-08T20:31:40.566 INFO:tasks.workunit.client.1.smithi144.stderr: 4550K .......... .......... .......... .......... .......... 3% 25.2M 12s 2024-03-08T20:31:40.567 INFO:tasks.workunit.client.1.smithi144.stderr: 4600K .......... .......... .......... .......... .......... 3% 34.1M 11s 2024-03-08T20:31:40.569 INFO:tasks.workunit.client.1.smithi144.stderr: 4650K .......... .......... .......... .......... .......... 3% 23.8M 11s 2024-03-08T20:31:40.571 INFO:tasks.workunit.client.1.smithi144.stderr: 4700K .......... .......... .......... .......... .......... 3% 25.5M 11s 2024-03-08T20:31:40.591 INFO:tasks.workunit.client.1.smithi144.stderr: 4750K .......... .......... .......... .......... .......... 3% 2.90M 12s 2024-03-08T20:31:40.591 INFO:tasks.workunit.client.1.smithi144.stderr: 4800K .......... .......... .......... .......... .......... 3% 62.1M 12s 2024-03-08T20:31:40.591 INFO:tasks.workunit.client.1.smithi144.stderr: 4850K .......... .......... .......... .......... .......... 3% 70.4M 11s 2024-03-08T20:31:40.591 INFO:tasks.workunit.client.1.smithi144.stderr: 4900K .......... .......... .......... .......... .......... 3% 64.7M 11s 2024-03-08T20:31:40.591 INFO:tasks.workunit.client.1.smithi144.stderr: 4950K .......... .......... .......... .......... .......... 3% 72.3M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5000K .......... .......... .......... .......... .......... 3% 72.3M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5050K .......... .......... .......... .......... .......... 3% 81.8M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5100K .......... .......... .......... .......... .......... 3% 69.9M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5150K .......... .......... .......... .......... .......... 3% 83.1M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5200K .......... .......... .......... .......... .......... 3% 79.0M 11s 2024-03-08T20:31:40.597 INFO:tasks.workunit.client.1.smithi144.stderr: 5250K .......... .......... .......... .......... .......... 3% 48.3M 11s 2024-03-08T20:31:40.598 INFO:tasks.workunit.client.1.smithi144.stderr: 5300K .......... .......... .......... .......... .......... 3% 19.7M 11s 2024-03-08T20:31:40.599 INFO:tasks.workunit.client.1.smithi144.stderr: 5350K .......... .......... .......... .......... .......... 3% 32.8M 11s 2024-03-08T20:31:40.601 INFO:tasks.workunit.client.1.smithi144.stderr: 5400K .......... .......... .......... .......... .......... 4% 28.4M 11s 2024-03-08T20:31:40.603 INFO:tasks.workunit.client.1.smithi144.stderr: 5450K .......... .......... .......... .......... .......... 4% 28.5M 10s 2024-03-08T20:31:40.604 INFO:tasks.workunit.client.1.smithi144.stderr: 5500K .......... .......... .......... .......... .......... 4% 34.3M 10s 2024-03-08T20:31:40.606 INFO:tasks.workunit.client.1.smithi144.stderr: 5550K .......... .......... .......... .......... .......... 4% 26.6M 10s 2024-03-08T20:31:40.607 INFO:tasks.workunit.client.1.smithi144.stderr: 5600K .......... .......... .......... .......... .......... 4% 36.1M 10s 2024-03-08T20:31:40.632 INFO:tasks.workunit.client.1.smithi144.stderr: 5650K .......... .......... .......... .......... .......... 4% 3.06M 11s 2024-03-08T20:31:40.632 INFO:tasks.workunit.client.1.smithi144.stderr: 5700K .......... .......... .......... .......... .......... 4% 46.8M 10s 2024-03-08T20:31:40.632 INFO:tasks.workunit.client.1.smithi144.stderr: 5750K .......... .......... .......... .......... .......... 4% 73.0M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 5800K .......... .......... .......... .......... .......... 4% 71.9M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 5850K .......... .......... .......... .......... .......... 4% 61.4M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 5900K .......... .......... .......... .......... .......... 4% 74.5M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 5950K .......... .......... .......... .......... .......... 4% 75.5M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 6000K .......... .......... .......... .......... .......... 4% 81.7M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 6050K .......... .......... .......... .......... .......... 4% 69.3M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 6100K .......... .......... .......... .......... .......... 4% 75.2M 10s 2024-03-08T20:31:40.633 INFO:tasks.workunit.client.1.smithi144.stderr: 6150K .......... .......... .......... .......... .......... 4% 33.1M 10s 2024-03-08T20:31:40.634 INFO:tasks.workunit.client.1.smithi144.stderr: 6200K .......... .......... .......... .......... .......... 4% 25.9M 10s 2024-03-08T20:31:40.635 INFO:tasks.workunit.client.1.smithi144.stderr: 6250K .......... .......... .......... .......... .......... 4% 37.1M 10s 2024-03-08T20:31:40.636 INFO:tasks.workunit.client.1.smithi144.stderr: 6300K .......... .......... .......... .......... .......... 4% 21.6M 10s 2024-03-08T20:31:40.637 INFO:tasks.workunit.client.1.smithi144.stderr: 6350K .......... .......... .......... .......... .......... 4% 51.1M 10s 2024-03-08T20:31:40.639 INFO:tasks.workunit.client.1.smithi144.stderr: 6400K .......... .......... .......... .......... .......... 4% 26.3M 10s 2024-03-08T20:31:40.641 INFO:tasks.workunit.client.1.smithi144.stderr: 6450K .......... .......... .......... .......... .......... 4% 25.2M 10s 2024-03-08T20:31:40.643 INFO:tasks.workunit.client.1.smithi144.stderr: 6500K .......... .......... .......... .......... .......... 4% 35.2M 10s 2024-03-08T20:31:40.645 INFO:tasks.workunit.client.1.smithi144.stderr: 6550K .......... .......... .......... .......... .......... 4% 22.8M 9s 2024-03-08T20:31:40.670 INFO:tasks.workunit.client.1.smithi144.stderr: 6600K .......... .......... .......... .......... .......... 4% 3.43M 10s 2024-03-08T20:31:40.670 INFO:tasks.workunit.client.1.smithi144.stderr: 6650K .......... .......... .......... .......... .......... 4% 54.2M 10s 2024-03-08T20:31:40.670 INFO:tasks.workunit.client.1.smithi144.stderr: 6700K .......... .......... .......... .......... .......... 4% 63.7M 10s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 6750K .......... .......... .......... .......... .......... 5% 69.7M 10s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 6800K .......... .......... .......... .......... .......... 5% 74.3M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 6850K .......... .......... .......... .......... .......... 5% 69.1M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 6900K .......... .......... .......... .......... .......... 5% 63.8M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 6950K .......... .......... .......... .......... .......... 5% 88.8M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 7000K .......... .......... .......... .......... .......... 5% 78.7M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 7050K .......... .......... .......... .......... .......... 5% 62.0M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 7100K .......... .......... .......... .......... .......... 5% 35.5M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 7150K .......... .......... .......... .......... .......... 5% 25.3M 9s 2024-03-08T20:31:40.671 INFO:tasks.workunit.client.1.smithi144.stderr: 7200K .......... .......... .......... .......... .......... 5% 27.0M 9s 2024-03-08T20:31:40.673 INFO:tasks.workunit.client.1.smithi144.stderr: 7250K .......... .......... .......... .......... .......... 5% 34.8M 9s 2024-03-08T20:31:40.674 INFO:tasks.workunit.client.1.smithi144.stderr: 7300K .......... .......... .......... .......... .......... 5% 24.9M 9s 2024-03-08T20:31:40.675 INFO:tasks.workunit.client.1.smithi144.stderr: 7350K .......... .......... .......... .......... .......... 5% 31.9M 9s 2024-03-08T20:31:40.678 INFO:tasks.workunit.client.1.smithi144.stderr: 7400K .......... .......... .......... .......... .......... 5% 24.7M 9s 2024-03-08T20:31:40.679 INFO:tasks.workunit.client.1.smithi144.stderr: 7450K .......... .......... .......... .......... .......... 5% 30.7M 9s 2024-03-08T20:31:40.680 INFO:tasks.workunit.client.1.smithi144.stderr: 7500K .......... .......... .......... .......... .......... 5% 35.0M 9s 2024-03-08T20:31:40.684 INFO:tasks.workunit.client.1.smithi144.stderr: 7550K .......... .......... .......... .......... .......... 5% 17.7M 9s 2024-03-08T20:31:40.704 INFO:tasks.workunit.client.1.smithi144.stderr: 7600K .......... .......... .......... .......... .......... 5% 4.23M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7650K .......... .......... .......... .......... .......... 5% 46.3M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7700K .......... .......... .......... .......... .......... 5% 70.6M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7750K .......... .......... .......... .......... .......... 5% 75.3M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7800K .......... .......... .......... .......... .......... 5% 72.2M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7850K .......... .......... .......... .......... .......... 5% 60.1M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7900K .......... .......... .......... .......... .......... 5% 79.9M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 7950K .......... .......... .......... .......... .......... 5% 86.3M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 8000K .......... .......... .......... .......... .......... 5% 78.4M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 8050K .......... .......... .......... .......... .......... 5% 58.6M 9s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 8100K .......... .......... .......... .......... .......... 6% 38.4M 8s 2024-03-08T20:31:40.705 INFO:tasks.workunit.client.1.smithi144.stderr: 8150K .......... .......... .......... .......... .......... 6% 25.1M 8s 2024-03-08T20:31:40.707 INFO:tasks.workunit.client.1.smithi144.stderr: 8200K .......... .......... .......... .......... .......... 6% 27.4M 8s 2024-03-08T20:31:40.707 INFO:tasks.workunit.client.1.smithi144.stderr: 8250K .......... .......... .......... .......... .......... 6% 32.8M 8s 2024-03-08T20:31:40.710 INFO:tasks.workunit.client.1.smithi144.stderr: 8300K .......... .......... .......... .......... .......... 6% 25.8M 8s 2024-03-08T20:31:40.711 INFO:tasks.workunit.client.1.smithi144.stderr: 8350K .......... .......... .......... .......... .......... 6% 38.7M 8s 2024-03-08T20:31:40.714 INFO:tasks.workunit.client.1.smithi144.stderr: 8400K .......... .......... .......... .......... .......... 6% 23.3M 8s 2024-03-08T20:31:40.715 INFO:tasks.workunit.client.1.smithi144.stderr: 8450K .......... .......... .......... .......... .......... 6% 30.6M 8s 2024-03-08T20:31:40.716 INFO:tasks.workunit.client.1.smithi144.stderr: 8500K .......... .......... .......... .......... .......... 6% 40.5M 8s 2024-03-08T20:31:40.718 INFO:tasks.workunit.client.1.smithi144.stderr: 8550K .......... .......... .......... .......... .......... 6% 25.4M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8600K .......... .......... .......... .......... .......... 6% 3.98M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8650K .......... .......... .......... .......... .......... 6% 61.5M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8700K .......... .......... .......... .......... .......... 6% 67.1M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8750K .......... .......... .......... .......... .......... 6% 76.3M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8800K .......... .......... .......... .......... .......... 6% 63.4M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8850K .......... .......... .......... .......... .......... 6% 70.3M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8900K .......... .......... .......... .......... .......... 6% 75.3M 8s 2024-03-08T20:31:40.736 INFO:tasks.workunit.client.1.smithi144.stderr: 8950K .......... .......... .......... .......... .......... 6% 44.3M 8s 2024-03-08T20:31:40.741 INFO:tasks.workunit.client.1.smithi144.stderr: 9000K .......... .......... .......... .......... .......... 6% 37.4M 8s 2024-03-08T20:31:40.741 INFO:tasks.workunit.client.1.smithi144.stderr: 9050K .......... .......... .......... .......... .......... 6% 51.4M 8s 2024-03-08T20:31:40.741 INFO:tasks.workunit.client.1.smithi144.stderr: 9100K .......... .......... .......... .......... .......... 6% 40.4M 8s 2024-03-08T20:31:40.741 INFO:tasks.workunit.client.1.smithi144.stderr: 9150K .......... .......... .......... .......... .......... 6% 64.8M 8s 2024-03-08T20:31:40.742 INFO:tasks.workunit.client.1.smithi144.stderr: 9200K .......... .......... .......... .......... .......... 6% 30.9M 8s 2024-03-08T20:31:40.744 INFO:tasks.workunit.client.1.smithi144.stderr: 9250K .......... .......... .......... .......... .......... 6% 35.4M 8s 2024-03-08T20:31:40.745 INFO:tasks.workunit.client.1.smithi144.stderr: 9300K .......... .......... .......... .......... .......... 6% 23.2M 8s 2024-03-08T20:31:40.747 INFO:tasks.workunit.client.1.smithi144.stderr: 9350K .......... .......... .......... .......... .......... 6% 24.4M 8s 2024-03-08T20:31:40.753 INFO:tasks.workunit.client.1.smithi144.stderr: 9400K .......... .......... .......... .......... .......... 6% 40.6M 8s 2024-03-08T20:31:40.753 INFO:tasks.workunit.client.1.smithi144.stderr: 9450K .......... .......... .......... .......... .......... 6% 30.8M 8s 2024-03-08T20:31:40.753 INFO:tasks.workunit.client.1.smithi144.stderr: 9500K .......... .......... .......... .......... .......... 7% 23.4M 8s 2024-03-08T20:31:40.754 INFO:tasks.workunit.client.1.smithi144.stderr: 9550K .......... .......... .......... .......... .......... 7% 23.8M 8s 2024-03-08T20:31:40.755 INFO:tasks.workunit.client.1.smithi144.stderr: 9600K .......... .......... .......... .......... .......... 7% 29.1M 8s 2024-03-08T20:31:40.756 INFO:tasks.workunit.client.1.smithi144.stderr: 9650K .......... .......... .......... .......... .......... 7% 38.0M 8s 2024-03-08T20:31:40.767 INFO:tasks.workunit.client.1.smithi144.stderr: 9700K .......... .......... .......... .......... .......... 7% 5.31M 8s 2024-03-08T20:31:40.768 INFO:tasks.workunit.client.1.smithi144.stderr: 9750K .......... .......... .......... .......... .......... 7% 38.6M 8s 2024-03-08T20:31:40.768 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether build environment is sane... yes 2024-03-08T20:31:40.771 INFO:tasks.workunit.client.1.smithi144.stderr: 9800K .......... .......... .......... .......... .......... 7% 34.5M 8s 2024-03-08T20:31:40.771 INFO:tasks.workunit.client.1.smithi144.stderr: 9850K .......... .......... .......... .......... .......... 7% 42.9M 8s 2024-03-08T20:31:40.771 INFO:tasks.workunit.client.1.smithi144.stderr: 9900K .......... .......... .......... .......... .......... 7% 47.9M 8s 2024-03-08T20:31:40.773 INFO:tasks.workunit.client.1.smithi144.stderr: 9950K .......... .......... .......... .......... .......... 7% 45.8M 8s 2024-03-08T20:31:40.773 INFO:tasks.workunit.client.1.smithi144.stderr: 10000K .......... .......... .......... .......... .......... 7% 41.3M 8s 2024-03-08T20:31:40.775 INFO:tasks.workunit.client.1.smithi144.stderr: 10050K .......... .......... .......... .......... .......... 7% 48.8M 8s 2024-03-08T20:31:40.775 INFO:tasks.workunit.client.1.smithi144.stderr: 10100K .......... .......... .......... .......... .......... 7% 46.7M 8s 2024-03-08T20:31:40.776 INFO:tasks.workunit.client.1.smithi144.stderr: 10150K .......... .......... .......... .......... .......... 7% 52.3M 8s 2024-03-08T20:31:40.777 INFO:tasks.workunit.client.1.smithi144.stderr: 10200K .......... .......... .......... .......... .......... 7% 43.5M 8s 2024-03-08T20:31:40.778 INFO:tasks.workunit.client.1.smithi144.stderr: 10250K .......... .......... .......... .......... .......... 7% 46.9M 8s 2024-03-08T20:31:40.779 INFO:tasks.workunit.client.1.smithi144.stderr: 10300K .......... .......... .......... .......... .......... 7% 53.1M 7s 2024-03-08T20:31:40.781 INFO:tasks.workunit.client.1.smithi144.stderr: 10350K .......... .......... .......... .......... .......... 7% 30.6M 7s 2024-03-08T20:31:40.781 INFO:tasks.workunit.client.1.smithi144.stderr: 10400K .......... .......... .......... .......... .......... 7% 44.4M 7s 2024-03-08T20:31:40.784 INFO:tasks.workunit.client.1.smithi144.stderr: 10450K .......... .......... .......... .......... .......... 7% 24.7M 7s 2024-03-08T20:31:40.785 INFO:tasks.workunit.client.1.smithi144.stderr: 10500K .......... .......... .......... .......... .......... 7% 23.3M 7s 2024-03-08T20:31:40.787 INFO:tasks.workunit.client.1.smithi144.stderr: 10550K .......... .......... .......... .......... .......... 7% 46.0M 7s 2024-03-08T20:31:40.789 INFO:tasks.workunit.client.1.smithi144.stderr: 10600K .......... .......... .......... .......... .......... 7% 22.8M 7s 2024-03-08T20:31:40.790 INFO:tasks.workunit.client.1.smithi144.stderr: 10650K .......... .......... .......... .......... .......... 7% 38.0M 7s 2024-03-08T20:31:40.792 INFO:tasks.workunit.client.1.smithi144.stderr: 10700K .......... .......... .......... .......... .......... 7% 26.5M 7s 2024-03-08T20:31:40.793 INFO:tasks.workunit.client.1.smithi144.stderr: 10750K .......... .......... .......... .......... .......... 7% 29.0M 7s 2024-03-08T20:31:40.795 INFO:tasks.workunit.client.1.smithi144.stderr: 10800K .......... .......... .......... .......... .......... 7% 27.4M 7s 2024-03-08T20:31:40.801 INFO:tasks.workunit.client.1.smithi144.stderr: 10850K .......... .......... .......... .......... .......... 8% 8.38M 7s 2024-03-08T20:31:40.803 INFO:tasks.workunit.client.1.smithi144.stderr: 10900K .......... .......... .......... .......... .......... 8% 24.3M 7s 2024-03-08T20:31:40.804 INFO:tasks.workunit.client.1.smithi144.stderr: 10950K .......... .......... .......... .......... .......... 8% 39.2M 7s 2024-03-08T20:31:40.806 INFO:tasks.workunit.client.1.smithi144.stderr: 11000K .......... .......... .......... .......... .......... 8% 37.7M 7s 2024-03-08T20:31:40.807 INFO:tasks.workunit.client.1.smithi144.stderr: 11050K .......... .......... .......... .......... .......... 8% 45.1M 7s 2024-03-08T20:31:40.808 INFO:tasks.workunit.client.1.smithi144.stderr: 11100K .......... .......... .......... .......... .......... 8% 47.5M 7s 2024-03-08T20:31:40.810 INFO:tasks.workunit.client.1.smithi144.stderr: 11150K .......... .......... .......... .......... .......... 8% 45.8M 7s 2024-03-08T20:31:40.812 INFO:tasks.workunit.client.1.smithi144.stderr: 11200K .......... .......... .......... .......... .......... 8% 41.3M 7s 2024-03-08T20:31:40.812 INFO:tasks.workunit.client.1.smithi144.stderr: 11250K .......... .......... .......... .......... .......... 8% 46.0M 7s 2024-03-08T20:31:40.813 INFO:tasks.workunit.client.1.smithi144.stderr: 11300K .......... .......... .......... .......... .......... 8% 50.6M 7s 2024-03-08T20:31:40.815 INFO:tasks.workunit.client.1.smithi144.stderr: 11350K .......... .......... .......... .......... .......... 8% 26.4M 7s 2024-03-08T20:31:40.815 INFO:tasks.workunit.client.1.smithi144.stderr: 11400K .......... .......... .......... .......... .......... 8% 39.6M 7s 2024-03-08T20:31:40.817 INFO:tasks.workunit.client.1.smithi144.stderr: 11450K .......... .......... .......... .......... .......... 8% 27.3M 7s 2024-03-08T20:31:40.819 INFO:tasks.workunit.client.1.smithi144.stderr: 11500K .......... .......... .......... .......... .......... 8% 25.0M 7s 2024-03-08T20:31:40.821 INFO:tasks.workunit.client.1.smithi144.stderr: 11550K .......... .......... .......... .......... .......... 8% 25.9M 7s 2024-03-08T20:31:40.822 INFO:tasks.workunit.client.1.smithi144.stderr: 11600K .......... .......... .......... .......... .......... 8% 28.4M 7s 2024-03-08T20:31:40.823 INFO:tasks.workunit.client.0.smithi118.stdout:checking for gawk... gawk 2024-03-08T20:31:40.824 INFO:tasks.workunit.client.1.smithi144.stderr: 11650K .......... .......... .......... .......... .......... 8% 53.5M 7s 2024-03-08T20:31:40.825 INFO:tasks.workunit.client.1.smithi144.stderr: 11700K .......... .......... .......... .......... .......... 8% 24.7M 7s 2024-03-08T20:31:40.827 INFO:tasks.workunit.client.1.smithi144.stderr: 11750K .......... .......... .......... .......... .......... 8% 31.4M 7s 2024-03-08T20:31:40.828 INFO:tasks.workunit.client.1.smithi144.stderr: 11800K .......... .......... .......... .......... .......... 8% 32.1M 7s 2024-03-08T20:31:40.831 INFO:tasks.workunit.client.1.smithi144.stderr: 11850K .......... .......... .......... .......... .......... 8% 21.5M 7s 2024-03-08T20:31:40.832 INFO:tasks.workunit.client.1.smithi144.stderr: 11900K .......... .......... .......... .......... .......... 8% 48.3M 7s 2024-03-08T20:31:40.834 INFO:tasks.workunit.client.1.smithi144.stderr: 11950K .......... .......... .......... .......... .......... 8% 23.3M 7s 2024-03-08T20:31:40.836 INFO:tasks.workunit.client.1.smithi144.stderr: 12000K .......... .......... .......... .......... .......... 8% 26.5M 7s 2024-03-08T20:31:40.838 INFO:tasks.workunit.client.1.smithi144.stderr: 12050K .......... .......... .......... .......... .......... 8% 33.6M 7s 2024-03-08T20:31:40.842 INFO:tasks.workunit.client.1.smithi144.stderr: 12100K .......... .......... .......... .......... .......... 8% 23.8M 7s 2024-03-08T20:31:40.842 INFO:tasks.workunit.client.1.smithi144.stderr: 12150K .......... .......... .......... .......... .......... 8% 59.5M 7s 2024-03-08T20:31:40.842 INFO:tasks.workunit.client.1.smithi144.stderr: 12200K .......... .......... .......... .......... .......... 9% 24.1M 7s 2024-03-08T20:31:40.844 INFO:tasks.workunit.client.1.smithi144.stderr: 12250K .......... .......... .......... .......... .......... 9% 28.7M 7s 2024-03-08T20:31:40.846 INFO:tasks.workunit.client.1.smithi144.stderr: 12300K .......... .......... .......... .......... .......... 9% 24.3M 7s 2024-03-08T20:31:40.848 INFO:tasks.workunit.client.1.smithi144.stderr: 12350K .......... .......... .......... .......... .......... 9% 28.3M 7s 2024-03-08T20:31:40.850 INFO:tasks.workunit.client.1.smithi144.stderr: 12400K .......... .......... .......... .......... .......... 9% 28.3M 7s 2024-03-08T20:31:40.851 INFO:tasks.workunit.client.1.smithi144.stderr: 12450K .......... .......... .......... .......... .......... 9% 31.1M 7s 2024-03-08T20:31:40.853 INFO:tasks.workunit.client.1.smithi144.stderr: 12500K .......... .......... .......... .......... .......... 9% 29.8M 7s 2024-03-08T20:31:40.854 INFO:tasks.workunit.client.1.smithi144.stderr: 12550K .......... .......... .......... .......... .......... 9% 28.1M 7s 2024-03-08T20:31:40.856 INFO:tasks.workunit.client.1.smithi144.stderr: 12600K .......... .......... .......... .......... .......... 9% 28.0M 7s 2024-03-08T20:31:40.858 INFO:tasks.workunit.client.1.smithi144.stderr: 12650K .......... .......... .......... .......... .......... 9% 33.4M 7s 2024-03-08T20:31:40.859 INFO:tasks.workunit.client.1.smithi144.stderr: 12700K .......... .......... .......... .......... .......... 9% 29.6M 7s 2024-03-08T20:31:40.861 INFO:tasks.workunit.client.1.smithi144.stderr: 12750K .......... .......... .......... .......... .......... 9% 27.0M 7s 2024-03-08T20:31:40.863 INFO:tasks.workunit.client.1.smithi144.stderr: 12800K .......... .......... .......... .......... .......... 9% 28.8M 7s 2024-03-08T20:31:40.864 INFO:tasks.workunit.client.1.smithi144.stderr: 12850K .......... .......... .......... .......... .......... 9% 33.7M 7s 2024-03-08T20:31:40.866 INFO:tasks.workunit.client.1.smithi144.stderr: 12900K .......... .......... .......... .......... .......... 9% 28.7M 7s 2024-03-08T20:31:40.868 INFO:tasks.workunit.client.1.smithi144.stderr: 12950K .......... .......... .......... .......... .......... 9% 25.4M 7s 2024-03-08T20:31:40.869 INFO:tasks.workunit.client.1.smithi144.stderr: 13000K .......... .......... .......... .......... .......... 9% 28.9M 7s 2024-03-08T20:31:40.870 INFO:tasks.workunit.client.1.smithi144.stderr: 13050K .......... .......... .......... .......... .......... 9% 35.3M 7s 2024-03-08T20:31:40.872 INFO:tasks.workunit.client.1.smithi144.stderr: 13100K .......... .......... .......... .......... .......... 9% 35.1M 7s 2024-03-08T20:31:40.876 INFO:tasks.workunit.client.1.smithi144.stderr: 13150K .......... .......... .......... .......... .......... 9% 26.2M 7s 2024-03-08T20:31:40.876 INFO:tasks.workunit.client.1.smithi144.stderr: 13200K .......... .......... .......... .......... .......... 9% 28.9M 7s 2024-03-08T20:31:40.878 INFO:tasks.workunit.client.1.smithi144.stderr: 13250K .......... .......... .......... .......... .......... 9% 25.8M 7s 2024-03-08T20:31:40.880 INFO:tasks.workunit.client.1.smithi144.stderr: 13300K .......... .......... .......... .......... .......... 9% 29.1M 7s 2024-03-08T20:31:40.882 INFO:tasks.workunit.client.1.smithi144.stderr: 13350K .......... .......... .......... .......... .......... 9% 27.5M 7s 2024-03-08T20:31:40.884 INFO:tasks.workunit.client.1.smithi144.stderr: 13400K .......... .......... .......... .......... .......... 9% 44.6M 7s 2024-03-08T20:31:40.884 INFO:tasks.workunit.client.1.smithi144.stderr: 13450K .......... .......... .......... .......... .......... 9% 26.4M 7s 2024-03-08T20:31:40.886 INFO:tasks.workunit.client.1.smithi144.stderr: 13500K .......... .......... .......... .......... .......... 9% 29.0M 7s 2024-03-08T20:31:40.888 INFO:tasks.workunit.client.1.smithi144.stderr: 13550K .......... .......... .......... .......... .......... 10% 24.9M 7s 2024-03-08T20:31:40.891 INFO:tasks.workunit.client.1.smithi144.stderr: 13600K .......... .......... .......... .......... .......... 10% 25.1M 7s 2024-03-08T20:31:40.892 INFO:tasks.workunit.client.1.smithi144.stderr: 13650K .......... .......... .......... .......... .......... 10% 27.2M 7s 2024-03-08T20:31:40.892 INFO:tasks.workunit.client.1.smithi144.stderr: 13700K .......... .......... .......... .......... .......... 10% 49.6M 6s 2024-03-08T20:31:40.894 INFO:tasks.workunit.client.1.smithi144.stderr: 13750K .......... .......... .......... .......... .......... 10% 31.5M 6s 2024-03-08T20:31:40.895 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether make sets $(MAKE)... yes 2024-03-08T20:31:40.897 INFO:tasks.workunit.client.1.smithi144.stderr: 13800K .......... .......... .......... .......... .......... 10% 20.9M 6s 2024-03-08T20:31:40.899 INFO:tasks.workunit.client.1.smithi144.stderr: 13850K .......... .......... .......... .......... .......... 10% 26.2M 6s 2024-03-08T20:31:40.901 INFO:tasks.workunit.client.1.smithi144.stderr: 13900K .......... .......... .......... .......... .......... 10% 24.9M 6s 2024-03-08T20:31:40.901 INFO:tasks.workunit.client.1.smithi144.stderr: 13950K .......... .......... .......... .......... .......... 10% 49.1M 6s 2024-03-08T20:31:40.903 INFO:tasks.workunit.client.1.smithi144.stderr: 14000K .......... .......... .......... .......... .......... 10% 24.4M 6s 2024-03-08T20:31:40.905 INFO:tasks.workunit.client.1.smithi144.stderr: 14050K .......... .......... .......... .......... .......... 10% 34.0M 6s 2024-03-08T20:31:40.907 INFO:tasks.workunit.client.1.smithi144.stderr: 14100K .......... .......... .......... .......... .......... 10% 23.1M 6s 2024-03-08T20:31:40.908 INFO:tasks.workunit.client.1.smithi144.stderr: 14150K .......... .......... .......... .......... .......... 10% 34.6M 6s 2024-03-08T20:31:40.910 INFO:tasks.workunit.client.1.smithi144.stderr: 14200K .......... .......... .......... .......... .......... 10% 26.6M 6s 2024-03-08T20:31:40.912 INFO:tasks.workunit.client.1.smithi144.stderr: 14250K .......... .......... .......... .......... .......... 10% 21.1M 6s 2024-03-08T20:31:40.915 INFO:tasks.workunit.client.1.smithi144.stderr: 14300K .......... .......... .......... .......... .......... 10% 21.3M 6s 2024-03-08T20:31:40.916 INFO:tasks.workunit.client.1.smithi144.stderr: 14350K .......... .......... .......... .......... .......... 10% 42.5M 6s 2024-03-08T20:31:40.918 INFO:tasks.workunit.client.1.smithi144.stderr: 14400K .......... .......... .......... .......... .......... 10% 26.2M 6s 2024-03-08T20:31:40.919 INFO:tasks.workunit.client.1.smithi144.stderr: 14450K .......... .......... .......... .......... .......... 10% 49.0M 6s 2024-03-08T20:31:40.921 INFO:tasks.workunit.client.1.smithi144.stderr: 14500K .......... .......... .......... .......... .......... 10% 22.7M 6s 2024-03-08T20:31:40.923 INFO:tasks.workunit.client.1.smithi144.stderr: 14550K .......... .......... .......... .......... .......... 10% 31.4M 6s 2024-03-08T20:31:40.923 INFO:tasks.workunit.client.1.smithi144.stderr: 14600K .......... .......... .......... .......... .......... 10% 32.0M 6s 2024-03-08T20:31:40.926 INFO:tasks.workunit.client.1.smithi144.stderr: 14650K .......... .......... .......... .......... .......... 10% 22.2M 6s 2024-03-08T20:31:40.927 INFO:tasks.workunit.client.1.smithi144.stderr: 14700K .......... .......... .......... .......... .......... 10% 45.7M 6s 2024-03-08T20:31:40.929 INFO:tasks.workunit.client.1.smithi144.stderr: 14750K .......... .......... .......... .......... .......... 10% 25.2M 6s 2024-03-08T20:31:40.931 INFO:tasks.workunit.client.1.smithi144.stderr: 14800K .......... .......... .......... .......... .......... 10% 29.5M 6s 2024-03-08T20:31:40.933 INFO:tasks.workunit.client.1.smithi144.stderr: 14850K .......... .......... .......... .......... .......... 10% 28.6M 6s 2024-03-08T20:31:40.936 INFO:tasks.workunit.client.1.smithi144.stderr: 14900K .......... .......... .......... .......... .......... 11% 23.8M 6s 2024-03-08T20:31:40.936 INFO:tasks.workunit.client.1.smithi144.stderr: 14950K .......... .......... .......... .......... .......... 11% 46.3M 6s 2024-03-08T20:31:40.937 INFO:tasks.workunit.client.1.smithi144.stderr: 15000K .......... .......... .......... .......... .......... 11% 29.4M 6s 2024-03-08T20:31:40.940 INFO:tasks.workunit.client.1.smithi144.stderr: 15050K .......... .......... .......... .......... .......... 11% 26.8M 6s 2024-03-08T20:31:40.942 INFO:tasks.workunit.client.1.smithi144.stderr: 15100K .......... .......... .......... .......... .......... 11% 23.2M 6s 2024-03-08T20:31:40.944 INFO:tasks.workunit.client.1.smithi144.stderr: 15150K .......... .......... .......... .......... .......... 11% 27.7M 6s 2024-03-08T20:31:40.944 INFO:tasks.workunit.client.1.smithi144.stderr: 15200K .......... .......... .......... .......... .......... 11% 44.1M 6s 2024-03-08T20:31:40.946 INFO:tasks.workunit.client.1.smithi144.stderr: 15250K .......... .......... .......... .......... .......... 11% 25.4M 6s 2024-03-08T20:31:40.946 INFO:tasks.workunit.client.0.smithi118.stdout:checking for gcc... gcc 2024-03-08T20:31:40.948 INFO:tasks.workunit.client.1.smithi144.stderr: 15300K .......... .......... .......... .......... .......... 11% 33.1M 6s 2024-03-08T20:31:40.950 INFO:tasks.workunit.client.1.smithi144.stderr: 15350K .......... .......... .......... .......... .......... 11% 24.1M 6s 2024-03-08T20:31:40.958 INFO:tasks.workunit.client.1.smithi144.stderr: 15400K .......... .......... .......... .......... .......... 11% 25.6M 6s 2024-03-08T20:31:40.959 INFO:tasks.workunit.client.1.smithi144.stderr: 15450K .......... .......... .......... .......... .......... 11% 46.9M 6s 2024-03-08T20:31:40.959 INFO:tasks.workunit.client.1.smithi144.stderr: 15500K .......... .......... .......... .......... .......... 11% 26.6M 6s 2024-03-08T20:31:40.959 INFO:tasks.workunit.client.1.smithi144.stderr: 15550K .......... .......... .......... .......... .......... 11% 30.5M 6s 2024-03-08T20:31:40.959 INFO:tasks.workunit.client.1.smithi144.stderr: 15600K .......... .......... .......... .......... .......... 11% 21.6M 6s 2024-03-08T20:31:40.960 INFO:tasks.workunit.client.1.smithi144.stderr: 15650K .......... .......... .......... .......... .......... 11% 31.4M 6s 2024-03-08T20:31:40.960 INFO:tasks.workunit.client.1.smithi144.stderr: 15700K .......... .......... .......... .......... .......... 11% 41.0M 6s 2024-03-08T20:31:40.963 INFO:tasks.workunit.client.1.smithi144.stderr: 15750K .......... .......... .......... .......... .......... 11% 22.8M 6s 2024-03-08T20:31:40.966 INFO:tasks.workunit.client.1.smithi144.stderr: 15800K .......... .......... .......... .......... .......... 11% 28.8M 6s 2024-03-08T20:31:40.966 INFO:tasks.workunit.client.1.smithi144.stderr: 15850K .......... .......... .......... .......... .......... 11% 34.6M 6s 2024-03-08T20:31:40.969 INFO:tasks.workunit.client.1.smithi144.stderr: 15900K .......... .......... .......... .......... .......... 11% 25.5M 6s 2024-03-08T20:31:40.969 INFO:tasks.workunit.client.1.smithi144.stderr: 15950K .......... .......... .......... .......... .......... 11% 43.0M 6s 2024-03-08T20:31:40.971 INFO:tasks.workunit.client.1.smithi144.stderr: 16000K .......... .......... .......... .......... .......... 11% 24.6M 6s 2024-03-08T20:31:40.973 INFO:tasks.workunit.client.1.smithi144.stderr: 16050K .......... .......... .......... .......... .......... 11% 31.2M 6s 2024-03-08T20:31:40.976 INFO:tasks.workunit.client.1.smithi144.stderr: 16100K .......... .......... .......... .......... .......... 11% 25.8M 6s 2024-03-08T20:31:40.978 INFO:tasks.workunit.client.1.smithi144.stderr: 16150K .......... .......... .......... .......... .......... 11% 27.2M 6s 2024-03-08T20:31:40.978 INFO:tasks.workunit.client.1.smithi144.stderr: 16200K .......... .......... .......... .......... .......... 11% 53.7M 6s 2024-03-08T20:31:40.979 INFO:tasks.workunit.client.1.smithi144.stderr: 16250K .......... .......... .......... .......... .......... 12% 22.6M 6s 2024-03-08T20:31:40.981 INFO:tasks.workunit.client.1.smithi144.stderr: 16300K .......... .......... .......... .......... .......... 12% 33.0M 6s 2024-03-08T20:31:40.984 INFO:tasks.workunit.client.1.smithi144.stderr: 16350K .......... .......... .......... .......... .......... 12% 24.7M 6s 2024-03-08T20:31:40.990 INFO:tasks.workunit.client.1.smithi144.stderr: 16400K .......... .......... .......... .......... .......... 12% 26.9M 6s 2024-03-08T20:31:40.990 INFO:tasks.workunit.client.1.smithi144.stderr: 16450K .......... .......... .......... .......... .......... 12% 53.1M 6s 2024-03-08T20:31:40.990 INFO:tasks.workunit.client.1.smithi144.stderr: 16500K .......... .......... .......... .......... .......... 12% 23.4M 6s 2024-03-08T20:31:40.991 INFO:tasks.workunit.client.1.smithi144.stderr: 16550K .......... .......... .......... .......... .......... 12% 28.3M 6s 2024-03-08T20:31:40.995 INFO:tasks.workunit.client.1.smithi144.stderr: 16600K .......... .......... .......... .......... .......... 12% 25.6M 6s 2024-03-08T20:31:40.995 INFO:tasks.workunit.client.1.smithi144.stderr: 16650K .......... .......... .......... .......... .......... 12% 29.1M 6s 2024-03-08T20:31:40.995 INFO:tasks.workunit.client.1.smithi144.stderr: 16700K .......... .......... .......... .......... .......... 12% 41.4M 6s 2024-03-08T20:31:40.997 INFO:tasks.workunit.client.1.smithi144.stderr: 16750K .......... .......... .......... .......... .......... 12% 23.7M 6s 2024-03-08T20:31:40.998 INFO:tasks.workunit.client.1.smithi144.stderr: 16800K .......... .......... .......... .......... .......... 12% 27.1M 6s 2024-03-08T20:31:41.000 INFO:tasks.workunit.client.1.smithi144.stderr: 16850K .......... .......... .......... .......... .......... 12% 27.0M 6s 2024-03-08T20:31:41.002 INFO:tasks.workunit.client.1.smithi144.stderr: 16900K .......... .......... .......... .......... .......... 12% 29.2M 6s 2024-03-08T20:31:41.003 INFO:tasks.workunit.client.1.smithi144.stderr: 16950K .......... .......... .......... .......... .......... 12% 38.5M 6s 2024-03-08T20:31:41.005 INFO:tasks.workunit.client.1.smithi144.stderr: 17000K .......... .......... .......... .......... .......... 12% 24.6M 6s 2024-03-08T20:31:41.007 INFO:tasks.workunit.client.1.smithi144.stderr: 17050K .......... .......... .......... .......... .......... 12% 32.8M 6s 2024-03-08T20:31:41.008 INFO:tasks.workunit.client.1.smithi144.stderr: 17100K .......... .......... .......... .......... .......... 12% 32.9M 6s 2024-03-08T20:31:41.011 INFO:tasks.workunit.client.1.smithi144.stderr: 17150K .......... .......... .......... .......... .......... 12% 23.3M 6s 2024-03-08T20:31:41.011 INFO:tasks.workunit.client.1.smithi144.stderr: 17200K .......... .......... .......... .......... .......... 12% 40.8M 6s 2024-03-08T20:31:41.013 INFO:tasks.workunit.client.1.smithi144.stderr: 17250K .......... .......... .......... .......... .......... 12% 29.5M 6s 2024-03-08T20:31:41.015 INFO:tasks.workunit.client.1.smithi144.stderr: 17300K .......... .......... .......... .......... .......... 12% 29.2M 6s 2024-03-08T20:31:41.017 INFO:tasks.workunit.client.1.smithi144.stderr: 17350K .......... .......... .......... .......... .......... 12% 24.1M 6s 2024-03-08T20:31:41.019 INFO:tasks.workunit.client.1.smithi144.stderr: 17400K .......... .......... .......... .......... .......... 12% 25.1M 6s 2024-03-08T20:31:41.019 INFO:tasks.workunit.client.1.smithi144.stderr: 17450K .......... .......... .......... .......... .......... 12% 49.4M 6s 2024-03-08T20:31:41.021 INFO:tasks.workunit.client.1.smithi144.stderr: 17500K .......... .......... .......... .......... .......... 12% 26.1M 6s 2024-03-08T20:31:41.023 INFO:tasks.workunit.client.1.smithi144.stderr: 17550K .......... .......... .......... .......... .......... 12% 30.9M 6s 2024-03-08T20:31:41.025 INFO:tasks.workunit.client.1.smithi144.stderr: 17600K .......... .......... .......... .......... .......... 13% 23.9M 6s 2024-03-08T20:31:41.029 INFO:tasks.workunit.client.1.smithi144.stderr: 17650K .......... .......... .......... .......... .......... 13% 25.7M 6s 2024-03-08T20:31:41.029 INFO:tasks.workunit.client.1.smithi144.stderr: 17700K .......... .......... .......... .......... .......... 13% 53.5M 6s 2024-03-08T20:31:41.030 INFO:tasks.workunit.client.1.smithi144.stderr: 17750K .......... .......... .......... .......... .......... 13% 23.4M 6s 2024-03-08T20:31:41.032 INFO:tasks.workunit.client.1.smithi144.stderr: 17800K .......... .......... .......... .......... .......... 13% 24.8M 6s 2024-03-08T20:31:41.033 INFO:tasks.workunit.client.1.smithi144.stderr: 17850K .......... .......... .......... .......... .......... 13% 32.3M 6s 2024-03-08T20:31:41.035 INFO:tasks.workunit.client.1.smithi144.stderr: 17900K .......... .......... .......... .......... .......... 13% 25.3M 6s 2024-03-08T20:31:41.036 INFO:tasks.workunit.client.1.smithi144.stderr: 17950K .......... .......... .......... .......... .......... 13% 41.0M 6s 2024-03-08T20:31:41.038 INFO:tasks.workunit.client.1.smithi144.stderr: 18000K .......... .......... .......... .......... .......... 13% 26.6M 6s 2024-03-08T20:31:41.040 INFO:tasks.workunit.client.1.smithi144.stderr: 18050K .......... .......... .......... .......... .......... 13% 24.8M 6s 2024-03-08T20:31:41.042 INFO:tasks.workunit.client.1.smithi144.stderr: 18100K .......... .......... .......... .......... .......... 13% 28.8M 6s 2024-03-08T20:31:41.043 INFO:tasks.workunit.client.1.smithi144.stderr: 18150K .......... .......... .......... .......... .......... 13% 32.6M 6s 2024-03-08T20:31:41.045 INFO:tasks.workunit.client.1.smithi144.stderr: 18200K .......... .......... .......... .......... .......... 13% 22.5M 6s 2024-03-08T20:31:41.047 INFO:tasks.workunit.client.1.smithi144.stderr: 18250K .......... .......... .......... .......... .......... 13% 28.8M 6s 2024-03-08T20:31:41.049 INFO:tasks.workunit.client.1.smithi144.stderr: 18300K .......... .......... .......... .......... .......... 13% 27.1M 6s 2024-03-08T20:31:41.051 INFO:tasks.workunit.client.1.smithi144.stderr: 18350K .......... .......... .......... .......... .......... 13% 28.7M 6s 2024-03-08T20:31:41.052 INFO:tasks.workunit.client.1.smithi144.stderr: 18400K .......... .......... .......... .......... .......... 13% 38.2M 6s 2024-03-08T20:31:41.055 INFO:tasks.workunit.client.1.smithi144.stderr: 18450K .......... .......... .......... .......... .......... 13% 25.0M 6s 2024-03-08T20:31:41.055 INFO:tasks.workunit.client.1.smithi144.stderr: 18500K .......... .......... .......... .......... .......... 13% 33.3M 6s 2024-03-08T20:31:41.058 INFO:tasks.workunit.client.1.smithi144.stderr: 18550K .......... .......... .......... .......... .......... 13% 24.0M 6s 2024-03-08T20:31:41.059 INFO:tasks.workunit.client.1.smithi144.stderr: 18600K .......... .......... .......... .......... .......... 13% 27.4M 6s 2024-03-08T20:31:41.062 INFO:tasks.workunit.client.1.smithi144.stderr: 18650K .......... .......... .......... .......... .......... 13% 28.4M 6s 2024-03-08T20:31:41.063 INFO:tasks.workunit.client.1.smithi144.stderr: 18700K .......... .......... .......... .......... .......... 13% 26.8M 6s 2024-03-08T20:31:41.064 INFO:tasks.workunit.client.1.smithi144.stderr: 18750K .......... .......... .......... .......... .......... 13% 45.4M 6s 2024-03-08T20:31:41.066 INFO:tasks.workunit.client.1.smithi144.stderr: 18800K .......... .......... .......... .......... .......... 13% 27.8M 6s 2024-03-08T20:31:41.068 INFO:tasks.workunit.client.1.smithi144.stderr: 18850K .......... .......... .......... .......... .......... 13% 25.3M 6s 2024-03-08T20:31:41.070 INFO:tasks.workunit.client.1.smithi144.stderr: 18900K .......... .......... .......... .......... .......... 13% 25.6M 6s 2024-03-08T20:31:41.072 INFO:tasks.workunit.client.1.smithi144.stderr: 18950K .......... .......... .......... .......... .......... 13% 23.2M 6s 2024-03-08T20:31:41.072 INFO:tasks.workunit.client.1.smithi144.stderr: 19000K .......... .......... .......... .......... .......... 14% 60.3M 6s 2024-03-08T20:31:41.074 INFO:tasks.workunit.client.1.smithi144.stderr: 19050K .......... .......... .......... .......... .......... 14% 25.1M 6s 2024-03-08T20:31:41.076 INFO:tasks.workunit.client.1.smithi144.stderr: 19100K .......... .......... .......... .......... .......... 14% 30.0M 6s 2024-03-08T20:31:41.078 INFO:tasks.workunit.client.1.smithi144.stderr: 19150K .......... .......... .......... .......... .......... 14% 25.5M 6s 2024-03-08T20:31:41.080 INFO:tasks.workunit.client.1.smithi144.stderr: 19200K .......... .......... .......... .......... .......... 14% 24.5M 6s 2024-03-08T20:31:41.081 INFO:tasks.workunit.client.1.smithi144.stderr: 19250K .......... .......... .......... .......... .......... 14% 49.6M 6s 2024-03-08T20:31:41.091 INFO:tasks.workunit.client.1.smithi144.stderr: 19300K .......... .......... .......... .......... .......... 14% 10.6M 6s 2024-03-08T20:31:41.091 INFO:tasks.workunit.client.1.smithi144.stderr: 19350K .......... .......... .......... .......... .......... 14% 64.6M 6s 2024-03-08T20:31:41.091 INFO:tasks.workunit.client.1.smithi144.stderr: 19400K .......... .......... .......... .......... .......... 14% 74.4M 6s 2024-03-08T20:31:41.092 INFO:tasks.workunit.client.1.smithi144.stderr: 19450K .......... .......... .......... .......... .......... 14% 50.6M 6s 2024-03-08T20:31:41.092 INFO:tasks.workunit.client.1.smithi144.stderr: 19500K .......... .......... .......... .......... .......... 14% 26.2M 6s 2024-03-08T20:31:41.092 INFO:tasks.workunit.client.1.smithi144.stderr: 19550K .......... .......... .......... .......... .......... 14% 25.4M 6s 2024-03-08T20:31:41.093 INFO:tasks.workunit.client.1.smithi144.stderr: 19600K .......... .......... .......... .......... .......... 14% 35.9M 6s 2024-03-08T20:31:41.094 INFO:tasks.workunit.client.1.smithi144.stderr: 19650K .......... .......... .......... .......... .......... 14% 32.8M 6s 2024-03-08T20:31:41.097 INFO:tasks.workunit.client.1.smithi144.stderr: 19700K .......... .......... .......... .......... .......... 14% 19.2M 6s 2024-03-08T20:31:41.098 INFO:tasks.workunit.client.1.smithi144.stderr: 19750K .......... .......... .......... .......... .......... 14% 53.7M 5s 2024-03-08T20:31:41.102 INFO:tasks.workunit.client.1.smithi144.stderr: 19800K .......... .......... .......... .......... .......... 14% 21.9M 5s 2024-03-08T20:31:41.102 INFO:tasks.workunit.client.1.smithi144.stderr: 19850K .......... .......... .......... .......... .......... 14% 38.7M 5s 2024-03-08T20:31:41.106 INFO:tasks.workunit.client.1.smithi144.stderr: 19900K .......... .......... .......... .......... .......... 14% 25.1M 5s 2024-03-08T20:31:41.106 INFO:tasks.workunit.client.1.smithi144.stderr: 19950K .......... .......... .......... .......... .......... 14% 24.5M 5s 2024-03-08T20:31:41.107 INFO:tasks.workunit.client.1.smithi144.stderr: 20000K .......... .......... .......... .......... .......... 14% 35.0M 5s 2024-03-08T20:31:41.111 INFO:tasks.workunit.client.1.smithi144.stderr: 20050K .......... .......... .......... .......... .......... 14% 24.6M 5s 2024-03-08T20:31:41.112 INFO:tasks.workunit.client.1.smithi144.stderr: 20100K .......... .......... .......... .......... .......... 14% 28.4M 5s 2024-03-08T20:31:41.115 INFO:tasks.workunit.client.1.smithi144.stderr: 20150K .......... .......... .......... .......... .......... 14% 25.0M 5s 2024-03-08T20:31:41.116 INFO:tasks.workunit.client.1.smithi144.stderr: 20200K .......... .......... .......... .......... .......... 14% 26.4M 5s 2024-03-08T20:31:41.116 INFO:tasks.workunit.client.1.smithi144.stderr: 20250K .......... .......... .......... .......... .......... 14% 53.5M 5s 2024-03-08T20:31:41.117 INFO:tasks.workunit.client.1.smithi144.stderr: 20300K .......... .......... .......... .......... .......... 14% 26.4M 5s 2024-03-08T20:31:41.119 INFO:tasks.workunit.client.1.smithi144.stderr: 20350K .......... .......... .......... .......... .......... 15% 27.6M 5s 2024-03-08T20:31:41.121 INFO:tasks.workunit.client.1.smithi144.stderr: 20400K .......... .......... .......... .......... .......... 15% 23.4M 5s 2024-03-08T20:31:41.122 INFO:tasks.workunit.client.1.smithi144.stderr: 20450K .......... .......... .......... .......... .......... 15% 28.9M 5s 2024-03-08T20:31:41.123 INFO:tasks.workunit.client.1.smithi144.stderr: 20500K .......... .......... .......... .......... .......... 15% 47.1M 5s 2024-03-08T20:31:41.126 INFO:tasks.workunit.client.1.smithi144.stderr: 20550K .......... .......... .......... .......... .......... 15% 23.3M 5s 2024-03-08T20:31:41.128 INFO:tasks.workunit.client.1.smithi144.stderr: 20600K .......... .......... .......... .......... .......... 15% 34.3M 5s 2024-03-08T20:31:41.128 INFO:tasks.workunit.client.1.smithi144.stderr: 20650K .......... .......... .......... .......... .......... 15% 30.2M 5s 2024-03-08T20:31:41.130 INFO:tasks.workunit.client.1.smithi144.stderr: 20700K .......... .......... .......... .......... .......... 15% 32.5M 5s 2024-03-08T20:31:41.132 INFO:tasks.workunit.client.1.smithi144.stderr: 20750K .......... .......... .......... .......... .......... 15% 30.9M 5s 2024-03-08T20:31:41.134 INFO:tasks.workunit.client.1.smithi144.stderr: 20800K .......... .......... .......... .......... .......... 15% 23.9M 5s 2024-03-08T20:31:41.137 INFO:tasks.workunit.client.1.smithi144.stderr: 20850K .......... .......... .......... .......... .......... 15% 22.1M 5s 2024-03-08T20:31:41.137 INFO:tasks.workunit.client.1.smithi144.stderr: 20900K .......... .......... .......... .......... .......... 15% 56.4M 5s 2024-03-08T20:31:41.139 INFO:tasks.workunit.client.1.smithi144.stderr: 20950K .......... .......... .......... .......... .......... 15% 21.2M 5s 2024-03-08T20:31:41.140 INFO:tasks.workunit.client.1.smithi144.stderr: 21000K .......... .......... .......... .......... .......... 15% 37.2M 5s 2024-03-08T20:31:41.142 INFO:tasks.workunit.client.1.smithi144.stderr: 21050K .......... .......... .......... .......... .......... 15% 29.2M 5s 2024-03-08T20:31:41.144 INFO:tasks.workunit.client.1.smithi144.stderr: 21100K .......... .......... .......... .......... .......... 15% 30.1M 5s 2024-03-08T20:31:41.146 INFO:tasks.workunit.client.1.smithi144.stderr: 21150K .......... .......... .......... .......... .......... 15% 24.7M 5s 2024-03-08T20:31:41.149 INFO:tasks.workunit.client.1.smithi144.stderr: 21200K .......... .......... .......... .......... .......... 15% 26.4M 5s 2024-03-08T20:31:41.149 INFO:tasks.workunit.client.1.smithi144.stderr: 21250K .......... .......... .......... .......... .......... 15% 42.9M 5s 2024-03-08T20:31:41.150 INFO:tasks.workunit.client.1.smithi144.stderr: 21300K .......... .......... .......... .......... .......... 15% 24.7M 5s 2024-03-08T20:31:41.152 INFO:tasks.workunit.client.1.smithi144.stderr: 21350K .......... .......... .......... .......... .......... 15% 35.2M 5s 2024-03-08T20:31:41.154 INFO:tasks.workunit.client.1.smithi144.stderr: 21400K .......... .......... .......... .......... .......... 15% 22.9M 5s 2024-03-08T20:31:41.157 INFO:tasks.workunit.client.1.smithi144.stderr: 21450K .......... .......... .......... .......... .......... 15% 27.1M 5s 2024-03-08T20:31:41.157 INFO:tasks.workunit.client.1.smithi144.stderr: 21500K .......... .......... .......... .......... .......... 15% 48.7M 5s 2024-03-08T20:31:41.159 INFO:tasks.workunit.client.1.smithi144.stderr: 21550K .......... .......... .......... .......... .......... 15% 27.2M 5s 2024-03-08T20:31:41.161 INFO:tasks.workunit.client.1.smithi144.stderr: 21600K .......... .......... .......... .......... .......... 15% 24.5M 5s 2024-03-08T20:31:41.163 INFO:tasks.workunit.client.1.smithi144.stderr: 21650K .......... .......... .......... .......... .......... 15% 24.9M 5s 2024-03-08T20:31:41.164 INFO:tasks.workunit.client.1.smithi144.stderr: 21700K .......... .......... .......... .......... .......... 16% 29.4M 5s 2024-03-08T20:31:41.165 INFO:tasks.workunit.client.1.smithi144.stderr: 21750K .......... .......... .......... .......... .......... 16% 40.2M 5s 2024-03-08T20:31:41.168 INFO:tasks.workunit.client.1.smithi144.stderr: 21800K .......... .......... .......... .......... .......... 16% 23.2M 5s 2024-03-08T20:31:41.169 INFO:tasks.workunit.client.1.smithi144.stderr: 21850K .......... .......... .......... .......... .......... 16% 33.4M 5s 2024-03-08T20:31:41.172 INFO:tasks.workunit.client.1.smithi144.stderr: 21900K .......... .......... .......... .......... .......... 16% 25.8M 5s 2024-03-08T20:31:41.174 INFO:tasks.workunit.client.1.smithi144.stderr: 21950K .......... .......... .......... .......... .......... 16% 22.3M 5s 2024-03-08T20:31:41.175 INFO:tasks.workunit.client.1.smithi144.stderr: 22000K .......... .......... .......... .......... .......... 16% 64.3M 5s 2024-03-08T20:31:41.176 INFO:tasks.workunit.client.1.smithi144.stderr: 22050K .......... .......... .......... .......... .......... 16% 24.9M 5s 2024-03-08T20:31:41.177 INFO:tasks.workunit.client.0.smithi118.stdout:checking for C compiler default output file name... a.out 2024-03-08T20:31:41.178 INFO:tasks.workunit.client.1.smithi144.stderr: 22100K .......... .......... .......... .......... .......... 16% 25.5M 5s 2024-03-08T20:31:41.180 INFO:tasks.workunit.client.1.smithi144.stderr: 22150K .......... .......... .......... .......... .......... 16% 22.2M 5s 2024-03-08T20:31:41.182 INFO:tasks.workunit.client.1.smithi144.stderr: 22200K .......... .......... .......... .......... .......... 16% 24.8M 5s 2024-03-08T20:31:41.183 INFO:tasks.workunit.client.1.smithi144.stderr: 22250K .......... .......... .......... .......... .......... 16% 29.2M 5s 2024-03-08T20:31:41.185 INFO:tasks.workunit.client.1.smithi144.stderr: 22300K .......... .......... .......... .......... .......... 16% 26.2M 5s 2024-03-08T20:31:41.187 INFO:tasks.workunit.client.1.smithi144.stderr: 22350K .......... .......... .......... .......... .......... 16% 37.0M 5s 2024-03-08T20:31:41.189 INFO:tasks.workunit.client.1.smithi144.stderr: 22400K .......... .......... .......... .......... .......... 16% 25.8M 5s 2024-03-08T20:31:41.189 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether the C compiler works... yes 2024-03-08T20:31:41.191 INFO:tasks.workunit.client.1.smithi144.stderr: 22450K .......... .......... .......... .......... .......... 16% 24.8M 5s 2024-03-08T20:31:41.192 INFO:tasks.workunit.client.1.smithi144.stderr: 22500K .......... .......... .......... .......... .......... 16% 47.2M 5s 2024-03-08T20:31:41.193 INFO:tasks.workunit.client.1.smithi144.stderr: 22550K .......... .......... .......... .......... .......... 16% 29.3M 5s 2024-03-08T20:31:41.196 INFO:tasks.workunit.client.1.smithi144.stderr: 22600K .......... .......... .......... .......... .......... 16% 27.1M 5s 2024-03-08T20:31:41.197 INFO:tasks.workunit.client.1.smithi144.stderr: 22650K .......... .......... .......... .......... .......... 16% 26.0M 5s 2024-03-08T20:31:41.199 INFO:tasks.workunit.client.1.smithi144.stderr: 22700K .......... .......... .......... .......... .......... 16% 23.5M 5s 2024-03-08T20:31:41.200 INFO:tasks.workunit.client.1.smithi144.stderr: 22750K .......... .......... .......... .......... .......... 16% 52.8M 5s 2024-03-08T20:31:41.200 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether we are cross compiling... no 2024-03-08T20:31:41.202 INFO:tasks.workunit.client.1.smithi144.stderr: 22800K .......... .......... .......... .......... .......... 16% 30.6M 5s 2024-03-08T20:31:41.204 INFO:tasks.workunit.client.1.smithi144.stderr: 22850K .......... .......... .......... .......... .......... 16% 24.6M 5s 2024-03-08T20:31:41.206 INFO:tasks.workunit.client.1.smithi144.stderr: 22900K .......... .......... .......... .......... .......... 16% 23.7M 5s 2024-03-08T20:31:41.208 INFO:tasks.workunit.client.1.smithi144.stderr: 22950K .......... .......... .......... .......... .......... 16% 26.8M 5s 2024-03-08T20:31:41.208 INFO:tasks.workunit.client.1.smithi144.stderr: 23000K .......... .......... .......... .......... .......... 16% 69.4M 5s 2024-03-08T20:31:41.210 INFO:tasks.workunit.client.1.smithi144.stderr: 23050K .......... .......... .......... .......... .......... 17% 23.4M 5s 2024-03-08T20:31:41.212 INFO:tasks.workunit.client.1.smithi144.stderr: 23100K .......... .......... .......... .......... .......... 17% 26.7M 5s 2024-03-08T20:31:41.215 INFO:tasks.workunit.client.1.smithi144.stderr: 23150K .......... .......... .......... .......... .......... 17% 28.4M 5s 2024-03-08T20:31:41.216 INFO:tasks.workunit.client.1.smithi144.stderr: 23200K .......... .......... .......... .......... .......... 17% 24.3M 5s 2024-03-08T20:31:41.217 INFO:tasks.workunit.client.1.smithi144.stderr: 23250K .......... .......... .......... .......... .......... 17% 44.1M 5s 2024-03-08T20:31:41.219 INFO:tasks.workunit.client.1.smithi144.stderr: 23300K .......... .......... .......... .......... .......... 17% 29.7M 5s 2024-03-08T20:31:41.221 INFO:tasks.workunit.client.1.smithi144.stderr: 23350K .......... .......... .......... .......... .......... 17% 23.9M 5s 2024-03-08T20:31:41.223 INFO:tasks.workunit.client.1.smithi144.stderr: 23400K .......... .......... .......... .......... .......... 17% 23.7M 5s 2024-03-08T20:31:41.224 INFO:tasks.workunit.client.1.smithi144.stderr: 23450K .......... .......... .......... .......... .......... 17% 55.4M 5s 2024-03-08T20:31:41.225 INFO:tasks.workunit.client.1.smithi144.stderr: 23500K .......... .......... .......... .......... .......... 17% 28.1M 5s 2024-03-08T20:31:41.227 INFO:tasks.workunit.client.1.smithi144.stderr: 23550K .......... .......... .......... .......... .......... 17% 24.2M 5s 2024-03-08T20:31:41.231 INFO:tasks.workunit.client.1.smithi144.stderr: 23600K .......... .......... .......... .......... .......... 17% 15.4M 5s 2024-03-08T20:31:41.233 INFO:tasks.workunit.client.1.smithi144.stderr: 23650K .......... .......... .......... .......... .......... 17% 27.2M 5s 2024-03-08T20:31:41.234 INFO:tasks.workunit.client.1.smithi144.stderr: 23700K .......... .......... .......... .......... .......... 17% 34.6M 5s 2024-03-08T20:31:41.237 INFO:tasks.workunit.client.1.smithi144.stderr: 23750K .......... .......... .......... .......... .......... 17% 43.6M 5s 2024-03-08T20:31:41.237 INFO:tasks.workunit.client.1.smithi144.stderr: 23800K .......... .......... .......... .......... .......... 17% 26.1M 5s 2024-03-08T20:31:41.239 INFO:tasks.workunit.client.1.smithi144.stderr: 23850K .......... .......... .......... .......... .......... 17% 27.9M 5s 2024-03-08T20:31:41.240 INFO:tasks.workunit.client.1.smithi144.stderr: 23900K .......... .......... .......... .......... .......... 17% 26.0M 5s 2024-03-08T20:31:41.242 INFO:tasks.workunit.client.1.smithi144.stderr: 23950K .......... .......... .......... .......... .......... 17% 25.4M 5s 2024-03-08T20:31:41.243 INFO:tasks.workunit.client.1.smithi144.stderr: 24000K .......... .......... .......... .......... .......... 17% 48.0M 5s 2024-03-08T20:31:41.245 INFO:tasks.workunit.client.1.smithi144.stderr: 24050K .......... .......... .......... .......... .......... 17% 25.7M 5s 2024-03-08T20:31:41.247 INFO:tasks.workunit.client.1.smithi144.stderr: 24100K .......... .......... .......... .......... .......... 17% 26.5M 5s 2024-03-08T20:31:41.249 INFO:tasks.workunit.client.1.smithi144.stderr: 24150K .......... .......... .......... .......... .......... 17% 29.1M 5s 2024-03-08T20:31:41.251 INFO:tasks.workunit.client.1.smithi144.stderr: 24200K .......... .......... .......... .......... .......... 17% 25.5M 5s 2024-03-08T20:31:41.253 INFO:tasks.workunit.client.1.smithi144.stderr: 24250K .......... .......... .......... .......... .......... 17% 27.3M 5s 2024-03-08T20:31:41.253 INFO:tasks.workunit.client.1.smithi144.stderr: 24300K .......... .......... .......... .......... .......... 17% 50.7M 5s 2024-03-08T20:31:41.255 INFO:tasks.workunit.client.1.smithi144.stderr: 24350K .......... .......... .......... .......... .......... 17% 25.5M 5s 2024-03-08T20:31:41.258 INFO:tasks.workunit.client.1.smithi144.stderr: 24400K .......... .......... .......... .......... .......... 18% 28.0M 5s 2024-03-08T20:31:41.259 INFO:tasks.workunit.client.1.smithi144.stderr: 24450K .......... .......... .......... .......... .......... 18% 26.8M 5s 2024-03-08T20:31:41.261 INFO:tasks.workunit.client.1.smithi144.stderr: 24500K .......... .......... .......... .......... .......... 18% 25.5M 5s 2024-03-08T20:31:41.262 INFO:tasks.workunit.client.1.smithi144.stderr: 24550K .......... .......... .......... .......... .......... 18% 40.1M 5s 2024-03-08T20:31:41.264 INFO:tasks.workunit.client.1.smithi144.stderr: 24600K .......... .......... .......... .......... .......... 18% 32.7M 5s 2024-03-08T20:31:41.267 INFO:tasks.workunit.client.1.smithi144.stderr: 24650K .......... .......... .......... .......... .......... 18% 20.6M 5s 2024-03-08T20:31:41.268 INFO:tasks.workunit.client.1.smithi144.stderr: 24700K .......... .......... .......... .......... .......... 18% 26.9M 5s 2024-03-08T20:31:41.269 INFO:tasks.workunit.client.1.smithi144.stderr: 24750K .......... .......... .......... .......... .......... 18% 35.7M 5s 2024-03-08T20:31:41.270 INFO:tasks.workunit.client.1.smithi144.stderr: 24800K .......... .......... .......... .......... .......... 18% 35.9M 5s 2024-03-08T20:31:41.273 INFO:tasks.workunit.client.1.smithi144.stderr: 24850K .......... .......... .......... .......... .......... 18% 24.3M 5s 2024-03-08T20:31:41.275 INFO:tasks.workunit.client.1.smithi144.stderr: 24900K .......... .......... .......... .......... .......... 18% 28.7M 5s 2024-03-08T20:31:41.276 INFO:tasks.workunit.client.1.smithi144.stderr: 24950K .......... .......... .......... .......... .......... 18% 38.5M 5s 2024-03-08T20:31:41.278 INFO:tasks.workunit.client.1.smithi144.stderr: 25000K .......... .......... .......... .......... .......... 18% 23.8M 5s 2024-03-08T20:31:41.279 INFO:tasks.workunit.client.1.smithi144.stderr: 25050K .......... .......... .......... .......... .......... 18% 34.5M 5s 2024-03-08T20:31:41.281 INFO:tasks.workunit.client.1.smithi144.stderr: 25100K .......... .......... .......... .......... .......... 18% 26.5M 5s 2024-03-08T20:31:41.282 INFO:tasks.workunit.client.1.smithi144.stderr: 25150K .......... .......... .......... .......... .......... 18% 26.8M 5s 2024-03-08T20:31:41.285 INFO:tasks.workunit.client.1.smithi144.stderr: 25200K .......... .......... .......... .......... .......... 18% 22.5M 5s 2024-03-08T20:31:41.287 INFO:tasks.workunit.client.1.smithi144.stderr: 25250K .......... .......... .......... .......... .......... 18% 24.9M 5s 2024-03-08T20:31:41.288 INFO:tasks.workunit.client.1.smithi144.stderr: 25300K .......... .......... .......... .......... .......... 18% 40.6M 5s 2024-03-08T20:31:41.290 INFO:tasks.workunit.client.1.smithi144.stderr: 25350K .......... .......... .......... .......... .......... 18% 24.2M 5s 2024-03-08T20:31:41.291 INFO:tasks.workunit.client.1.smithi144.stderr: 25400K .......... .......... .......... .......... .......... 18% 29.7M 5s 2024-03-08T20:31:41.295 INFO:tasks.workunit.client.1.smithi144.stderr: 25450K .......... .......... .......... .......... .......... 18% 34.9M 5s 2024-03-08T20:31:41.295 INFO:tasks.workunit.client.1.smithi144.stderr: 25500K .......... .......... .......... .......... .......... 18% 24.5M 5s 2024-03-08T20:31:41.297 INFO:tasks.workunit.client.1.smithi144.stderr: 25550K .......... .......... .......... .......... .......... 18% 30.8M 5s 2024-03-08T20:31:41.299 INFO:tasks.workunit.client.1.smithi144.stderr: 25600K .......... .......... .......... .......... .......... 18% 24.5M 5s 2024-03-08T20:31:41.301 INFO:tasks.workunit.client.1.smithi144.stderr: 25650K .......... .......... .......... .......... .......... 18% 26.0M 5s 2024-03-08T20:31:41.305 INFO:tasks.workunit.client.1.smithi144.stderr: 25700K .......... .......... .......... .......... .......... 18% 22.0M 5s 2024-03-08T20:31:41.305 INFO:tasks.workunit.client.1.smithi144.stderr: 25750K .......... .......... .......... .......... .......... 19% 33.4M 5s 2024-03-08T20:31:41.305 INFO:tasks.workunit.client.1.smithi144.stderr: 25800K .......... .......... .......... .......... .......... 19% 39.5M 5s 2024-03-08T20:31:41.307 INFO:tasks.workunit.client.1.smithi144.stderr: 25850K .......... .......... .......... .......... .......... 19% 26.7M 5s 2024-03-08T20:31:41.308 INFO:tasks.workunit.client.1.smithi144.stderr: 25900K .......... .......... .......... .......... .......... 19% 33.1M 5s 2024-03-08T20:31:41.312 INFO:tasks.workunit.client.1.smithi144.stderr: 25950K .......... .......... .......... .......... .......... 19% 22.2M 5s 2024-03-08T20:31:41.312 INFO:tasks.workunit.client.1.smithi144.stderr: 26000K .......... .......... .......... .......... .......... 19% 51.2M 5s 2024-03-08T20:31:41.314 INFO:tasks.workunit.client.1.smithi144.stderr: 26050K .......... .......... .......... .......... .......... 19% 25.9M 5s 2024-03-08T20:31:41.316 INFO:tasks.workunit.client.1.smithi144.stderr: 26100K .......... .......... .......... .......... .......... 19% 24.2M 5s 2024-03-08T20:31:41.319 INFO:tasks.workunit.client.1.smithi144.stderr: 26150K .......... .......... .......... .......... .......... 19% 26.4M 5s 2024-03-08T20:31:41.319 INFO:tasks.workunit.client.1.smithi144.stderr: 26200K .......... .......... .......... .......... .......... 19% 47.0M 5s 2024-03-08T20:31:41.321 INFO:tasks.workunit.client.1.smithi144.stderr: 26250K .......... .......... .......... .......... .......... 19% 22.1M 5s 2024-03-08T20:31:41.322 INFO:tasks.workunit.client.1.smithi144.stderr: 26300K .......... .......... .......... .......... .......... 19% 36.6M 5s 2024-03-08T20:31:41.325 INFO:tasks.workunit.client.1.smithi144.stderr: 26350K .......... .......... .......... .......... .......... 19% 21.6M 5s 2024-03-08T20:31:41.327 INFO:tasks.workunit.client.1.smithi144.stderr: 26400K .......... .......... .......... .......... .......... 19% 36.8M 5s 2024-03-08T20:31:41.329 INFO:tasks.workunit.client.1.smithi144.stderr: 26450K .......... .......... .......... .......... .......... 19% 20.0M 5s 2024-03-08T20:31:41.329 INFO:tasks.workunit.client.1.smithi144.stderr: 26500K .......... .......... .......... .......... .......... 19% 33.0M 5s 2024-03-08T20:31:41.331 INFO:tasks.workunit.client.1.smithi144.stderr: 26550K .......... .......... .......... .......... .......... 19% 38.6M 5s 2024-03-08T20:31:41.333 INFO:tasks.workunit.client.1.smithi144.stderr: 26600K .......... .......... .......... .......... .......... 19% 31.5M 5s 2024-03-08T20:31:41.337 INFO:tasks.workunit.client.1.smithi144.stderr: 26650K .......... .......... .......... .......... .......... 19% 27.7M 5s 2024-03-08T20:31:41.337 INFO:tasks.workunit.client.1.smithi144.stderr: 26700K .......... .......... .......... .......... .......... 19% 25.8M 5s 2024-03-08T20:31:41.344 INFO:tasks.workunit.client.1.smithi144.stderr: 26750K .......... .......... .......... .......... .......... 19% 29.8M 5s 2024-03-08T20:31:41.344 INFO:tasks.workunit.client.1.smithi144.stderr: 26800K .......... .......... .......... .......... .......... 19% 37.7M 5s 2024-03-08T20:31:41.344 INFO:tasks.workunit.client.1.smithi144.stderr: 26850K .......... .......... .......... .......... .......... 19% 25.3M 5s 2024-03-08T20:31:41.344 INFO:tasks.workunit.client.1.smithi144.stderr: 26900K .......... .......... .......... .......... .......... 19% 24.7M 5s 2024-03-08T20:31:41.352 INFO:tasks.workunit.client.1.smithi144.stderr: 26950K .......... .......... .......... .......... .......... 19% 25.0M 5s 2024-03-08T20:31:41.352 INFO:tasks.workunit.client.1.smithi144.stderr: 27000K .......... .......... .......... .......... .......... 19% 36.9M 5s 2024-03-08T20:31:41.352 INFO:tasks.workunit.client.1.smithi144.stderr: 27050K .......... .......... .......... .......... .......... 19% 40.3M 5s 2024-03-08T20:31:41.352 INFO:tasks.workunit.client.1.smithi144.stderr: 27100K .......... .......... .......... .......... .......... 19% 26.3M 5s 2024-03-08T20:31:41.352 INFO:tasks.workunit.client.1.smithi144.stderr: 27150K .......... .......... .......... .......... .......... 20% 28.4M 5s 2024-03-08T20:31:41.353 INFO:tasks.workunit.client.1.smithi144.stderr: 27200K .......... .......... .......... .......... .......... 20% 26.1M 5s 2024-03-08T20:31:41.354 INFO:tasks.workunit.client.1.smithi144.stderr: 27250K .......... .......... .......... .......... .......... 20% 40.4M 5s 2024-03-08T20:31:41.356 INFO:tasks.workunit.client.1.smithi144.stderr: 27300K .......... .......... .......... .......... .......... 20% 25.3M 5s 2024-03-08T20:31:41.358 INFO:tasks.workunit.client.1.smithi144.stderr: 27350K .......... .......... .......... .......... .......... 20% 27.5M 5s 2024-03-08T20:31:41.359 INFO:tasks.workunit.client.0.smithi118.stdout:checking for suffix of executables... 2024-03-08T20:31:41.360 INFO:tasks.workunit.client.1.smithi144.stderr: 27400K .......... .......... .......... .......... .......... 20% 21.0M 5s 2024-03-08T20:31:41.361 INFO:tasks.workunit.client.1.smithi144.stderr: 27450K .......... .......... .......... .......... .......... 20% 35.9M 5s 2024-03-08T20:31:41.363 INFO:tasks.workunit.client.1.smithi144.stderr: 27500K .......... .......... .......... .......... .......... 20% 33.1M 5s 2024-03-08T20:31:41.376 INFO:tasks.workunit.client.1.smithi144.stderr: 27550K .......... .......... .......... .......... .......... 20% 37.1M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27600K .......... .......... .......... .......... .......... 20% 26.8M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27650K .......... .......... .......... .......... .......... 20% 25.4M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27700K .......... .......... .......... .......... .......... 20% 33.9M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27750K .......... .......... .......... .......... .......... 20% 25.7M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27800K .......... .......... .......... .......... .......... 20% 33.4M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27850K .......... .......... .......... .......... .......... 20% 28.6M 5s 2024-03-08T20:31:41.377 INFO:tasks.workunit.client.1.smithi144.stderr: 27900K .......... .......... .......... .......... .......... 20% 30.4M 5s 2024-03-08T20:31:41.379 INFO:tasks.workunit.client.1.smithi144.stderr: 27950K .......... .......... .......... .......... .......... 20% 26.9M 5s 2024-03-08T20:31:41.381 INFO:tasks.workunit.client.1.smithi144.stderr: 28000K .......... .......... .......... .......... .......... 20% 23.4M 5s 2024-03-08T20:31:41.381 INFO:tasks.workunit.client.1.smithi144.stderr: 28050K .......... .......... .......... .......... .......... 20% 41.1M 5s 2024-03-08T20:31:41.383 INFO:tasks.workunit.client.1.smithi144.stderr: 28100K .......... .......... .......... .......... .......... 20% 32.0M 5s 2024-03-08T20:31:41.397 INFO:tasks.workunit.client.1.smithi144.stderr: 28150K .......... .......... .......... .......... .......... 20% 27.2M 5s 2024-03-08T20:31:41.397 INFO:tasks.workunit.client.1.smithi144.stderr: 28200K .......... .......... .......... .......... .......... 20% 22.5M 5s 2024-03-08T20:31:41.397 INFO:tasks.workunit.client.1.smithi144.stderr: 28250K .......... .......... .......... .......... .......... 20% 37.4M 5s 2024-03-08T20:31:41.397 INFO:tasks.workunit.client.1.smithi144.stderr: 28300K .......... .......... .......... .......... .......... 20% 36.9M 5s 2024-03-08T20:31:41.398 INFO:tasks.workunit.client.1.smithi144.stderr: 28350K .......... .......... .......... .......... .......... 20% 22.6M 5s 2024-03-08T20:31:41.398 INFO:tasks.workunit.client.1.smithi144.stderr: 28400K .......... .......... .......... .......... .......... 20% 28.6M 5s 2024-03-08T20:31:41.398 INFO:tasks.workunit.client.1.smithi144.stderr: 28450K .......... .......... .......... .......... .......... 20% 26.3M 5s 2024-03-08T20:31:41.398 INFO:tasks.workunit.client.1.smithi144.stderr: 28500K .......... .......... .......... .......... .......... 21% 29.0M 5s 2024-03-08T20:31:41.445 INFO:tasks.workunit.client.1.smithi144.stderr: 28550K .......... .......... .......... .......... .......... 21% 28.9M 5s 2024-03-08T20:31:41.445 INFO:tasks.workunit.client.1.smithi144.stderr: 28600K .......... .......... .......... .......... .......... 21% 27.8M 5s 2024-03-08T20:31:41.445 INFO:tasks.workunit.client.1.smithi144.stderr: 28650K .......... .......... .......... .......... .......... 21% 35.6M 5s 2024-03-08T20:31:41.445 INFO:tasks.workunit.client.1.smithi144.stderr: 28700K .......... .......... .......... .......... .......... 21% 23.3M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 28750K .......... .......... .......... .......... .......... 21% 23.3M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 28800K .......... .......... .......... .......... .......... 21% 22.8M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 28850K .......... .......... .......... .......... .......... 21% 90.5M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 28900K .......... .......... .......... .......... .......... 21% 52.1M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 28950K .......... .......... .......... .......... .......... 21% 24.6M 5s 2024-03-08T20:31:41.446 INFO:tasks.workunit.client.1.smithi144.stderr: 29000K .......... .......... .......... .......... .......... 21% 24.7M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29050K .......... .......... .......... .......... .......... 21% 51.5M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29100K .......... .......... .......... .......... .......... 21% 23.2M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29150K .......... .......... .......... .......... .......... 21% 28.5M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29200K .......... .......... .......... .......... .......... 21% 28.8M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29250K .......... .......... .......... .......... .......... 21% 25.5M 5s 2024-03-08T20:31:41.447 INFO:tasks.workunit.client.1.smithi144.stderr: 29300K .......... .......... .......... .......... .......... 21% 25.2M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29350K .......... .......... .......... .......... .......... 21% 51.6M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29400K .......... .......... .......... .......... .......... 21% 31.0M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29450K .......... .......... .......... .......... .......... 21% 23.4M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29500K .......... .......... .......... .......... .......... 21% 26.0M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29550K .......... .......... .......... .......... .......... 21% 20.0M 5s 2024-03-08T20:31:41.448 INFO:tasks.workunit.client.1.smithi144.stderr: 29600K .......... .......... .......... .......... .......... 21% 21.3M 5s 2024-03-08T20:31:41.449 INFO:tasks.workunit.client.1.smithi144.stderr: 29650K .......... .......... .......... .......... .......... 21% 11.7M 5s 2024-03-08T20:31:41.449 INFO:tasks.workunit.client.1.smithi144.stderr: 29700K .......... .......... .......... .......... .......... 21% 12.6M 5s 2024-03-08T20:31:41.458 INFO:tasks.workunit.client.1.smithi144.stderr: 29750K .......... .......... .......... .......... .......... 21% 17.2M 5s 2024-03-08T20:31:41.458 INFO:tasks.workunit.client.1.smithi144.stderr: 29800K .......... .......... .......... .......... .......... 21% 12.2M 5s 2024-03-08T20:31:41.458 INFO:tasks.workunit.client.1.smithi144.stderr: 29850K .......... .......... .......... .......... .......... 22% 25.3M 5s 2024-03-08T20:31:41.458 INFO:tasks.workunit.client.1.smithi144.stderr: 29900K .......... .......... .......... .......... .......... 22% 12.6M 5s 2024-03-08T20:31:41.461 INFO:tasks.workunit.client.1.smithi144.stderr: 29950K .......... .......... .......... .......... .......... 22% 14.8M 5s 2024-03-08T20:31:41.461 INFO:tasks.workunit.client.1.smithi144.stderr: 30000K .......... .......... .......... .......... .......... 22% 18.4M 5s 2024-03-08T20:31:41.466 INFO:tasks.workunit.client.1.smithi144.stderr: 30050K .......... .......... .......... .......... .......... 22% 13.2M 5s 2024-03-08T20:31:41.466 INFO:tasks.workunit.client.1.smithi144.stderr: 30100K .......... .......... .......... .......... .......... 22% 49.8M 5s 2024-03-08T20:31:41.467 INFO:tasks.workunit.client.1.smithi144.stderr: 30150K .......... .......... .......... .......... .......... 22% 57.5M 5s 2024-03-08T20:31:41.469 INFO:tasks.workunit.client.1.smithi144.stderr: 30200K .......... .......... .......... .......... .......... 22% 18.4M 5s 2024-03-08T20:31:41.472 INFO:tasks.workunit.client.1.smithi144.stderr: 30250K .......... .......... .......... .......... .......... 22% 66.9M 5s 2024-03-08T20:31:41.472 INFO:tasks.workunit.client.1.smithi144.stderr: 30300K .......... .......... .......... .......... .......... 22% 84.0M 5s 2024-03-08T20:31:41.472 INFO:tasks.workunit.client.1.smithi144.stderr: 30350K .......... .......... .......... .......... .......... 22% 98.5M 5s 2024-03-08T20:31:41.472 INFO:tasks.workunit.client.1.smithi144.stderr: 30400K .......... .......... .......... .......... .......... 22% 105M 5s 2024-03-08T20:31:41.473 INFO:tasks.workunit.client.1.smithi144.stderr: 30450K .......... .......... .......... .......... .......... 22% 76.4M 5s 2024-03-08T20:31:41.477 INFO:tasks.workunit.client.1.smithi144.stderr: 30500K .......... .......... .......... .......... .......... 22% 12.1M 5s 2024-03-08T20:31:41.481 INFO:tasks.workunit.client.1.smithi144.stderr: 30550K .......... .......... .......... .......... .......... 22% 12.1M 5s 2024-03-08T20:31:41.484 INFO:tasks.workunit.client.1.smithi144.stderr: 30600K .......... .......... .......... .......... .......... 22% 13.9M 5s 2024-03-08T20:31:41.489 INFO:tasks.workunit.client.1.smithi144.stderr: 30650K .......... .......... .......... .......... .......... 22% 19.7M 5s 2024-03-08T20:31:41.489 INFO:tasks.workunit.client.1.smithi144.stderr: 30700K .......... .......... .......... .......... .......... 22% 83.1M 5s 2024-03-08T20:31:41.489 INFO:tasks.workunit.client.1.smithi144.stderr: 30750K .......... .......... .......... .......... .......... 22% 80.6M 5s 2024-03-08T20:31:41.490 INFO:tasks.workunit.client.1.smithi144.stderr: 30800K .......... .......... .......... .......... .......... 22% 72.7M 5s 2024-03-08T20:31:41.490 INFO:tasks.workunit.client.1.smithi144.stderr: 30850K .......... .......... .......... .......... .......... 22% 103M 5s 2024-03-08T20:31:41.493 INFO:tasks.workunit.client.1.smithi144.stderr: 30900K .......... .......... .......... .......... .......... 22% 12.9M 5s 2024-03-08T20:31:41.495 INFO:tasks.workunit.client.1.smithi144.stderr: 30950K .......... .......... .......... .......... .......... 22% 19.3M 5s 2024-03-08T20:31:41.499 INFO:tasks.workunit.client.1.smithi144.stderr: 31000K .......... .......... .......... .......... .......... 22% 11.9M 5s 2024-03-08T20:31:41.503 INFO:tasks.workunit.client.1.smithi144.stderr: 31050K .......... .......... .......... .......... .......... 22% 16.6M 5s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31100K .......... .......... .......... .......... .......... 22% 58.5M 5s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31150K .......... .......... .......... .......... .......... 22% 50.7M 5s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31200K .......... .......... .......... .......... .......... 23% 67.4M 4s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31250K .......... .......... .......... .......... .......... 23% 80.2M 4s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31300K .......... .......... .......... .......... .......... 23% 95.2M 4s 2024-03-08T20:31:41.507 INFO:tasks.workunit.client.1.smithi144.stderr: 31350K .......... .......... .......... .......... .......... 23% 79.4M 4s 2024-03-08T20:31:41.508 INFO:tasks.workunit.client.1.smithi144.stderr: 31400K .......... .......... .......... .......... .......... 23% 41.0M 4s 2024-03-08T20:31:41.509 INFO:tasks.workunit.client.0.smithi118.stdout:checking for suffix of object files... o 2024-03-08T20:31:41.513 INFO:tasks.workunit.client.1.smithi144.stderr: 31450K .......... .......... .......... .......... .......... 23% 9.24M 4s 2024-03-08T20:31:41.516 INFO:tasks.workunit.client.1.smithi144.stderr: 31500K .......... .......... .......... .......... .......... 23% 17.6M 4s 2024-03-08T20:31:41.521 INFO:tasks.workunit.client.1.smithi144.stderr: 31550K .......... .......... .......... .......... .......... 23% 14.7M 4s 2024-03-08T20:31:41.521 INFO:tasks.workunit.client.1.smithi144.stderr: 31600K .......... .......... .......... .......... .......... 23% 63.3M 4s 2024-03-08T20:31:41.521 INFO:tasks.workunit.client.1.smithi144.stderr: 31650K .......... .......... .......... .......... .......... 23% 61.4M 4s 2024-03-08T20:31:41.522 INFO:tasks.workunit.client.1.smithi144.stderr: 31700K .......... .......... .......... .......... .......... 23% 42.1M 4s 2024-03-08T20:31:41.523 INFO:tasks.workunit.client.1.smithi144.stderr: 31750K .......... .......... .......... .......... .......... 23% 43.1M 4s 2024-03-08T20:31:41.525 INFO:tasks.workunit.client.1.smithi144.stderr: 31800K .......... .......... .......... .......... .......... 23% 59.4M 4s 2024-03-08T20:31:41.525 INFO:tasks.workunit.client.1.smithi144.stderr: 31850K .......... .......... .......... .......... .......... 23% 51.3M 4s 2024-03-08T20:31:41.527 INFO:tasks.workunit.client.1.smithi144.stderr: 31900K .......... .......... .......... .......... .......... 23% 25.0M 4s 2024-03-08T20:31:41.532 INFO:tasks.workunit.client.1.smithi144.stderr: 31950K .......... .......... .......... .......... .......... 23% 10.5M 4s 2024-03-08T20:31:41.534 INFO:tasks.workunit.client.1.smithi144.stderr: 32000K .......... .......... .......... .......... .......... 23% 15.6M 4s 2024-03-08T20:31:41.537 INFO:tasks.workunit.client.1.smithi144.stderr: 32050K .......... .......... .......... .......... .......... 23% 33.4M 4s 2024-03-08T20:31:41.537 INFO:tasks.workunit.client.1.smithi144.stderr: 32100K .......... .......... .......... .......... .......... 23% 44.0M 4s 2024-03-08T20:31:41.539 INFO:tasks.workunit.client.1.smithi144.stderr: 32150K .......... .......... .......... .......... .......... 23% 31.6M 4s 2024-03-08T20:31:41.541 INFO:tasks.workunit.client.1.smithi144.stderr: 32200K .......... .......... .......... .......... .......... 23% 30.4M 4s 2024-03-08T20:31:41.542 INFO:tasks.workunit.client.1.smithi144.stderr: 32250K .......... .......... .......... .......... .......... 23% 36.6M 4s 2024-03-08T20:31:41.544 INFO:tasks.workunit.client.1.smithi144.stderr: 32300K .......... .......... .......... .......... .......... 23% 31.9M 4s 2024-03-08T20:31:41.545 INFO:tasks.workunit.client.1.smithi144.stderr: 32350K .......... .......... .......... .......... .......... 23% 42.0M 4s 2024-03-08T20:31:41.546 INFO:tasks.workunit.client.1.smithi144.stderr: 32400K .......... .......... .......... .......... .......... 23% 68.6M 4s 2024-03-08T20:31:41.548 INFO:tasks.workunit.client.1.smithi144.stderr: 32450K .......... .......... .......... .......... .......... 23% 15.3M 4s 2024-03-08T20:31:41.551 INFO:tasks.workunit.client.1.smithi144.stderr: 32500K .......... .......... .......... .......... .......... 23% 18.4M 4s 2024-03-08T20:31:41.553 INFO:tasks.workunit.client.1.smithi144.stderr: 32550K .......... .......... .......... .......... .......... 24% 22.2M 4s 2024-03-08T20:31:41.555 INFO:tasks.workunit.client.1.smithi144.stderr: 32600K .......... .......... .......... .......... .......... 24% 56.3M 4s 2024-03-08T20:31:41.555 INFO:tasks.workunit.client.1.smithi144.stderr: 32650K .......... .......... .......... .......... .......... 24% 58.3M 4s 2024-03-08T20:31:41.560 INFO:tasks.workunit.client.1.smithi144.stderr: 32700K .......... .......... .......... .......... .......... 24% 48.4M 4s 2024-03-08T20:31:41.560 INFO:tasks.workunit.client.1.smithi144.stderr: 32750K .......... .......... .......... .......... .......... 24% 35.1M 4s 2024-03-08T20:31:41.560 INFO:tasks.workunit.client.1.smithi144.stderr: 32800K .......... .......... .......... .......... .......... 24% 39.6M 4s 2024-03-08T20:31:41.561 INFO:tasks.workunit.client.1.smithi144.stderr: 32850K .......... .......... .......... .......... .......... 24% 76.4M 4s 2024-03-08T20:31:41.561 INFO:tasks.workunit.client.1.smithi144.stderr: 32900K .......... .......... .......... .......... .......... 24% 59.0M 4s 2024-03-08T20:31:41.565 INFO:tasks.workunit.client.1.smithi144.stderr: 32950K .......... .......... .......... .......... .......... 24% 9.83M 4s 2024-03-08T20:31:41.568 INFO:tasks.workunit.client.1.smithi144.stderr: 33000K .......... .......... .......... .......... .......... 24% 14.6M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33050K .......... .......... .......... .......... .......... 24% 25.0M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33100K .......... .......... .......... .......... .......... 24% 88.4M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33150K .......... .......... .......... .......... .......... 24% 106M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33200K .......... .......... .......... .......... .......... 24% 102M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33250K .......... .......... .......... .......... .......... 24% 92.2M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33300K .......... .......... .......... .......... .......... 24% 104M 4s 2024-03-08T20:31:41.574 INFO:tasks.workunit.client.1.smithi144.stderr: 33350K .......... .......... .......... .......... .......... 24% 125M 4s 2024-03-08T20:31:41.578 INFO:tasks.workunit.client.1.smithi144.stderr: 33400K .......... .......... .......... .......... .......... 24% 10.0M 4s 2024-03-08T20:31:41.584 INFO:tasks.workunit.client.1.smithi144.stderr: 33450K .......... .......... .......... .......... .......... 24% 9.36M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33500K .......... .......... .......... .......... .......... 24% 14.3M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33550K .......... .......... .......... .......... .......... 24% 59.5M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33600K .......... .......... .......... .......... .......... 24% 70.9M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33650K .......... .......... .......... .......... .......... 24% 72.0M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33700K .......... .......... .......... .......... .......... 24% 67.9M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33750K .......... .......... .......... .......... .......... 24% 69.4M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33800K .......... .......... .......... .......... .......... 24% 85.2M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33850K .......... .......... .......... .......... .......... 24% 87.7M 4s 2024-03-08T20:31:41.595 INFO:tasks.workunit.client.1.smithi144.stderr: 33900K .......... .......... .......... .......... .......... 25% 16.7M 4s 2024-03-08T20:31:41.600 INFO:tasks.workunit.client.1.smithi144.stderr: 33950K .......... .......... .......... .......... .......... 25% 8.70M 4s 2024-03-08T20:31:41.605 INFO:tasks.workunit.client.1.smithi144.stderr: 34000K .......... .......... .......... .......... .......... 25% 12.8M 4s 2024-03-08T20:31:41.608 INFO:tasks.workunit.client.1.smithi144.stderr: 34050K .......... .......... .......... .......... .......... 25% 13.5M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34100K .......... .......... .......... .......... .......... 25% 35.8M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34150K .......... .......... .......... .......... .......... 25% 63.1M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34200K .......... .......... .......... .......... .......... 25% 86.5M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34250K .......... .......... .......... .......... .......... 25% 69.6M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34300K .......... .......... .......... .......... .......... 25% 87.0M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34350K .......... .......... .......... .......... .......... 25% 77.0M 4s 2024-03-08T20:31:41.613 INFO:tasks.workunit.client.1.smithi144.stderr: 34400K .......... .......... .......... .......... .......... 25% 46.5M 4s 2024-03-08T20:31:41.617 INFO:tasks.workunit.client.1.smithi144.stderr: 34450K .......... .......... .......... .......... .......... 25% 12.8M 4s 2024-03-08T20:31:41.621 INFO:tasks.workunit.client.1.smithi144.stderr: 34500K .......... .......... .......... .......... .......... 25% 14.1M 4s 2024-03-08T20:31:41.621 INFO:tasks.workunit.client.1.smithi144.stderr: 34550K .......... .......... .......... .......... .......... 25% 51.9M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34600K .......... .......... .......... .......... .......... 25% 67.8M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34650K .......... .......... .......... .......... .......... 25% 64.1M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34700K .......... .......... .......... .......... .......... 25% 60.2M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34750K .......... .......... .......... .......... .......... 25% 75.3M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34800K .......... .......... .......... .......... .......... 25% 79.8M 4s 2024-03-08T20:31:41.627 INFO:tasks.workunit.client.1.smithi144.stderr: 34850K .......... .......... .......... .......... .......... 25% 77.5M 4s 2024-03-08T20:31:41.628 INFO:tasks.workunit.client.1.smithi144.stderr: 34900K .......... .......... .......... .......... .......... 25% 20.2M 4s 2024-03-08T20:31:41.634 INFO:tasks.workunit.client.1.smithi144.stderr: 34950K .......... .......... .......... .......... .......... 25% 8.56M 4s 2024-03-08T20:31:41.637 INFO:tasks.workunit.client.1.smithi144.stderr: 35000K .......... .......... .......... .......... .......... 25% 14.4M 4s 2024-03-08T20:31:41.643 INFO:tasks.workunit.client.1.smithi144.stderr: 35050K .......... .......... .......... .......... .......... 25% 36.9M 4s 2024-03-08T20:31:41.643 INFO:tasks.workunit.client.1.smithi144.stderr: 35100K .......... .......... .......... .......... .......... 25% 65.0M 4s 2024-03-08T20:31:41.644 INFO:tasks.workunit.client.1.smithi144.stderr: 35150K .......... .......... .......... .......... .......... 25% 66.1M 4s 2024-03-08T20:31:41.644 INFO:tasks.workunit.client.1.smithi144.stderr: 35200K .......... .......... .......... .......... .......... 25% 56.3M 4s 2024-03-08T20:31:41.644 INFO:tasks.workunit.client.1.smithi144.stderr: 35250K .......... .......... .......... .......... .......... 26% 88.1M 4s 2024-03-08T20:31:41.644 INFO:tasks.workunit.client.1.smithi144.stderr: 35300K .......... .......... .......... .......... .......... 26% 76.5M 4s 2024-03-08T20:31:41.644 INFO:tasks.workunit.client.1.smithi144.stderr: 35350K .......... .......... .......... .......... .......... 26% 77.6M 4s 2024-03-08T20:31:41.645 INFO:tasks.workunit.client.1.smithi144.stderr: 35400K .......... .......... .......... .......... .......... 26% 19.9M 4s 2024-03-08T20:31:41.650 INFO:tasks.workunit.client.1.smithi144.stderr: 35450K .......... .......... .......... .......... .......... 26% 9.15M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35500K .......... .......... .......... .......... .......... 26% 13.8M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35550K .......... .......... .......... .......... .......... 26% 45.0M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35600K .......... .......... .......... .......... .......... 26% 43.9M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35650K .......... .......... .......... .......... .......... 26% 38.3M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35700K .......... .......... .......... .......... .......... 26% 38.3M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35750K .......... .......... .......... .......... .......... 26% 67.8M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35800K .......... .......... .......... .......... .......... 26% 79.9M 4s 2024-03-08T20:31:41.661 INFO:tasks.workunit.client.1.smithi144.stderr: 35850K .......... .......... .......... .......... .......... 26% 85.2M 4s 2024-03-08T20:31:41.662 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether we are using the GNU C compiler... yes 2024-03-08T20:31:41.663 INFO:tasks.workunit.client.1.smithi144.stderr: 35900K .......... .......... .......... .......... .......... 26% 31.7M 4s 2024-03-08T20:31:41.667 INFO:tasks.workunit.client.1.smithi144.stderr: 35950K .......... .......... .......... .......... .......... 26% 9.09M 4s 2024-03-08T20:31:41.671 INFO:tasks.workunit.client.1.smithi144.stderr: 36000K .......... .......... .......... .......... .......... 26% 13.9M 4s 2024-03-08T20:31:41.676 INFO:tasks.workunit.client.1.smithi144.stderr: 36050K .......... .......... .......... .......... .......... 26% 32.8M 4s 2024-03-08T20:31:41.676 INFO:tasks.workunit.client.1.smithi144.stderr: 36100K .......... .......... .......... .......... .......... 26% 66.7M 4s 2024-03-08T20:31:41.676 INFO:tasks.workunit.client.1.smithi144.stderr: 36150K .......... .......... .......... .......... .......... 26% 35.4M 4s 2024-03-08T20:31:41.676 INFO:tasks.workunit.client.1.smithi144.stderr: 36200K .......... .......... .......... .......... .......... 26% 41.3M 4s 2024-03-08T20:31:41.679 INFO:tasks.workunit.client.1.smithi144.stderr: 36250K .......... .......... .......... .......... .......... 26% 43.3M 4s 2024-03-08T20:31:41.679 INFO:tasks.workunit.client.1.smithi144.stderr: 36300K .......... .......... .......... .......... .......... 26% 43.4M 4s 2024-03-08T20:31:41.679 INFO:tasks.workunit.client.1.smithi144.stderr: 36350K .......... .......... .......... .......... .......... 26% 41.7M 4s 2024-03-08T20:31:41.680 INFO:tasks.workunit.client.1.smithi144.stderr: 36400K .......... .......... .......... .......... .......... 26% 37.8M 4s 2024-03-08T20:31:41.685 INFO:tasks.workunit.client.1.smithi144.stderr: 36450K .......... .......... .......... .......... .......... 26% 10.7M 4s 2024-03-08T20:31:41.688 INFO:tasks.workunit.client.1.smithi144.stderr: 36500K .......... .......... .......... .......... .......... 26% 14.7M 4s 2024-03-08T20:31:41.692 INFO:tasks.workunit.client.1.smithi144.stderr: 36550K .......... .......... .......... .......... .......... 26% 36.9M 4s 2024-03-08T20:31:41.692 INFO:tasks.workunit.client.1.smithi144.stderr: 36600K .......... .......... .......... .......... .......... 26% 56.5M 4s 2024-03-08T20:31:41.693 INFO:tasks.workunit.client.1.smithi144.stderr: 36650K .......... .......... .......... .......... .......... 27% 45.3M 4s 2024-03-08T20:31:41.693 INFO:tasks.workunit.client.1.smithi144.stderr: 36700K .......... .......... .......... .......... .......... 27% 56.7M 4s 2024-03-08T20:31:41.696 INFO:tasks.workunit.client.1.smithi144.stderr: 36750K .......... .......... .......... .......... .......... 27% 54.7M 4s 2024-03-08T20:31:41.696 INFO:tasks.workunit.client.1.smithi144.stderr: 36800K .......... .......... .......... .......... .......... 27% 63.1M 4s 2024-03-08T20:31:41.696 INFO:tasks.workunit.client.1.smithi144.stderr: 36850K .......... .......... .......... .......... .......... 27% 53.2M 4s 2024-03-08T20:31:41.696 INFO:tasks.workunit.client.1.smithi144.stderr: 36900K .......... .......... .......... .......... .......... 27% 52.7M 4s 2024-03-08T20:31:41.701 INFO:tasks.workunit.client.1.smithi144.stderr: 36950K .......... .......... .......... .......... .......... 27% 9.28M 4s 2024-03-08T20:31:41.705 INFO:tasks.workunit.client.1.smithi144.stderr: 37000K .......... .......... .......... .......... .......... 27% 14.1M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37050K .......... .......... .......... .......... .......... 27% 22.1M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37100K .......... .......... .......... .......... .......... 27% 118M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37150K .......... .......... .......... .......... .......... 27% 95.3M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37200K .......... .......... .......... .......... .......... 27% 62.7M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37250K .......... .......... .......... .......... .......... 27% 64.5M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37300K .......... .......... .......... .......... .......... 27% 94.6M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37350K .......... .......... .......... .......... .......... 27% 135M 4s 2024-03-08T20:31:41.713 INFO:tasks.workunit.client.1.smithi144.stderr: 37400K .......... .......... .......... .......... .......... 27% 28.7M 4s 2024-03-08T20:31:41.717 INFO:tasks.workunit.client.1.smithi144.stderr: 37450K .......... .......... .......... .......... .......... 27% 8.55M 4s 2024-03-08T20:31:41.721 INFO:tasks.workunit.client.1.smithi144.stderr: 37500K .......... .......... .......... .......... .......... 27% 14.6M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37550K .......... .......... .......... .......... .......... 27% 16.4M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37600K .......... .......... .......... .......... .......... 27% 40.9M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37650K .......... .......... .......... .......... .......... 27% 34.1M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37700K .......... .......... .......... .......... .......... 27% 60.0M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37750K .......... .......... .......... .......... .......... 27% 97.1M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37800K .......... .......... .......... .......... .......... 27% 76.0M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37850K .......... .......... .......... .......... .......... 27% 87.5M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37900K .......... .......... .......... .......... .......... 27% 105M 4s 2024-03-08T20:31:41.732 INFO:tasks.workunit.client.1.smithi144.stderr: 37950K .......... .......... .......... .......... .......... 27% 21.5M 4s 2024-03-08T20:31:41.736 INFO:tasks.workunit.client.1.smithi144.stderr: 38000K .......... .......... .......... .......... .......... 28% 11.5M 4s 2024-03-08T20:31:41.741 INFO:tasks.workunit.client.1.smithi144.stderr: 38050K .......... .......... .......... .......... .......... 28% 9.83M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38100K .......... .......... .......... .......... .......... 28% 27.4M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38150K .......... .......... .......... .......... .......... 28% 43.6M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38200K .......... .......... .......... .......... .......... 28% 71.0M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38250K .......... .......... .......... .......... .......... 28% 94.2M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38300K .......... .......... .......... .......... .......... 28% 81.5M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38350K .......... .......... .......... .......... .......... 28% 89.0M 4s 2024-03-08T20:31:41.748 INFO:tasks.workunit.client.1.smithi144.stderr: 38400K .......... .......... .......... .......... .......... 28% 89.8M 4s 2024-03-08T20:31:41.750 INFO:tasks.workunit.client.1.smithi144.stderr: 38450K .......... .......... .......... .......... .......... 28% 13.4M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38500K .......... .......... .......... .......... .......... 28% 11.0M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38550K .......... .......... .......... .......... .......... 28% 52.9M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38600K .......... .......... .......... .......... .......... 28% 56.8M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38650K .......... .......... .......... .......... .......... 28% 86.2M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38700K .......... .......... .......... .......... .......... 28% 139M 4s 2024-03-08T20:31:41.759 INFO:tasks.workunit.client.1.smithi144.stderr: 38750K .......... .......... .......... .......... .......... 28% 150M 4s 2024-03-08T20:31:41.761 INFO:tasks.workunit.client.1.smithi144.stderr: 38800K .......... .......... .......... .......... .......... 28% 22.8M 4s 2024-03-08T20:31:41.761 INFO:tasks.workunit.client.1.smithi144.stderr: 38850K .......... .......... .......... .......... .......... 28% 61.0M 4s 2024-03-08T20:31:41.761 INFO:tasks.workunit.client.1.smithi144.stderr: 38900K .......... .......... .......... .......... .......... 28% 90.6M 4s 2024-03-08T20:31:41.764 INFO:tasks.workunit.client.1.smithi144.stderr: 38950K .......... .......... .......... .......... .......... 28% 23.2M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39000K .......... .......... .......... .......... .......... 28% 41.0M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39050K .......... .......... .......... .......... .......... 28% 40.9M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39100K .......... .......... .......... .......... .......... 28% 42.1M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39150K .......... .......... .......... .......... .......... 28% 80.4M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39200K .......... .......... .......... .......... .......... 28% 70.6M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39250K .......... .......... .......... .......... .......... 28% 95.0M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39300K .......... .......... .......... .......... .......... 28% 89.2M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39350K .......... .......... .......... .......... .......... 29% 98.5M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39400K .......... .......... .......... .......... .......... 29% 102M 4s 2024-03-08T20:31:41.771 INFO:tasks.workunit.client.1.smithi144.stderr: 39450K .......... .......... .......... .......... .......... 29% 70.6M 4s 2024-03-08T20:31:41.776 INFO:tasks.workunit.client.1.smithi144.stderr: 39500K .......... .......... .......... .......... .......... 29% 9.40M 4s 2024-03-08T20:31:41.780 INFO:tasks.workunit.client.1.smithi144.stderr: 39550K .......... .......... .......... .......... .......... 29% 12.3M 4s 2024-03-08T20:31:41.786 INFO:tasks.workunit.client.1.smithi144.stderr: 39600K .......... .......... .......... .......... .......... 29% 9.00M 4s 2024-03-08T20:31:41.791 INFO:tasks.workunit.client.1.smithi144.stderr: 39650K .......... .......... .......... .......... .......... 29% 18.4M 4s 2024-03-08T20:31:41.793 INFO:tasks.workunit.client.1.smithi144.stderr: 39700K .......... .......... .......... .......... .......... 29% 13.1M 4s 2024-03-08T20:31:41.794 INFO:tasks.workunit.client.1.smithi144.stderr: 39750K .......... .......... .......... .......... .......... 29% 29.7M 4s 2024-03-08T20:31:41.795 INFO:tasks.workunit.client.1.smithi144.stderr: 39800K .......... .......... .......... .......... .......... 29% 35.7M 4s 2024-03-08T20:31:41.796 INFO:tasks.workunit.client.1.smithi144.stderr: 39850K .......... .......... .......... .......... .......... 29% 46.2M 4s 2024-03-08T20:31:41.797 INFO:tasks.workunit.client.1.smithi144.stderr: 39900K .......... .......... .......... .......... .......... 29% 72.2M 4s 2024-03-08T20:31:41.798 INFO:tasks.workunit.client.1.smithi144.stderr: 39950K .......... .......... .......... .......... .......... 29% 27.0M 4s 2024-03-08T20:31:41.803 INFO:tasks.workunit.client.1.smithi144.stderr: 40000K .......... .......... .......... .......... .......... 29% 11.4M 4s 2024-03-08T20:31:41.803 INFO:tasks.workunit.client.1.smithi144.stderr: 40050K .......... .......... .......... .......... .......... 29% 72.4M 4s 2024-03-08T20:31:41.808 INFO:tasks.workunit.client.1.smithi144.stderr: 40100K .......... .......... .......... .......... .......... 29% 11.5M 4s 2024-03-08T20:31:41.816 INFO:tasks.workunit.client.1.smithi144.stderr: 40150K .......... .......... .......... .......... .......... 29% 21.9M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40200K .......... .......... .......... .......... .......... 29% 45.4M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40250K .......... .......... .......... .......... .......... 29% 39.4M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40300K .......... .......... .......... .......... .......... 29% 38.8M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40350K .......... .......... .......... .......... .......... 29% 85.2M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40400K .......... .......... .......... .......... .......... 29% 85.8M 4s 2024-03-08T20:31:41.817 INFO:tasks.workunit.client.1.smithi144.stderr: 40450K .......... .......... .......... .......... .......... 29% 66.7M 4s 2024-03-08T20:31:41.818 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether gcc accepts -g... yes 2024-03-08T20:31:41.818 INFO:tasks.workunit.client.1.smithi144.stderr: 40500K .......... .......... .......... .......... .......... 29% 26.3M 4s 2024-03-08T20:31:41.824 INFO:tasks.workunit.client.1.smithi144.stderr: 40550K .......... .......... .......... .......... .......... 29% 14.6M 4s 2024-03-08T20:31:41.825 INFO:tasks.workunit.client.1.smithi144.stderr: 40600K .......... .......... .......... .......... .......... 29% 10.2M 4s 2024-03-08T20:31:41.827 INFO:tasks.workunit.client.1.smithi144.stderr: 40650K .......... .......... .......... .......... .......... 29% 35.0M 4s 2024-03-08T20:31:41.827 INFO:tasks.workunit.client.1.smithi144.stderr: 40700K .......... .......... .......... .......... .......... 30% 61.3M 4s 2024-03-08T20:31:41.832 INFO:tasks.workunit.client.1.smithi144.stderr: 40750K .......... .......... .......... .......... .......... 30% 66.5M 4s 2024-03-08T20:31:41.832 INFO:tasks.workunit.client.1.smithi144.stderr: 40800K .......... .......... .......... .......... .......... 30% 88.5M 4s 2024-03-08T20:31:41.833 INFO:tasks.workunit.client.1.smithi144.stderr: 40850K .......... .......... .......... .......... .......... 30% 94.5M 4s 2024-03-08T20:31:41.833 INFO:tasks.workunit.client.1.smithi144.stderr: 40900K .......... .......... .......... .......... .......... 30% 97.6M 4s 2024-03-08T20:31:41.833 INFO:tasks.workunit.client.1.smithi144.stderr: 40950K .......... .......... .......... .......... .......... 30% 117M 4s 2024-03-08T20:31:41.833 INFO:tasks.workunit.client.1.smithi144.stderr: 41000K .......... .......... .......... .......... .......... 30% 15.8M 4s 2024-03-08T20:31:41.837 INFO:tasks.workunit.client.1.smithi144.stderr: 41050K .......... .......... .......... .......... .......... 30% 11.8M 4s 2024-03-08T20:31:41.845 INFO:tasks.workunit.client.1.smithi144.stderr: 41100K .......... .......... .......... .......... .......... 30% 6.47M 4s 2024-03-08T20:31:41.847 INFO:tasks.workunit.client.1.smithi144.stderr: 41150K .......... .......... .......... .......... .......... 30% 45.8M 4s 2024-03-08T20:31:41.848 INFO:tasks.workunit.client.1.smithi144.stderr: 41200K .......... .......... .......... .......... .......... 30% 44.5M 4s 2024-03-08T20:31:41.849 INFO:tasks.workunit.client.1.smithi144.stderr: 41250K .......... .......... .......... .......... .......... 30% 45.0M 4s 2024-03-08T20:31:41.853 INFO:tasks.workunit.client.1.smithi144.stderr: 41300K .......... .......... .......... .......... .......... 30% 44.7M 4s 2024-03-08T20:31:41.853 INFO:tasks.workunit.client.1.smithi144.stderr: 41350K .......... .......... .......... .......... .......... 30% 53.9M 4s 2024-03-08T20:31:41.853 INFO:tasks.workunit.client.1.smithi144.stderr: 41400K .......... .......... .......... .......... .......... 30% 56.5M 4s 2024-03-08T20:31:41.853 INFO:tasks.workunit.client.1.smithi144.stderr: 41450K .......... .......... .......... .......... .......... 30% 57.6M 4s 2024-03-08T20:31:41.853 INFO:tasks.workunit.client.1.smithi144.stderr: 41500K .......... .......... .......... .......... .......... 30% 51.4M 4s 2024-03-08T20:31:41.856 INFO:tasks.workunit.client.1.smithi144.stderr: 41550K .......... .......... .......... .......... .......... 30% 17.5M 4s 2024-03-08T20:31:41.858 INFO:tasks.workunit.client.1.smithi144.stderr: 41600K .......... .......... .......... .......... .......... 30% 17.7M 4s 2024-03-08T20:31:41.863 INFO:tasks.workunit.client.1.smithi144.stderr: 41650K .......... .......... .......... .......... .......... 30% 10.6M 4s 2024-03-08T20:31:41.864 INFO:tasks.workunit.client.1.smithi144.stderr: 41700K .......... .......... .......... .......... .......... 30% 39.5M 4s 2024-03-08T20:31:41.867 INFO:tasks.workunit.client.1.smithi144.stderr: 41750K .......... .......... .......... .......... .......... 30% 38.4M 4s 2024-03-08T20:31:41.867 INFO:tasks.workunit.client.1.smithi144.stderr: 41800K .......... .......... .......... .......... .......... 30% 35.8M 4s 2024-03-08T20:31:41.868 INFO:tasks.workunit.client.1.smithi144.stderr: 41850K .......... .......... .......... .......... .......... 30% 46.0M 4s 2024-03-08T20:31:41.869 INFO:tasks.workunit.client.1.smithi144.stderr: 41900K .......... .......... .......... .......... .......... 30% 42.3M 4s 2024-03-08T20:31:41.871 INFO:tasks.workunit.client.1.smithi144.stderr: 41950K .......... .......... .......... .......... .......... 30% 47.2M 4s 2024-03-08T20:31:41.871 INFO:tasks.workunit.client.1.smithi144.stderr: 42000K .......... .......... .......... .......... .......... 30% 40.6M 4s 2024-03-08T20:31:41.873 INFO:tasks.workunit.client.1.smithi144.stderr: 42050K .......... .......... .......... .......... .......... 31% 49.5M 4s 2024-03-08T20:31:41.874 INFO:tasks.workunit.client.1.smithi144.stderr: 42100K .......... .......... .......... .......... .......... 31% 23.3M 4s 2024-03-08T20:31:41.881 INFO:tasks.workunit.client.1.smithi144.stderr: 42150K .......... .......... .......... .......... .......... 31% 7.39M 4s 2024-03-08T20:31:41.883 INFO:tasks.workunit.client.1.smithi144.stderr: 42200K .......... .......... .......... .......... .......... 31% 41.7M 4s 2024-03-08T20:31:41.885 INFO:tasks.workunit.client.1.smithi144.stderr: 42250K .......... .......... .......... .......... .......... 31% 22.7M 4s 2024-03-08T20:31:41.886 INFO:tasks.workunit.client.1.smithi144.stderr: 42300K .......... .......... .......... .......... .......... 31% 39.2M 4s 2024-03-08T20:31:41.887 INFO:tasks.workunit.client.1.smithi144.stderr: 42350K .......... .......... .......... .......... .......... 31% 39.9M 4s 2024-03-08T20:31:41.888 INFO:tasks.workunit.client.1.smithi144.stderr: 42400K .......... .......... .......... .......... .......... 31% 38.3M 4s 2024-03-08T20:31:41.889 INFO:tasks.workunit.client.1.smithi144.stderr: 42450K .......... .......... .......... .......... .......... 31% 45.0M 4s 2024-03-08T20:31:41.891 INFO:tasks.workunit.client.1.smithi144.stderr: 42500K .......... .......... .......... .......... .......... 31% 42.6M 4s 2024-03-08T20:31:41.892 INFO:tasks.workunit.client.1.smithi144.stderr: 42550K .......... .......... .......... .......... .......... 31% 46.6M 4s 2024-03-08T20:31:41.892 INFO:tasks.workunit.client.1.smithi144.stderr: 42600K .......... .......... .......... .......... .......... 31% 41.9M 4s 2024-03-08T20:31:41.894 INFO:tasks.workunit.client.1.smithi144.stderr: 42650K .......... .......... .......... .......... .......... 31% 45.8M 4s 2024-03-08T20:31:41.896 INFO:tasks.workunit.client.1.smithi144.stderr: 42700K .......... .......... .......... .......... .......... 31% 21.0M 4s 2024-03-08T20:31:41.901 INFO:tasks.workunit.client.1.smithi144.stderr: 42750K .......... .......... .......... .......... .......... 31% 9.95M 4s 2024-03-08T20:31:41.903 INFO:tasks.workunit.client.1.smithi144.stderr: 42800K .......... .......... .......... .......... .......... 31% 28.5M 4s 2024-03-08T20:31:41.904 INFO:tasks.workunit.client.1.smithi144.stderr: 42850K .......... .......... .......... .......... .......... 31% 32.0M 4s 2024-03-08T20:31:41.906 INFO:tasks.workunit.client.1.smithi144.stderr: 42900K .......... .......... .......... .......... .......... 31% 37.9M 4s 2024-03-08T20:31:41.908 INFO:tasks.workunit.client.1.smithi144.stderr: 42950K .......... .......... .......... .......... .......... 31% 39.3M 4s 2024-03-08T20:31:41.908 INFO:tasks.workunit.client.1.smithi144.stderr: 43000K .......... .......... .......... .......... .......... 31% 42.0M 4s 2024-03-08T20:31:41.910 INFO:tasks.workunit.client.1.smithi144.stderr: 43050K .......... .......... .......... .......... .......... 31% 39.4M 4s 2024-03-08T20:31:41.910 INFO:tasks.workunit.client.1.smithi144.stderr: 43100K .......... .......... .......... .......... .......... 31% 46.3M 4s 2024-03-08T20:31:41.911 INFO:tasks.workunit.client.1.smithi144.stderr: 43150K .......... .......... .......... .......... .......... 31% 43.3M 4s 2024-03-08T20:31:41.913 INFO:tasks.workunit.client.1.smithi144.stderr: 43200K .......... .......... .......... .......... .......... 31% 46.1M 4s 2024-03-08T20:31:41.913 INFO:tasks.workunit.client.1.smithi144.stderr: 43250K .......... .......... .......... .......... .......... 31% 41.1M 4s 2024-03-08T20:31:41.920 INFO:tasks.workunit.client.1.smithi144.stderr: 43300K .......... .......... .......... .......... .......... 31% 8.31M 4s 2024-03-08T20:31:41.923 INFO:tasks.workunit.client.1.smithi144.stderr: 43350K .......... .......... .......... .......... .......... 31% 14.1M 4s 2024-03-08T20:31:41.925 INFO:tasks.workunit.client.1.smithi144.stderr: 43400K .......... .......... .......... .......... .......... 32% 40.8M 4s 2024-03-08T20:31:41.926 INFO:tasks.workunit.client.1.smithi144.stderr: 43450K .......... .......... .......... .......... .......... 32% 32.8M 4s 2024-03-08T20:31:41.928 INFO:tasks.workunit.client.1.smithi144.stderr: 43500K .......... .......... .......... .......... .......... 32% 38.7M 4s 2024-03-08T20:31:41.931 INFO:tasks.workunit.client.1.smithi144.stderr: 43550K .......... .......... .......... .......... .......... 32% 44.8M 4s 2024-03-08T20:31:41.931 INFO:tasks.workunit.client.1.smithi144.stderr: 43600K .......... .......... .......... .......... .......... 32% 42.1M 4s 2024-03-08T20:31:41.931 INFO:tasks.workunit.client.1.smithi144.stderr: 43650K .......... .......... .......... .......... .......... 32% 39.9M 4s 2024-03-08T20:31:41.934 INFO:tasks.workunit.client.1.smithi144.stderr: 43700K .......... .......... .......... .......... .......... 32% 44.8M 4s 2024-03-08T20:31:41.934 INFO:tasks.workunit.client.1.smithi144.stderr: 43750K .......... .......... .......... .......... .......... 32% 50.0M 4s 2024-03-08T20:31:41.934 INFO:tasks.workunit.client.1.smithi144.stderr: 43800K .......... .......... .......... .......... .......... 32% 49.3M 4s 2024-03-08T20:31:41.937 INFO:tasks.workunit.client.1.smithi144.stderr: 43850K .......... .......... .......... .......... .......... 32% 13.8M 4s 2024-03-08T20:31:41.941 INFO:tasks.workunit.client.1.smithi144.stderr: 43900K .......... .......... .......... .......... .......... 32% 13.8M 4s 2024-03-08T20:31:41.943 INFO:tasks.workunit.client.1.smithi144.stderr: 43950K .......... .......... .......... .......... .......... 32% 33.2M 4s 2024-03-08T20:31:41.945 INFO:tasks.workunit.client.1.smithi144.stderr: 44000K .......... .......... .......... .......... .......... 32% 39.9M 4s 2024-03-08T20:31:41.945 INFO:tasks.workunit.client.1.smithi144.stderr: 44050K .......... .......... .......... .......... .......... 32% 41.9M 4s 2024-03-08T20:31:41.947 INFO:tasks.workunit.client.1.smithi144.stderr: 44100K .......... .......... .......... .......... .......... 32% 43.1M 4s 2024-03-08T20:31:41.948 INFO:tasks.workunit.client.1.smithi144.stderr: 44150K .......... .......... .......... .......... .......... 32% 37.9M 4s 2024-03-08T20:31:41.948 INFO:tasks.workunit.client.1.smithi144.stderr: 44200K .......... .......... .......... .......... .......... 32% 46.0M 4s 2024-03-08T20:31:41.950 INFO:tasks.workunit.client.1.smithi144.stderr: 44250K .......... .......... .......... .......... .......... 32% 46.5M 4s 2024-03-08T20:31:41.950 INFO:tasks.workunit.client.1.smithi144.stderr: 44300K .......... .......... .......... .......... .......... 32% 76.2M 4s 2024-03-08T20:31:41.951 INFO:tasks.workunit.client.1.smithi144.stderr: 44350K .......... .......... .......... .......... .......... 32% 24.1M 4s 2024-03-08T20:31:41.955 INFO:tasks.workunit.client.1.smithi144.stderr: 44400K .......... .......... .......... .......... .......... 32% 15.0M 4s 2024-03-08T20:31:41.959 INFO:tasks.workunit.client.1.smithi144.stderr: 44450K .......... .......... .......... .......... .......... 32% 12.4M 4s 2024-03-08T20:31:41.960 INFO:tasks.workunit.client.1.smithi144.stderr: 44500K .......... .......... .......... .......... .......... 32% 32.0M 4s 2024-03-08T20:31:41.962 INFO:tasks.workunit.client.1.smithi144.stderr: 44550K .......... .......... .......... .......... .......... 32% 37.0M 4s 2024-03-08T20:31:41.965 INFO:tasks.workunit.client.1.smithi144.stderr: 44600K .......... .......... .......... .......... .......... 32% 43.9M 4s 2024-03-08T20:31:41.965 INFO:tasks.workunit.client.1.smithi144.stderr: 44650K .......... .......... .......... .......... .......... 32% 51.9M 4s 2024-03-08T20:31:41.965 INFO:tasks.workunit.client.1.smithi144.stderr: 44700K .......... .......... .......... .......... .......... 32% 68.9M 4s 2024-03-08T20:31:41.968 INFO:tasks.workunit.client.1.smithi144.stderr: 44750K .......... .......... .......... .......... .......... 33% 45.4M 4s 2024-03-08T20:31:41.968 INFO:tasks.workunit.client.1.smithi144.stderr: 44800K .......... .......... .......... .......... .......... 33% 48.7M 4s 2024-03-08T20:31:41.969 INFO:tasks.workunit.client.1.smithi144.stderr: 44850K .......... .......... .......... .......... .......... 33% 54.8M 4s 2024-03-08T20:31:41.969 INFO:tasks.workunit.client.1.smithi144.stderr: 44900K .......... .......... .......... .......... .......... 33% 53.0M 4s 2024-03-08T20:31:41.974 INFO:tasks.workunit.client.1.smithi144.stderr: 44950K .......... .......... .......... .......... .......... 33% 8.16M 4s 2024-03-08T20:31:41.976 INFO:tasks.workunit.client.1.smithi144.stderr: 45000K .......... .......... .......... .......... .......... 33% 21.9M 4s 2024-03-08T20:31:41.977 INFO:tasks.workunit.client.1.smithi144.stderr: 45050K .......... .......... .......... .......... .......... 33% 35.3M 4s 2024-03-08T20:31:41.980 INFO:tasks.workunit.client.1.smithi144.stderr: 45100K .......... .......... .......... .......... .......... 33% 43.4M 4s 2024-03-08T20:31:41.980 INFO:tasks.workunit.client.1.smithi144.stderr: 45150K .......... .......... .......... .......... .......... 33% 48.6M 4s 2024-03-08T20:31:41.984 INFO:tasks.workunit.client.1.smithi144.stderr: 45200K .......... .......... .......... .......... .......... 33% 53.7M 4s 2024-03-08T20:31:41.984 INFO:tasks.workunit.client.1.smithi144.stderr: 45250K .......... .......... .......... .......... .......... 33% 52.2M 4s 2024-03-08T20:31:41.984 INFO:tasks.workunit.client.1.smithi144.stderr: 45300K .......... .......... .......... .......... .......... 33% 44.3M 4s 2024-03-08T20:31:41.984 INFO:tasks.workunit.client.1.smithi144.stderr: 45350K .......... .......... .......... .......... .......... 33% 54.2M 4s 2024-03-08T20:31:41.986 INFO:tasks.workunit.client.1.smithi144.stderr: 45400K .......... .......... .......... .......... .......... 33% 17.9M 4s 2024-03-08T20:31:41.993 INFO:tasks.workunit.client.1.smithi144.stderr: 45450K .......... .......... .......... .......... .......... 33% 8.44M 4s 2024-03-08T20:31:41.995 INFO:tasks.workunit.client.1.smithi144.stderr: 45500K .......... .......... .......... .......... .......... 33% 25.1M 4s 2024-03-08T20:31:41.996 INFO:tasks.workunit.client.1.smithi144.stderr: 45550K .......... .......... .......... .......... .......... 33% 29.8M 4s 2024-03-08T20:31:41.997 INFO:tasks.workunit.client.1.smithi144.stderr: 45600K .......... .......... .......... .......... .......... 33% 38.2M 4s 2024-03-08T20:31:41.998 INFO:tasks.workunit.client.1.smithi144.stderr: 45650K .......... .......... .......... .......... .......... 33% 38.1M 4s 2024-03-08T20:31:42.000 INFO:tasks.workunit.client.1.smithi144.stderr: 45700K .......... .......... .......... .......... .......... 33% 43.8M 4s 2024-03-08T20:31:42.003 INFO:tasks.workunit.client.1.smithi144.stderr: 45750K .......... .......... .......... .......... .......... 33% 43.9M 4s 2024-03-08T20:31:42.003 INFO:tasks.workunit.client.1.smithi144.stderr: 45800K .......... .......... .......... .......... .......... 33% 43.0M 4s 2024-03-08T20:31:42.003 INFO:tasks.workunit.client.1.smithi144.stderr: 45850K .......... .......... .......... .......... .......... 33% 48.2M 4s 2024-03-08T20:31:42.005 INFO:tasks.workunit.client.1.smithi144.stderr: 45900K .......... .......... .......... .......... .......... 33% 53.6M 4s 2024-03-08T20:31:42.005 INFO:tasks.workunit.client.1.smithi144.stderr: 45950K .......... .......... .......... .......... .......... 33% 46.2M 4s 2024-03-08T20:31:42.008 INFO:tasks.workunit.client.1.smithi144.stderr: 46000K .......... .......... .......... .......... .......... 33% 15.4M 4s 2024-03-08T20:31:42.010 INFO:tasks.workunit.client.1.smithi144.stderr: 46050K .......... .......... .......... .......... .......... 33% 18.2M 4s 2024-03-08T20:31:42.011 INFO:tasks.workunit.client.0.smithi118.stdout:checking for gcc option to accept ANSI C... none needed 2024-03-08T20:31:42.017 INFO:tasks.workunit.client.1.smithi144.stderr: 46100K .......... .......... .......... .......... .......... 33% 13.6M 4s 2024-03-08T20:31:42.017 INFO:tasks.workunit.client.1.smithi144.stderr: 46150K .......... .......... .......... .......... .......... 34% 44.2M 4s 2024-03-08T20:31:42.017 INFO:tasks.workunit.client.1.smithi144.stderr: 46200K .......... .......... .......... .......... .......... 34% 33.1M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46250K .......... .......... .......... .......... .......... 34% 38.2M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46300K .......... .......... .......... .......... .......... 34% 48.1M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46350K .......... .......... .......... .......... .......... 34% 53.6M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46400K .......... .......... .......... .......... .......... 34% 43.3M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46450K .......... .......... .......... .......... .......... 34% 52.8M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46500K .......... .......... .......... .......... .......... 34% 57.2M 4s 2024-03-08T20:31:42.028 INFO:tasks.workunit.client.1.smithi144.stderr: 46550K .......... .......... .......... .......... .......... 34% 12.3M 4s 2024-03-08T20:31:42.031 INFO:tasks.workunit.client.1.smithi144.stderr: 46600K .......... .......... .......... .......... .......... 34% 12.4M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46650K .......... .......... .......... .......... .......... 34% 31.0M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46700K .......... .......... .......... .......... .......... 34% 88.4M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46750K .......... .......... .......... .......... .......... 34% 79.5M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46800K .......... .......... .......... .......... .......... 34% 87.8M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46850K .......... .......... .......... .......... .......... 34% 73.3M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46900K .......... .......... .......... .......... .......... 34% 98.6M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 46950K .......... .......... .......... .......... .......... 34% 106M 4s 2024-03-08T20:31:42.054 INFO:tasks.workunit.client.1.smithi144.stderr: 47000K .......... .......... .......... .......... .......... 34% 43.4M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47050K .......... .......... .......... .......... .......... 34% 80.7M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47100K .......... .......... .......... .......... .......... 34% 81.7M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47150K .......... .......... .......... .......... .......... 34% 80.2M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47200K .......... .......... .......... .......... .......... 34% 80.5M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47250K .......... .......... .......... .......... .......... 34% 86.8M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47300K .......... .......... .......... .......... .......... 34% 88.6M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47350K .......... .......... .......... .......... .......... 34% 90.7M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47400K .......... .......... .......... .......... .......... 34% 77.6M 4s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47450K .......... .......... .......... .......... .......... 34% 94.6M 3s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47500K .......... .......... .......... .......... .......... 35% 93.3M 3s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47550K .......... .......... .......... .......... .......... 35% 107M 3s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47600K .......... .......... .......... .......... .......... 35% 31.2M 3s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47650K .......... .......... .......... .......... .......... 35% 39.6M 3s 2024-03-08T20:31:42.055 INFO:tasks.workunit.client.1.smithi144.stderr: 47700K .......... .......... .......... .......... .......... 35% 36.9M 3s 2024-03-08T20:31:42.056 INFO:tasks.workunit.client.1.smithi144.stderr: 47750K .......... .......... .......... .......... .......... 35% 27.5M 3s 2024-03-08T20:31:42.056 INFO:tasks.workunit.client.1.smithi144.stderr: 47800K .......... .......... .......... .......... .......... 35% 27.9M 3s 2024-03-08T20:31:42.056 INFO:tasks.workunit.client.1.smithi144.stderr: 47850K .......... .......... .......... .......... .......... 35% 26.5M 3s 2024-03-08T20:31:42.060 INFO:tasks.workunit.client.1.smithi144.stderr: 47900K .......... .......... .......... .......... .......... 35% 24.4M 3s 2024-03-08T20:31:42.060 INFO:tasks.workunit.client.1.smithi144.stderr: 47950K .......... .......... .......... .......... .......... 35% 60.1M 3s 2024-03-08T20:31:42.060 INFO:tasks.workunit.client.1.smithi144.stderr: 48000K .......... .......... .......... .......... .......... 35% 25.2M 3s 2024-03-08T20:31:42.060 INFO:tasks.workunit.client.1.smithi144.stderr: 48050K .......... .......... .......... .......... .......... 35% 29.0M 3s 2024-03-08T20:31:42.062 INFO:tasks.workunit.client.1.smithi144.stderr: 48100K .......... .......... .......... .......... .......... 35% 25.3M 3s 2024-03-08T20:31:42.063 INFO:tasks.workunit.client.1.smithi144.stderr: 48150K .......... .......... .......... .......... .......... 35% 25.8M 3s 2024-03-08T20:31:42.064 INFO:tasks.workunit.client.1.smithi144.stderr: 48200K .......... .......... .......... .......... .......... 35% 42.3M 3s 2024-03-08T20:31:42.066 INFO:tasks.workunit.client.1.smithi144.stderr: 48250K .......... .......... .......... .......... .......... 35% 27.9M 3s 2024-03-08T20:31:42.068 INFO:tasks.workunit.client.1.smithi144.stderr: 48300K .......... .......... .......... .......... .......... 35% 24.3M 3s 2024-03-08T20:31:42.071 INFO:tasks.workunit.client.1.smithi144.stderr: 48350K .......... .......... .......... .......... .......... 35% 28.3M 3s 2024-03-08T20:31:42.071 INFO:tasks.workunit.client.1.smithi144.stderr: 48400K .......... .......... .......... .......... .......... 35% 45.4M 3s 2024-03-08T20:31:42.072 INFO:tasks.workunit.client.1.smithi144.stderr: 48450K .......... .......... .......... .......... .......... 35% 24.6M 3s 2024-03-08T20:31:42.074 INFO:tasks.workunit.client.1.smithi144.stderr: 48500K .......... .......... .......... .......... .......... 35% 24.7M 3s 2024-03-08T20:31:42.076 INFO:tasks.workunit.client.1.smithi144.stderr: 48550K .......... .......... .......... .......... .......... 35% 35.8M 3s 2024-03-08T20:31:42.078 INFO:tasks.workunit.client.1.smithi144.stderr: 48600K .......... .......... .......... .......... .......... 35% 24.5M 3s 2024-03-08T20:31:42.080 INFO:tasks.workunit.client.1.smithi144.stderr: 48650K .......... .......... .......... .......... .......... 35% 20.1M 3s 2024-03-08T20:31:42.083 INFO:tasks.workunit.client.1.smithi144.stderr: 48700K .......... .......... .......... .......... .......... 35% 15.2M 3s 2024-03-08T20:31:42.087 INFO:tasks.workunit.client.1.smithi144.stderr: 48750K .......... .......... .......... .......... .......... 35% 18.8M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 48800K .......... .......... .......... .......... .......... 35% 32.1M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 48850K .......... .......... .......... .......... .......... 36% 38.9M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 48900K .......... .......... .......... .......... .......... 36% 34.7M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 48950K .......... .......... .......... .......... .......... 36% 40.1M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 49000K .......... .......... .......... .......... .......... 36% 47.3M 3s 2024-03-08T20:31:42.101 INFO:tasks.workunit.client.1.smithi144.stderr: 49050K .......... .......... .......... .......... .......... 36% 37.2M 3s 2024-03-08T20:31:42.102 INFO:tasks.workunit.client.1.smithi144.stderr: 49100K .......... .......... .......... .......... .......... 36% 42.7M 3s 2024-03-08T20:31:42.102 INFO:tasks.workunit.client.1.smithi144.stderr: 49150K .......... .......... .......... .......... .......... 36% 23.2M 3s 2024-03-08T20:31:42.102 INFO:tasks.workunit.client.1.smithi144.stderr: 49200K .......... .......... .......... .......... .......... 36% 40.3M 3s 2024-03-08T20:31:42.102 INFO:tasks.workunit.client.1.smithi144.stderr: 49250K .......... .......... .......... .......... .......... 36% 30.5M 3s 2024-03-08T20:31:42.103 INFO:tasks.workunit.client.1.smithi144.stderr: 49300K .......... .......... .......... .......... .......... 36% 18.0M 3s 2024-03-08T20:31:42.106 INFO:tasks.workunit.client.1.smithi144.stderr: 49350K .......... .......... .......... .......... .......... 36% 14.4M 3s 2024-03-08T20:31:42.111 INFO:tasks.workunit.client.1.smithi144.stderr: 49400K .......... .......... .......... .......... .......... 36% 18.7M 3s 2024-03-08T20:31:42.111 INFO:tasks.workunit.client.1.smithi144.stderr: 49450K .......... .......... .......... .......... .......... 36% 79.1M 3s 2024-03-08T20:31:42.111 INFO:tasks.workunit.client.1.smithi144.stderr: 49500K .......... .......... .......... .......... .......... 36% 79.0M 3s 2024-03-08T20:31:42.111 INFO:tasks.workunit.client.1.smithi144.stderr: 49550K .......... .......... .......... .......... .......... 36% 73.1M 3s 2024-03-08T20:31:42.113 INFO:tasks.workunit.client.1.smithi144.stderr: 49600K .......... .......... .......... .......... .......... 36% 121M 3s 2024-03-08T20:31:42.115 INFO:tasks.workunit.client.1.smithi144.stderr: 49650K .......... .......... .......... .......... .......... 36% 11.5M 3s 2024-03-08T20:31:42.117 INFO:tasks.workunit.client.1.smithi144.stderr: 49700K .......... .......... .......... .......... .......... 36% 22.0M 3s 2024-03-08T20:31:42.120 INFO:tasks.workunit.client.1.smithi144.stderr: 49750K .......... .......... .......... .......... .......... 36% 17.6M 3s 2024-03-08T20:31:42.122 INFO:tasks.workunit.client.1.smithi144.stderr: 49800K .......... .......... .......... .......... .......... 36% 28.4M 3s 2024-03-08T20:31:42.124 INFO:tasks.workunit.client.1.smithi144.stderr: 49850K .......... .......... .......... .......... .......... 36% 29.3M 3s 2024-03-08T20:31:42.124 INFO:tasks.workunit.client.1.smithi144.stderr: 49900K .......... .......... .......... .......... .......... 36% 49.8M 3s 2024-03-08T20:31:42.125 INFO:tasks.workunit.client.1.smithi144.stderr: 49950K .......... .......... .......... .......... .......... 36% 50.4M 3s 2024-03-08T20:31:42.127 INFO:tasks.workunit.client.1.smithi144.stderr: 50000K .......... .......... .......... .......... .......... 36% 42.9M 3s 2024-03-08T20:31:42.128 INFO:tasks.workunit.client.1.smithi144.stderr: 50050K .......... .......... .......... .......... .......... 36% 54.1M 3s 2024-03-08T20:31:42.128 INFO:tasks.workunit.client.1.smithi144.stderr: 50100K .......... .......... .......... .......... .......... 36% 49.8M 3s 2024-03-08T20:31:42.131 INFO:tasks.workunit.client.1.smithi144.stderr: 50150K .......... .......... .......... .......... .......... 36% 25.3M 3s 2024-03-08T20:31:42.131 INFO:tasks.workunit.client.1.smithi144.stderr: 50200K .......... .......... .......... .......... .......... 37% 40.3M 3s 2024-03-08T20:31:42.134 INFO:tasks.workunit.client.1.smithi144.stderr: 50250K .......... .......... .......... .......... .......... 37% 25.3M 3s 2024-03-08T20:31:42.203 INFO:tasks.workunit.client.0.smithi118.stdout:checking for style of include used by make... GNU 2024-03-08T20:31:42.222 INFO:tasks.workunit.client.1.smithi144.stderr: 50300K .......... .......... .......... .......... .......... 37% 566K 3s 2024-03-08T20:31:42.224 INFO:tasks.workunit.client.1.smithi144.stderr: 50350K .......... .......... .......... .......... .......... 37% 48.3M 3s 2024-03-08T20:31:42.224 INFO:tasks.workunit.client.1.smithi144.stderr: 50400K .......... .......... .......... .......... .......... 37% 52.1M 3s 2024-03-08T20:31:42.228 INFO:tasks.workunit.client.1.smithi144.stderr: 50450K .......... .......... .......... .......... .......... 37% 45.0M 3s 2024-03-08T20:31:42.228 INFO:tasks.workunit.client.1.smithi144.stderr: 50500K .......... .......... .......... .......... .......... 37% 44.1M 3s 2024-03-08T20:31:42.228 INFO:tasks.workunit.client.1.smithi144.stderr: 50550K .......... .......... .......... .......... .......... 37% 51.4M 3s 2024-03-08T20:31:42.228 INFO:tasks.workunit.client.1.smithi144.stderr: 50600K .......... .......... .......... .......... .......... 37% 49.1M 3s 2024-03-08T20:31:42.236 INFO:tasks.workunit.client.1.smithi144.stderr: 50650K .......... .......... .......... .......... .......... 37% 52.1M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50700K .......... .......... .......... .......... .......... 37% 45.2M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50750K .......... .......... .......... .......... .......... 37% 51.3M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50800K .......... .......... .......... .......... .......... 37% 54.0M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50850K .......... .......... .......... .......... .......... 37% 52.9M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50900K .......... .......... .......... .......... .......... 37% 45.0M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 50950K .......... .......... .......... .......... .......... 37% 52.5M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 51000K .......... .......... .......... .......... .......... 37% 52.8M 3s 2024-03-08T20:31:42.237 INFO:tasks.workunit.client.1.smithi144.stderr: 51050K .......... .......... .......... .......... .......... 37% 52.7M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51100K .......... .......... .......... .......... .......... 37% 42.6M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51150K .......... .......... .......... .......... .......... 37% 53.7M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51200K .......... .......... .......... .......... .......... 37% 52.1M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51250K .......... .......... .......... .......... .......... 37% 52.8M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51300K .......... .......... .......... .......... .......... 37% 44.0M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51350K .......... .......... .......... .......... .......... 37% 52.3M 3s 2024-03-08T20:31:42.253 INFO:tasks.workunit.client.1.smithi144.stderr: 51400K .......... .......... .......... .......... .......... 37% 53.2M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51450K .......... .......... .......... .......... .......... 37% 52.5M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51500K .......... .......... .......... .......... .......... 37% 45.7M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51550K .......... .......... .......... .......... .......... 38% 53.0M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51600K .......... .......... .......... .......... .......... 38% 53.8M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51650K .......... .......... .......... .......... .......... 38% 51.3M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51700K .......... .......... .......... .......... .......... 38% 44.3M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51750K .......... .......... .......... .......... .......... 38% 54.7M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51800K .......... .......... .......... .......... .......... 38% 52.7M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51850K .......... .......... .......... .......... .......... 38% 53.3M 3s 2024-03-08T20:31:42.254 INFO:tasks.workunit.client.1.smithi144.stderr: 51900K .......... .......... .......... .......... .......... 38% 45.6M 3s 2024-03-08T20:31:42.260 INFO:tasks.workunit.client.1.smithi144.stderr: 51950K .......... .......... .......... .......... .......... 38% 51.8M 3s 2024-03-08T20:31:42.260 INFO:tasks.workunit.client.1.smithi144.stderr: 52000K .......... .......... .......... .......... .......... 38% 53.2M 3s 2024-03-08T20:31:42.260 INFO:tasks.workunit.client.1.smithi144.stderr: 52050K .......... .......... .......... .......... .......... 38% 52.4M 3s 2024-03-08T20:31:42.260 INFO:tasks.workunit.client.1.smithi144.stderr: 52100K .......... .......... .......... .......... .......... 38% 46.0M 3s 2024-03-08T20:31:42.260 INFO:tasks.workunit.client.1.smithi144.stderr: 52150K .......... .......... .......... .......... .......... 38% 52.2M 3s 2024-03-08T20:31:42.261 INFO:tasks.workunit.client.1.smithi144.stderr: 52200K .......... .......... .......... .......... .......... 38% 47.4M 3s 2024-03-08T20:31:42.261 INFO:tasks.workunit.client.1.smithi144.stderr: 52250K .......... .......... .......... .......... .......... 38% 47.1M 3s 2024-03-08T20:31:42.262 INFO:tasks.workunit.client.1.smithi144.stderr: 52300K .......... .......... .......... .......... .......... 38% 42.0M 3s 2024-03-08T20:31:42.264 INFO:tasks.workunit.client.1.smithi144.stderr: 52350K .......... .......... .......... .......... .......... 38% 51.7M 3s 2024-03-08T20:31:42.264 INFO:tasks.workunit.client.1.smithi144.stderr: 52400K .......... .......... .......... .......... .......... 38% 53.6M 3s 2024-03-08T20:31:42.264 INFO:tasks.workunit.client.1.smithi144.stderr: 52450K .......... .......... .......... .......... .......... 38% 58.4M 3s 2024-03-08T20:31:42.266 INFO:tasks.workunit.client.1.smithi144.stderr: 52500K .......... .......... .......... .......... .......... 38% 47.7M 3s 2024-03-08T20:31:42.266 INFO:tasks.workunit.client.1.smithi144.stderr: 52550K .......... .......... .......... .......... .......... 38% 49.5M 3s 2024-03-08T20:31:42.299 INFO:tasks.workunit.client.1.smithi144.stderr: 52600K .......... .......... .......... .......... .......... 38% 58.7M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52650K .......... .......... .......... .......... .......... 38% 58.2M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52700K .......... .......... .......... .......... .......... 38% 51.1M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52750K .......... .......... .......... .......... .......... 38% 62.7M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52800K .......... .......... .......... .......... .......... 38% 62.4M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52850K .......... .......... .......... .......... .......... 38% 62.4M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52900K .......... .......... .......... .......... .......... 39% 54.3M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 52950K .......... .......... .......... .......... .......... 39% 65.2M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53000K .......... .......... .......... .......... .......... 39% 64.4M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53050K .......... .......... .......... .......... .......... 39% 62.4M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53100K .......... .......... .......... .......... .......... 39% 57.0M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53150K .......... .......... .......... .......... .......... 39% 68.8M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53200K .......... .......... .......... .......... .......... 39% 70.5M 3s 2024-03-08T20:31:42.300 INFO:tasks.workunit.client.1.smithi144.stderr: 53250K .......... .......... .......... .......... .......... 39% 70.2M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53300K .......... .......... .......... .......... .......... 39% 62.2M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53350K .......... .......... .......... .......... .......... 39% 69.5M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53400K .......... .......... .......... .......... .......... 39% 75.7M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53450K .......... .......... .......... .......... .......... 39% 64.0M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53500K .......... .......... .......... .......... .......... 39% 64.6M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53550K .......... .......... .......... .......... .......... 39% 80.4M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53600K .......... .......... .......... .......... .......... 39% 66.7M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53650K .......... .......... .......... .......... .......... 39% 78.3M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53700K .......... .......... .......... .......... .......... 39% 71.1M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53750K .......... .......... .......... .......... .......... 39% 68.6M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53800K .......... .......... .......... .......... .......... 39% 80.8M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53850K .......... .......... .......... .......... .......... 39% 80.5M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53900K .......... .......... .......... .......... .......... 39% 63.8M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 53950K .......... .......... .......... .......... .......... 39% 79.2M 3s 2024-03-08T20:31:42.301 INFO:tasks.workunit.client.1.smithi144.stderr: 54000K .......... .......... .......... .......... .......... 39% 84.3M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54050K .......... .......... .......... .......... .......... 39% 83.5M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54100K .......... .......... .......... .......... .......... 39% 63.1M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54150K .......... .......... .......... .......... .......... 39% 88.2M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54200K .......... .......... .......... .......... .......... 39% 87.8M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54250K .......... .......... .......... .......... .......... 39% 82.4M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54300K .......... .......... .......... .......... .......... 40% 72.0M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54350K .......... .......... .......... .......... .......... 40% 87.5M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54400K .......... .......... .......... .......... .......... 40% 88.9M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54450K .......... .......... .......... .......... .......... 40% 78.8M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54500K .......... .......... .......... .......... .......... 40% 34.5M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54550K .......... .......... .......... .......... .......... 40% 74.3M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54600K .......... .......... .......... .......... .......... 40% 26.4M 3s 2024-03-08T20:31:42.302 INFO:tasks.workunit.client.1.smithi144.stderr: 54650K .......... .......... .......... .......... .......... 40% 21.7M 3s 2024-03-08T20:31:42.308 INFO:tasks.workunit.client.1.smithi144.stderr: 54700K .......... .......... .......... .......... .......... 40% 22.3M 3s 2024-03-08T20:31:42.308 INFO:tasks.workunit.client.1.smithi144.stderr: 54750K .......... .......... .......... .......... .......... 40% 30.3M 3s 2024-03-08T20:31:42.308 INFO:tasks.workunit.client.1.smithi144.stderr: 54800K .......... .......... .......... .......... .......... 40% 52.5M 3s 2024-03-08T20:31:42.308 INFO:tasks.workunit.client.1.smithi144.stderr: 54850K .......... .......... .......... .......... .......... 40% 30.8M 3s 2024-03-08T20:31:42.308 INFO:tasks.workunit.client.1.smithi144.stderr: 54900K .......... .......... .......... .......... .......... 40% 18.6M 3s 2024-03-08T20:31:42.310 INFO:tasks.workunit.client.1.smithi144.stderr: 54950K .......... .......... .......... .......... .......... 40% 36.3M 3s 2024-03-08T20:31:42.311 INFO:tasks.workunit.client.1.smithi144.stderr: 55000K .......... .......... .......... .......... .......... 40% 25.5M 3s 2024-03-08T20:31:42.312 INFO:tasks.workunit.client.1.smithi144.stderr: 55050K .......... .......... .......... .......... .......... 40% 49.2M 3s 2024-03-08T20:31:42.314 INFO:tasks.workunit.client.1.smithi144.stderr: 55100K .......... .......... .......... .......... .......... 40% 27.9M 3s 2024-03-08T20:31:42.316 INFO:tasks.workunit.client.1.smithi144.stderr: 55150K .......... .......... .......... .......... .......... 40% 24.2M 3s 2024-03-08T20:31:42.318 INFO:tasks.workunit.client.1.smithi144.stderr: 55200K .......... .......... .......... .......... .......... 40% 24.8M 3s 2024-03-08T20:31:42.323 INFO:tasks.workunit.client.1.smithi144.stderr: 55250K .......... .......... .......... .......... .......... 40% 20.5M 3s 2024-03-08T20:31:42.323 INFO:tasks.workunit.client.1.smithi144.stderr: 55300K .......... .......... .......... .......... .......... 40% 44.6M 3s 2024-03-08T20:31:42.323 INFO:tasks.workunit.client.1.smithi144.stderr: 55350K .......... .......... .......... .......... .......... 40% 37.1M 3s 2024-03-08T20:31:42.325 INFO:tasks.workunit.client.1.smithi144.stderr: 55400K .......... .......... .......... .......... .......... 40% 26.7M 3s 2024-03-08T20:31:42.327 INFO:tasks.workunit.client.1.smithi144.stderr: 55450K .......... .......... .......... .......... .......... 40% 30.7M 3s 2024-03-08T20:31:42.328 INFO:tasks.workunit.client.1.smithi144.stderr: 55500K .......... .......... .......... .......... .......... 40% 27.7M 3s 2024-03-08T20:31:42.328 INFO:tasks.workunit.client.1.smithi144.stderr: 55550K .......... .......... .......... .......... .......... 40% 92.2M 3s 2024-03-08T20:31:42.330 INFO:tasks.workunit.client.1.smithi144.stderr: 55600K .......... .......... .......... .......... .......... 40% 27.3M 3s 2024-03-08T20:31:42.332 INFO:tasks.workunit.client.1.smithi144.stderr: 55650K .......... .......... .......... .......... .......... 41% 20.3M 3s 2024-03-08T20:31:42.336 INFO:tasks.workunit.client.1.smithi144.stderr: 55700K .......... .......... .......... .......... .......... 41% 31.1M 3s 2024-03-08T20:31:42.336 INFO:tasks.workunit.client.1.smithi144.stderr: 55750K .......... .......... .......... .......... .......... 41% 34.3M 3s 2024-03-08T20:31:42.337 INFO:tasks.workunit.client.1.smithi144.stderr: 55800K .......... .......... .......... .......... .......... 41% 44.7M 3s 2024-03-08T20:31:42.339 INFO:tasks.workunit.client.1.smithi144.stderr: 55850K .......... .......... .......... .......... .......... 41% 26.3M 3s 2024-03-08T20:31:42.342 INFO:tasks.workunit.client.1.smithi144.stderr: 55900K .......... .......... .......... .......... .......... 41% 23.4M 3s 2024-03-08T20:31:42.348 INFO:tasks.workunit.client.1.smithi144.stderr: 55950K .......... .......... .......... .......... .......... 41% 12.2M 3s 2024-03-08T20:31:42.348 INFO:tasks.workunit.client.1.smithi144.stderr: 56000K .......... .......... .......... .......... .......... 41% 83.2M 3s 2024-03-08T20:31:42.348 INFO:tasks.workunit.client.1.smithi144.stderr: 56050K .......... .......... .......... .......... .......... 41% 115M 3s 2024-03-08T20:31:42.348 INFO:tasks.workunit.client.1.smithi144.stderr: 56100K .......... .......... .......... .......... .......... 41% 29.9M 3s 2024-03-08T20:31:42.350 INFO:tasks.workunit.client.1.smithi144.stderr: 56150K .......... .......... .......... .......... .......... 41% 23.0M 3s 2024-03-08T20:31:42.352 INFO:tasks.workunit.client.1.smithi144.stderr: 56200K .......... .......... .......... .......... .......... 41% 28.1M 3s 2024-03-08T20:31:42.352 INFO:tasks.workunit.client.1.smithi144.stderr: 56250K .......... .......... .......... .......... .......... 41% 73.7M 3s 2024-03-08T20:31:42.354 INFO:tasks.workunit.client.1.smithi144.stderr: 56300K .......... .......... .......... .......... .......... 41% 17.2M 3s 2024-03-08T20:31:42.359 INFO:tasks.workunit.client.1.smithi144.stderr: 56350K .......... .......... .......... .......... .......... 41% 12.4M 3s 2024-03-08T20:31:42.362 INFO:tasks.workunit.client.1.smithi144.stderr: 56400K .......... .......... .......... .......... .......... 41% 31.4M 3s 2024-03-08T20:31:42.363 INFO:tasks.workunit.client.1.smithi144.stderr: 56450K .......... .......... .......... .......... .......... 41% 88.1M 3s 2024-03-08T20:31:42.363 INFO:tasks.workunit.client.1.smithi144.stderr: 56500K .......... .......... .......... .......... .......... 41% 113M 3s 2024-03-08T20:31:42.363 INFO:tasks.workunit.client.1.smithi144.stderr: 56550K .......... .......... .......... .......... .......... 41% 61.4M 3s 2024-03-08T20:31:42.364 INFO:tasks.workunit.client.1.smithi144.stderr: 56600K .......... .......... .......... .......... .......... 41% 21.6M 3s 2024-03-08T20:31:42.367 INFO:tasks.workunit.client.1.smithi144.stderr: 56650K .......... .......... .......... .......... .......... 41% 26.4M 3s 2024-03-08T20:31:42.368 INFO:tasks.workunit.client.1.smithi144.stderr: 56700K .......... .......... .......... .......... .......... 41% 25.1M 3s 2024-03-08T20:31:42.369 INFO:tasks.workunit.client.1.smithi144.stderr: 56750K .......... .......... .......... .......... .......... 41% 41.3M 3s 2024-03-08T20:31:42.371 INFO:tasks.workunit.client.1.smithi144.stderr: 56800K .......... .......... .......... .......... .......... 41% 34.3M 3s 2024-03-08T20:31:42.372 INFO:tasks.workunit.client.1.smithi144.stderr: 56850K .......... .......... .......... .......... .......... 41% 25.2M 3s 2024-03-08T20:31:42.374 INFO:tasks.workunit.client.1.smithi144.stderr: 56900K .......... .......... .......... .......... .......... 41% 28.1M 3s 2024-03-08T20:31:42.375 INFO:tasks.workunit.client.1.smithi144.stderr: 56950K .......... .......... .......... .......... .......... 41% 34.7M 3s 2024-03-08T20:31:42.377 INFO:tasks.workunit.client.1.smithi144.stderr: 57000K .......... .......... .......... .......... .......... 42% 28.9M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57050K .......... .......... .......... .......... .......... 42% 28.1M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57100K .......... .......... .......... .......... .......... 42% 26.8M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57150K .......... .......... .......... .......... .......... 42% 27.6M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57200K .......... .......... .......... .......... .......... 42% 22.8M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57250K .......... .......... .......... .......... .......... 42% 59.4M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57300K .......... .......... .......... .......... .......... 42% 18.9M 3s 2024-03-08T20:31:42.390 INFO:tasks.workunit.client.1.smithi144.stderr: 57350K .......... .......... .......... .......... .......... 42% 58.2M 3s 2024-03-08T20:31:42.392 INFO:tasks.workunit.client.1.smithi144.stderr: 57400K .......... .......... .......... .......... .......... 42% 22.2M 3s 2024-03-08T20:31:42.395 INFO:tasks.workunit.client.1.smithi144.stderr: 57450K .......... .......... .......... .......... .......... 42% 23.4M 3s 2024-03-08T20:31:42.396 INFO:tasks.workunit.client.1.smithi144.stderr: 57500K .......... .......... .......... .......... .......... 42% 41.6M 3s 2024-03-08T20:31:42.398 INFO:tasks.workunit.client.1.smithi144.stderr: 57550K .......... .......... .......... .......... .......... 42% 23.9M 3s 2024-03-08T20:31:42.398 INFO:tasks.workunit.client.1.smithi144.stderr: 57600K .......... .......... .......... .......... .......... 42% 41.4M 3s 2024-03-08T20:31:42.401 INFO:tasks.workunit.client.1.smithi144.stderr: 57650K .......... .......... .......... .......... .......... 42% 22.5M 3s 2024-03-08T20:31:42.401 INFO:tasks.workunit.client.1.smithi144.stderr: 57700K .......... .......... .......... .......... .......... 42% 50.6M 3s 2024-03-08T20:31:42.404 INFO:tasks.workunit.client.1.smithi144.stderr: 57750K .......... .......... .......... .......... .......... 42% 21.5M 3s 2024-03-08T20:31:42.406 INFO:tasks.workunit.client.1.smithi144.stderr: 57800K .......... .......... .......... .......... .......... 42% 24.4M 3s 2024-03-08T20:31:42.406 INFO:tasks.workunit.client.1.smithi144.stderr: 57850K .......... .......... .......... .......... .......... 42% 41.7M 3s 2024-03-08T20:31:42.408 INFO:tasks.workunit.client.1.smithi144.stderr: 57900K .......... .......... .......... .......... .......... 42% 22.6M 3s 2024-03-08T20:31:42.410 INFO:tasks.workunit.client.1.smithi144.stderr: 57950K .......... .......... .......... .......... .......... 42% 27.6M 3s 2024-03-08T20:31:42.413 INFO:tasks.workunit.client.1.smithi144.stderr: 58000K .......... .......... .......... .......... .......... 42% 27.7M 3s 2024-03-08T20:31:42.415 INFO:tasks.workunit.client.1.smithi144.stderr: 58050K .......... .......... .......... .......... .......... 42% 23.0M 3s 2024-03-08T20:31:42.415 INFO:tasks.workunit.client.1.smithi144.stderr: 58100K .......... .......... .......... .......... .......... 42% 54.4M 3s 2024-03-08T20:31:42.417 INFO:tasks.workunit.client.1.smithi144.stderr: 58150K .......... .......... .......... .......... .......... 42% 28.4M 3s 2024-03-08T20:31:42.419 INFO:tasks.workunit.client.1.smithi144.stderr: 58200K .......... .......... .......... .......... .......... 42% 26.6M 3s 2024-03-08T20:31:42.421 INFO:tasks.workunit.client.1.smithi144.stderr: 58250K .......... .......... .......... .......... .......... 42% 24.5M 3s 2024-03-08T20:31:42.423 INFO:tasks.workunit.client.1.smithi144.stderr: 58300K .......... .......... .......... .......... .......... 42% 25.4M 3s 2024-03-08T20:31:42.423 INFO:tasks.workunit.client.1.smithi144.stderr: 58350K .......... .......... .......... .......... .......... 43% 42.4M 3s 2024-03-08T20:31:42.426 INFO:tasks.workunit.client.1.smithi144.stderr: 58400K .......... .......... .......... .......... .......... 43% 23.7M 3s 2024-03-08T20:31:42.427 INFO:tasks.workunit.client.1.smithi144.stderr: 58450K .......... .......... .......... .......... .......... 43% 34.4M 3s 2024-03-08T20:31:42.429 INFO:tasks.workunit.client.1.smithi144.stderr: 58500K .......... .......... .......... .......... .......... 43% 26.6M 3s 2024-03-08T20:31:42.432 INFO:tasks.workunit.client.1.smithi144.stderr: 58550K .......... .......... .......... .......... .......... 43% 26.0M 3s 2024-03-08T20:31:42.432 INFO:tasks.workunit.client.1.smithi144.stderr: 58600K .......... .......... .......... .......... .......... 43% 56.2M 3s 2024-03-08T20:31:42.433 INFO:tasks.workunit.client.1.smithi144.stderr: 58650K .......... .......... .......... .......... .......... 43% 22.7M 3s 2024-03-08T20:31:42.435 INFO:tasks.workunit.client.1.smithi144.stderr: 58700K .......... .......... .......... .......... .......... 43% 31.3M 3s 2024-03-08T20:31:42.437 INFO:tasks.workunit.client.1.smithi144.stderr: 58750K .......... .......... .......... .......... .......... 43% 21.1M 3s 2024-03-08T20:31:42.439 INFO:tasks.workunit.client.1.smithi144.stderr: 58800K .......... .......... .......... .......... .......... 43% 31.8M 3s 2024-03-08T20:31:42.441 INFO:tasks.workunit.client.1.smithi144.stderr: 58850K .......... .......... .......... .......... .......... 43% 38.4M 3s 2024-03-08T20:31:42.442 INFO:tasks.workunit.client.1.smithi144.stderr: 58900K .......... .......... .......... .......... .......... 43% 24.3M 3s 2024-03-08T20:31:42.444 INFO:tasks.workunit.client.1.smithi144.stderr: 58950K .......... .......... .......... .......... .......... 43% 29.1M 3s 2024-03-08T20:31:42.446 INFO:tasks.workunit.client.1.smithi144.stderr: 59000K .......... .......... .......... .......... .......... 43% 21.7M 3s 2024-03-08T20:31:42.448 INFO:tasks.workunit.client.1.smithi144.stderr: 59050K .......... .......... .......... .......... .......... 43% 38.8M 3s 2024-03-08T20:31:42.449 INFO:tasks.workunit.client.1.smithi144.stderr: 59100K .......... .......... .......... .......... .......... 43% 42.5M 3s 2024-03-08T20:31:42.451 INFO:tasks.workunit.client.1.smithi144.stderr: 59150K .......... .......... .......... .......... .......... 43% 28.0M 3s 2024-03-08T20:31:42.453 INFO:tasks.workunit.client.1.smithi144.stderr: 59200K .......... .......... .......... .......... .......... 43% 25.5M 3s 2024-03-08T20:31:42.455 INFO:tasks.workunit.client.1.smithi144.stderr: 59250K .......... .......... .......... .......... .......... 43% 26.8M 3s 2024-03-08T20:31:42.455 INFO:tasks.workunit.client.1.smithi144.stderr: 59300K .......... .......... .......... .......... .......... 43% 43.3M 3s 2024-03-08T20:31:42.457 INFO:tasks.workunit.client.1.smithi144.stderr: 59350K .......... .......... .......... .......... .......... 43% 24.9M 3s 2024-03-08T20:31:42.459 INFO:tasks.workunit.client.1.smithi144.stderr: 59400K .......... .......... .......... .......... .......... 43% 28.2M 3s 2024-03-08T20:31:42.461 INFO:tasks.workunit.client.1.smithi144.stderr: 59450K .......... .......... .......... .......... .......... 43% 26.1M 3s 2024-03-08T20:31:42.463 INFO:tasks.workunit.client.1.smithi144.stderr: 59500K .......... .......... .......... .......... .......... 43% 28.3M 3s 2024-03-08T20:31:42.464 INFO:tasks.workunit.client.1.smithi144.stderr: 59550K .......... .......... .......... .......... .......... 43% 26.7M 3s 2024-03-08T20:31:42.465 INFO:tasks.workunit.client.1.smithi144.stderr: 59600K .......... .......... .......... .......... .......... 43% 38.3M 3s 2024-03-08T20:31:42.467 INFO:tasks.workunit.client.1.smithi144.stderr: 59650K .......... .......... .......... .......... .......... 43% 34.7M 3s 2024-03-08T20:31:42.469 INFO:tasks.workunit.client.1.smithi144.stderr: 59700K .......... .......... .......... .......... .......... 44% 23.5M 3s 2024-03-08T20:31:42.472 INFO:tasks.workunit.client.1.smithi144.stderr: 59750K .......... .......... .......... .......... .......... 44% 28.1M 3s 2024-03-08T20:31:42.473 INFO:tasks.workunit.client.1.smithi144.stderr: 59800K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-03-08T20:31:42.474 INFO:tasks.workunit.client.1.smithi144.stderr: 59850K .......... .......... .......... .......... .......... 44% 42.5M 3s 2024-03-08T20:31:42.476 INFO:tasks.workunit.client.1.smithi144.stderr: 59900K .......... .......... .......... .......... .......... 44% 28.5M 3s 2024-03-08T20:31:42.480 INFO:tasks.workunit.client.1.smithi144.stderr: 59950K .......... .......... .......... .......... .......... 44% 17.7M 3s 2024-03-08T20:31:42.480 INFO:tasks.workunit.client.1.smithi144.stderr: 60000K .......... .......... .......... .......... .......... 44% 63.3M 3s 2024-03-08T20:31:42.482 INFO:tasks.workunit.client.1.smithi144.stderr: 60050K .......... .......... .......... .......... .......... 44% 25.6M 3s 2024-03-08T20:31:42.482 INFO:tasks.workunit.client.1.smithi144.stderr: 60100K .......... .......... .......... .......... .......... 44% 54.5M 3s 2024-03-08T20:31:42.484 INFO:tasks.workunit.client.1.smithi144.stderr: 60150K .......... .......... .......... .......... .......... 44% 25.8M 3s 2024-03-08T20:31:42.486 INFO:tasks.workunit.client.1.smithi144.stderr: 60200K .......... .......... .......... .......... .......... 44% 25.6M 3s 2024-03-08T20:31:42.488 INFO:tasks.workunit.client.1.smithi144.stderr: 60250K .......... .......... .......... .......... .......... 44% 27.1M 3s 2024-03-08T20:31:42.491 INFO:tasks.workunit.client.1.smithi144.stderr: 60300K .......... .......... .......... .......... .......... 44% 27.4M 3s 2024-03-08T20:31:42.491 INFO:tasks.workunit.client.1.smithi144.stderr: 60350K .......... .......... .......... .......... .......... 44% 41.0M 3s 2024-03-08T20:31:42.492 INFO:tasks.workunit.client.1.smithi144.stderr: 60400K .......... .......... .......... .......... .......... 44% 31.2M 3s 2024-03-08T20:31:42.494 INFO:tasks.workunit.client.1.smithi144.stderr: 60450K .......... .......... .......... .......... .......... 44% 26.6M 3s 2024-03-08T20:31:42.496 INFO:tasks.workunit.client.1.smithi144.stderr: 60500K .......... .......... .......... .......... .......... 44% 25.7M 3s 2024-03-08T20:31:42.499 INFO:tasks.workunit.client.1.smithi144.stderr: 60550K .......... .......... .......... .......... .......... 44% 25.1M 3s 2024-03-08T20:31:42.499 INFO:tasks.workunit.client.1.smithi144.stderr: 60600K .......... .......... .......... .......... .......... 44% 60.0M 3s 2024-03-08T20:31:42.501 INFO:tasks.workunit.client.1.smithi144.stderr: 60650K .......... .......... .......... .......... .......... 44% 22.6M 3s 2024-03-08T20:31:42.503 INFO:tasks.workunit.client.1.smithi144.stderr: 60700K .......... .......... .......... .......... .......... 44% 30.2M 3s 2024-03-08T20:31:42.505 INFO:tasks.workunit.client.1.smithi144.stderr: 60750K .......... .......... .......... .......... .......... 44% 25.0M 3s 2024-03-08T20:31:42.507 INFO:tasks.workunit.client.1.smithi144.stderr: 60800K .......... .......... .......... .......... .......... 44% 26.0M 3s 2024-03-08T20:31:42.507 INFO:tasks.workunit.client.1.smithi144.stderr: 60850K .......... .......... .......... .......... .......... 44% 48.3M 3s 2024-03-08T20:31:42.509 INFO:tasks.workunit.client.1.smithi144.stderr: 60900K .......... .......... .......... .......... .......... 44% 23.4M 3s 2024-03-08T20:31:42.511 INFO:tasks.workunit.client.1.smithi144.stderr: 60950K .......... .......... .......... .......... .......... 44% 27.7M 3s 2024-03-08T20:31:42.513 INFO:tasks.workunit.client.1.smithi144.stderr: 61000K .......... .......... .......... .......... .......... 44% 33.7M 3s 2024-03-08T20:31:42.515 INFO:tasks.workunit.client.1.smithi144.stderr: 61050K .......... .......... .......... .......... .......... 45% 22.9M 3s 2024-03-08T20:31:42.516 INFO:tasks.workunit.client.1.smithi144.stderr: 61100K .......... .......... .......... .......... .......... 45% 45.0M 3s 2024-03-08T20:31:42.518 INFO:tasks.workunit.client.1.smithi144.stderr: 61150K .......... .......... .......... .......... .......... 45% 24.6M 3s 2024-03-08T20:31:42.520 INFO:tasks.workunit.client.1.smithi144.stderr: 61200K .......... .......... .......... .......... .......... 45% 26.3M 3s 2024-03-08T20:31:42.522 INFO:tasks.workunit.client.1.smithi144.stderr: 61250K .......... .......... .......... .......... .......... 45% 32.0M 3s 2024-03-08T20:31:42.524 INFO:tasks.workunit.client.1.smithi144.stderr: 61300K .......... .......... .......... .......... .......... 45% 25.0M 3s 2024-03-08T20:31:42.524 INFO:tasks.workunit.client.1.smithi144.stderr: 61350K .......... .......... .......... .......... .......... 45% 52.3M 3s 2024-03-08T20:31:42.526 INFO:tasks.workunit.client.1.smithi144.stderr: 61400K .......... .......... .......... .......... .......... 45% 21.7M 3s 2024-03-08T20:31:42.528 INFO:tasks.workunit.client.1.smithi144.stderr: 61450K .......... .......... .......... .......... .......... 45% 30.8M 3s 2024-03-08T20:31:42.529 INFO:tasks.workunit.client.1.smithi144.stderr: 61500K .......... .......... .......... .......... .......... 45% 31.8M 3s 2024-03-08T20:31:42.531 INFO:tasks.workunit.client.1.smithi144.stderr: 61550K .......... .......... .......... .......... .......... 45% 25.8M 3s 2024-03-08T20:31:42.532 INFO:tasks.workunit.client.1.smithi144.stderr: 61600K .......... .......... .......... .......... .......... 45% 40.3M 3s 2024-03-08T20:31:42.535 INFO:tasks.workunit.client.1.smithi144.stderr: 61650K .......... .......... .......... .......... .......... 45% 25.8M 3s 2024-03-08T20:31:42.536 INFO:tasks.workunit.client.1.smithi144.stderr: 61700K .......... .......... .......... .......... .......... 45% 26.0M 3s 2024-03-08T20:31:42.538 INFO:tasks.workunit.client.1.smithi144.stderr: 61750K .......... .......... .......... .......... .......... 45% 32.4M 3s 2024-03-08T20:31:42.541 INFO:tasks.workunit.client.1.smithi144.stderr: 61800K .......... .......... .......... .......... .......... 45% 24.7M 3s 2024-03-08T20:31:42.541 INFO:tasks.workunit.client.1.smithi144.stderr: 61850K .......... .......... .......... .......... .......... 45% 50.0M 3s 2024-03-08T20:31:42.543 INFO:tasks.workunit.client.1.smithi144.stderr: 61900K .......... .......... .......... .......... .......... 45% 25.3M 3s 2024-03-08T20:31:42.545 INFO:tasks.workunit.client.1.smithi144.stderr: 61950K .......... .......... .......... .......... .......... 45% 24.6M 3s 2024-03-08T20:31:42.547 INFO:tasks.workunit.client.1.smithi144.stderr: 62000K .......... .......... .......... .......... .......... 45% 27.2M 3s 2024-03-08T20:31:42.549 INFO:tasks.workunit.client.1.smithi144.stderr: 62050K .......... .......... .......... .......... .......... 45% 60.0M 3s 2024-03-08T20:31:42.549 INFO:tasks.workunit.client.1.smithi144.stderr: 62100K .......... .......... .......... .......... .......... 45% 27.1M 3s 2024-03-08T20:31:42.551 INFO:tasks.workunit.client.1.smithi144.stderr: 62150K .......... .......... .......... .......... .......... 45% 24.8M 3s 2024-03-08T20:31:42.553 INFO:tasks.workunit.client.1.smithi144.stderr: 62200K .......... .......... .......... .......... .......... 45% 29.2M 3s 2024-03-08T20:31:42.555 INFO:tasks.workunit.client.1.smithi144.stderr: 62250K .......... .......... .......... .......... .......... 45% 27.1M 3s 2024-03-08T20:31:42.557 INFO:tasks.workunit.client.1.smithi144.stderr: 62300K .......... .......... .......... .......... .......... 45% 25.7M 3s 2024-03-08T20:31:42.558 INFO:tasks.workunit.client.1.smithi144.stderr: 62350K .......... .......... .......... .......... .......... 45% 35.7M 3s 2024-03-08T20:31:42.560 INFO:tasks.workunit.client.1.smithi144.stderr: 62400K .......... .......... .......... .......... .......... 46% 28.8M 3s 2024-03-08T20:31:42.562 INFO:tasks.workunit.client.1.smithi144.stderr: 62450K .......... .......... .......... .......... .......... 46% 25.9M 3s 2024-03-08T20:31:42.563 INFO:tasks.workunit.client.1.smithi144.stderr: 62500K .......... .......... .......... .......... .......... 46% 24.3M 3s 2024-03-08T20:31:42.564 INFO:tasks.workunit.client.1.smithi144.stderr: 62550K .......... .......... .......... .......... .......... 46% 39.8M 3s 2024-03-08T20:31:42.567 INFO:tasks.workunit.client.1.smithi144.stderr: 62600K .......... .......... .......... .......... .......... 46% 27.7M 3s 2024-03-08T20:31:42.568 INFO:tasks.workunit.client.1.smithi144.stderr: 62650K .......... .......... .......... .......... .......... 46% 25.3M 3s 2024-03-08T20:31:42.571 INFO:tasks.workunit.client.1.smithi144.stderr: 62700K .......... .......... .......... .......... .......... 46% 25.2M 3s 2024-03-08T20:31:42.573 INFO:tasks.workunit.client.1.smithi144.stderr: 62750K .......... .......... .......... .......... .......... 46% 23.7M 3s 2024-03-08T20:31:42.573 INFO:tasks.workunit.client.1.smithi144.stderr: 62800K .......... .......... .......... .......... .......... 46% 42.7M 3s 2024-03-08T20:31:42.575 INFO:tasks.workunit.client.1.smithi144.stderr: 62850K .......... .......... .......... .......... .......... 46% 34.1M 3s 2024-03-08T20:31:42.577 INFO:tasks.workunit.client.1.smithi144.stderr: 62900K .......... .......... .......... .......... .......... 46% 27.7M 3s 2024-03-08T20:31:42.579 INFO:tasks.workunit.client.1.smithi144.stderr: 62950K .......... .......... .......... .......... .......... 46% 26.9M 3s 2024-03-08T20:31:42.581 INFO:tasks.workunit.client.1.smithi144.stderr: 63000K .......... .......... .......... .......... .......... 46% 30.2M 3s 2024-03-08T20:31:42.582 INFO:tasks.workunit.client.1.smithi144.stderr: 63050K .......... .......... .......... .......... .......... 46% 31.7M 3s 2024-03-08T20:31:42.585 INFO:tasks.workunit.client.1.smithi144.stderr: 63100K .......... .......... .......... .......... .......... 46% 16.5M 3s 2024-03-08T20:31:42.586 INFO:tasks.workunit.client.1.smithi144.stderr: 63150K .......... .......... .......... .......... .......... 46% 42.8M 3s 2024-03-08T20:31:42.589 INFO:tasks.workunit.client.1.smithi144.stderr: 63200K .......... .......... .......... .......... .......... 46% 25.2M 3s 2024-03-08T20:31:42.591 INFO:tasks.workunit.client.1.smithi144.stderr: 63250K .......... .......... .......... .......... .......... 46% 25.0M 3s 2024-03-08T20:31:42.591 INFO:tasks.workunit.client.1.smithi144.stderr: 63300K .......... .......... .......... .......... .......... 46% 49.0M 3s 2024-03-08T20:31:42.594 INFO:tasks.workunit.client.1.smithi144.stderr: 63350K .......... .......... .......... .......... .......... 46% 19.4M 3s 2024-03-08T20:31:42.595 INFO:tasks.workunit.client.1.smithi144.stderr: 63400K .......... .......... .......... .......... .......... 46% 53.1M 3s 2024-03-08T20:31:42.596 INFO:tasks.workunit.client.1.smithi144.stderr: 63450K .......... .......... .......... .......... .......... 46% 24.1M 3s 2024-03-08T20:31:42.598 INFO:tasks.workunit.client.1.smithi144.stderr: 63500K .......... .......... .......... .......... .......... 46% 25.4M 3s 2024-03-08T20:31:42.600 INFO:tasks.workunit.client.1.smithi144.stderr: 63550K .......... .......... .......... .......... .......... 46% 32.7M 3s 2024-03-08T20:31:42.601 INFO:tasks.workunit.client.1.smithi144.stderr: 63600K .......... .......... .......... .......... .......... 46% 30.6M 3s 2024-03-08T20:31:42.603 INFO:tasks.workunit.client.1.smithi144.stderr: 63650K .......... .......... .......... .......... .......... 46% 33.3M 3s 2024-03-08T20:31:42.605 INFO:tasks.workunit.client.1.smithi144.stderr: 63700K .......... .......... .......... .......... .......... 46% 26.8M 3s 2024-03-08T20:31:42.607 INFO:tasks.workunit.client.1.smithi144.stderr: 63750K .......... .......... .......... .......... .......... 46% 22.6M 3s 2024-03-08T20:31:42.609 INFO:tasks.workunit.client.1.smithi144.stderr: 63800K .......... .......... .......... .......... .......... 47% 37.6M 3s 2024-03-08T20:31:42.610 INFO:tasks.workunit.client.1.smithi144.stderr: 63850K .......... .......... .......... .......... .......... 47% 25.6M 3s 2024-03-08T20:31:42.611 INFO:tasks.workunit.client.1.smithi144.stderr: 63900K .......... .......... .......... .......... .......... 47% 37.1M 3s 2024-03-08T20:31:42.613 INFO:tasks.workunit.client.1.smithi144.stderr: 63950K .......... .......... .......... .......... .......... 47% 28.8M 3s 2024-03-08T20:31:42.615 INFO:tasks.workunit.client.1.smithi144.stderr: 64000K .......... .......... .......... .......... .......... 47% 31.4M 3s 2024-03-08T20:31:42.617 INFO:tasks.workunit.client.1.smithi144.stderr: 64050K .......... .......... .......... .......... .......... 47% 24.3M 3s 2024-03-08T20:31:42.619 INFO:tasks.workunit.client.1.smithi144.stderr: 64100K .......... .......... .......... .......... .......... 47% 27.7M 3s 2024-03-08T20:31:42.620 INFO:tasks.workunit.client.1.smithi144.stderr: 64150K .......... .......... .......... .......... .......... 47% 41.8M 3s 2024-03-08T20:31:42.621 INFO:tasks.workunit.client.1.smithi144.stderr: 64200K .......... .......... .......... .......... .......... 47% 23.4M 3s 2024-03-08T20:31:42.623 INFO:tasks.workunit.client.1.smithi144.stderr: 64250K .......... .......... .......... .......... .......... 47% 36.1M 3s 2024-03-08T20:31:42.625 INFO:tasks.workunit.client.1.smithi144.stderr: 64300K .......... .......... .......... .......... .......... 47% 26.0M 3s 2024-03-08T20:31:42.627 INFO:tasks.workunit.client.1.smithi144.stderr: 64350K .......... .......... .......... .......... .......... 47% 24.5M 3s 2024-03-08T20:31:42.627 INFO:tasks.workunit.client.1.smithi144.stderr: 64400K .......... .......... .......... .......... .......... 47% 51.6M 3s 2024-03-08T20:31:42.630 INFO:tasks.workunit.client.1.smithi144.stderr: 64450K .......... .......... .......... .......... .......... 47% 23.9M 3s 2024-03-08T20:31:42.631 INFO:tasks.workunit.client.1.smithi144.stderr: 64500K .......... .......... .......... .......... .......... 47% 34.7M 3s 2024-03-08T20:31:42.635 INFO:tasks.workunit.client.1.smithi144.stderr: 64550K .......... .......... .......... .......... .......... 47% 17.3M 3s 2024-03-08T20:31:42.635 INFO:tasks.workunit.client.1.smithi144.stderr: 64600K .......... .......... .......... .......... .......... 47% 58.6M 3s 2024-03-08T20:31:42.636 INFO:tasks.workunit.client.1.smithi144.stderr: 64650K .......... .......... .......... .......... .......... 47% 31.9M 3s 2024-03-08T20:31:42.638 INFO:tasks.workunit.client.1.smithi144.stderr: 64700K .......... .......... .......... .......... .......... 47% 30.5M 3s 2024-03-08T20:31:42.640 INFO:tasks.workunit.client.1.smithi144.stderr: 64750K .......... .......... .......... .......... .......... 47% 28.0M 3s 2024-03-08T20:31:42.642 INFO:tasks.workunit.client.1.smithi144.stderr: 64800K .......... .......... .......... .......... .......... 47% 27.0M 3s 2024-03-08T20:31:42.644 INFO:tasks.workunit.client.1.smithi144.stderr: 64850K .......... .......... .......... .......... .......... 47% 25.7M 3s 2024-03-08T20:31:42.644 INFO:tasks.workunit.client.1.smithi144.stderr: 64900K .......... .......... .......... .......... .......... 47% 50.6M 3s 2024-03-08T20:31:42.647 INFO:tasks.workunit.client.1.smithi144.stderr: 64950K .......... .......... .......... .......... .......... 47% 22.0M 3s 2024-03-08T20:31:42.648 INFO:tasks.workunit.client.1.smithi144.stderr: 65000K .......... .......... .......... .......... .......... 47% 33.6M 3s 2024-03-08T20:31:42.651 INFO:tasks.workunit.client.1.smithi144.stderr: 65050K .......... .......... .......... .......... .......... 47% 16.8M 3s 2024-03-08T20:31:42.654 INFO:tasks.workunit.client.1.smithi144.stderr: 65100K .......... .......... .......... .......... .......... 47% 28.4M 3s 2024-03-08T20:31:42.654 INFO:tasks.workunit.client.1.smithi144.stderr: 65150K .......... .......... .......... .......... .......... 48% 75.8M 3s 2024-03-08T20:31:42.655 INFO:tasks.workunit.client.1.smithi144.stderr: 65200K .......... .......... .......... .......... .......... 48% 30.6M 3s 2024-03-08T20:31:42.657 INFO:tasks.workunit.client.1.smithi144.stderr: 65250K .......... .......... .......... .......... .......... 48% 35.4M 3s 2024-03-08T20:31:42.659 INFO:tasks.workunit.client.1.smithi144.stderr: 65300K .......... .......... .......... .......... .......... 48% 23.5M 3s 2024-03-08T20:31:42.660 INFO:tasks.workunit.client.1.smithi144.stderr: 65350K .......... .......... .......... .......... .......... 48% 28.2M 3s 2024-03-08T20:31:42.661 INFO:tasks.workunit.client.1.smithi144.stderr: 65400K .......... .......... .......... .......... .......... 48% 38.4M 3s 2024-03-08T20:31:42.663 INFO:tasks.workunit.client.1.smithi144.stderr: 65450K .......... .......... .......... .......... .......... 48% 28.4M 3s 2024-03-08T20:31:42.665 INFO:tasks.workunit.client.1.smithi144.stderr: 65500K .......... .......... .......... .......... .......... 48% 27.4M 3s 2024-03-08T20:31:42.667 INFO:tasks.workunit.client.1.smithi144.stderr: 65550K .......... .......... .......... .......... .......... 48% 27.0M 3s 2024-03-08T20:31:42.669 INFO:tasks.workunit.client.1.smithi144.stderr: 65600K .......... .......... .......... .......... .......... 48% 24.2M 3s 2024-03-08T20:31:42.669 INFO:tasks.workunit.client.1.smithi144.stderr: 65650K .......... .......... .......... .......... .......... 48% 43.8M 3s 2024-03-08T20:31:42.672 INFO:tasks.workunit.client.1.smithi144.stderr: 65700K .......... .......... .......... .......... .......... 48% 27.2M 3s 2024-03-08T20:31:42.673 INFO:tasks.workunit.client.1.smithi144.stderr: 65750K .......... .......... .......... .......... .......... 48% 27.8M 3s 2024-03-08T20:31:42.675 INFO:tasks.workunit.client.1.smithi144.stderr: 65800K .......... .......... .......... .......... .......... 48% 27.7M 3s 2024-03-08T20:31:42.677 INFO:tasks.workunit.client.1.smithi144.stderr: 65850K .......... .......... .......... .......... .......... 48% 26.2M 3s 2024-03-08T20:31:42.678 INFO:tasks.workunit.client.1.smithi144.stderr: 65900K .......... .......... .......... .......... .......... 48% 35.7M 3s 2024-03-08T20:31:42.680 INFO:tasks.workunit.client.1.smithi144.stderr: 65950K .......... .......... .......... .......... .......... 48% 29.3M 3s 2024-03-08T20:31:42.682 INFO:tasks.workunit.client.1.smithi144.stderr: 66000K .......... .......... .......... .......... .......... 48% 23.4M 3s 2024-03-08T20:31:42.684 INFO:tasks.workunit.client.1.smithi144.stderr: 66050K .......... .......... .......... .......... .......... 48% 32.9M 3s 2024-03-08T20:31:42.685 INFO:tasks.workunit.client.1.smithi144.stderr: 66100K .......... .......... .......... .......... .......... 48% 25.2M 3s 2024-03-08T20:31:42.686 INFO:tasks.workunit.client.1.smithi144.stderr: 66150K .......... .......... .......... .......... .......... 48% 45.0M 3s 2024-03-08T20:31:42.688 INFO:tasks.workunit.client.1.smithi144.stderr: 66200K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-03-08T20:31:42.692 INFO:tasks.workunit.client.1.smithi144.stderr: 66250K .......... .......... .......... .......... .......... 48% 25.8M 3s 2024-03-08T20:31:42.692 INFO:tasks.workunit.client.1.smithi144.stderr: 66300K .......... .......... .......... .......... .......... 48% 34.9M 3s 2024-03-08T20:31:42.694 INFO:tasks.workunit.client.1.smithi144.stderr: 66350K .......... .......... .......... .......... .......... 48% 26.0M 3s 2024-03-08T20:31:42.695 INFO:tasks.workunit.client.1.smithi144.stderr: 66400K .......... .......... .......... .......... .......... 48% 24.9M 3s 2024-03-08T20:31:42.698 INFO:tasks.workunit.client.1.smithi144.stderr: 66450K .......... .......... .......... .......... .......... 48% 32.7M 3s 2024-03-08T20:31:42.699 INFO:tasks.workunit.client.1.smithi144.stderr: 66500K .......... .......... .......... .......... .......... 49% 33.2M 3s 2024-03-08T20:31:42.700 INFO:tasks.workunit.client.1.smithi144.stderr: 66550K .......... .......... .......... .......... .......... 49% 30.4M 3s 2024-03-08T20:31:42.701 INFO:tasks.workunit.client.1.smithi144.stderr: 66600K .......... .......... .......... .......... .......... 49% 41.8M 3s 2024-03-08T20:31:42.703 INFO:tasks.workunit.client.1.smithi144.stderr: 66650K .......... .......... .......... .......... .......... 49% 28.9M 3s 2024-03-08T20:31:42.705 INFO:tasks.workunit.client.1.smithi144.stderr: 66700K .......... .......... .......... .......... .......... 49% 27.2M 3s 2024-03-08T20:31:42.707 INFO:tasks.workunit.client.1.smithi144.stderr: 66750K .......... .......... .......... .......... .......... 49% 25.1M 3s 2024-03-08T20:31:42.708 INFO:tasks.workunit.client.0.smithi118.stdout:checking dependency style of gcc... gcc3 2024-03-08T20:31:42.709 INFO:tasks.workunit.client.1.smithi144.stderr: 66800K .......... .......... .......... .......... .......... 49% 27.5M 3s 2024-03-08T20:31:42.711 INFO:tasks.workunit.client.1.smithi144.stderr: 66850K .......... .......... .......... .......... .......... 49% 25.0M 3s 2024-03-08T20:31:42.711 INFO:tasks.workunit.client.1.smithi144.stderr: 66900K .......... .......... .......... .......... .......... 49% 53.4M 3s 2024-03-08T20:31:42.712 INFO:tasks.workunit.client.0.smithi118.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-08T20:31:42.713 INFO:tasks.workunit.client.1.smithi144.stderr: 66950K .......... .......... .......... .......... .......... 49% 22.6M 3s 2024-03-08T20:31:42.716 INFO:tasks.workunit.client.1.smithi144.stderr: 67000K .......... .......... .......... .......... .......... 49% 25.4M 3s 2024-03-08T20:31:42.718 INFO:tasks.workunit.client.1.smithi144.stderr: 67050K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-03-08T20:31:42.720 INFO:tasks.workunit.client.1.smithi144.stderr: 67100K .......... .......... .......... .......... .......... 49% 29.6M 3s 2024-03-08T20:31:42.720 INFO:tasks.workunit.client.1.smithi144.stderr: 67150K .......... .......... .......... .......... .......... 49% 52.0M 3s 2024-03-08T20:31:42.722 INFO:tasks.workunit.client.1.smithi144.stderr: 67200K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-03-08T20:31:42.724 INFO:tasks.workunit.client.1.smithi144.stderr: 67250K .......... .......... .......... .......... .......... 49% 27.3M 3s 2024-03-08T20:31:42.727 INFO:tasks.workunit.client.1.smithi144.stderr: 67300K .......... .......... .......... .......... .......... 49% 18.3M 3s 2024-03-08T20:31:42.728 INFO:tasks.workunit.client.1.smithi144.stderr: 67350K .......... .......... .......... .......... .......... 49% 47.8M 3s 2024-03-08T20:31:42.730 INFO:tasks.workunit.client.1.smithi144.stderr: 67400K .......... .......... .......... .......... .......... 49% 34.1M 3s 2024-03-08T20:31:42.731 INFO:tasks.workunit.client.1.smithi144.stderr: 67450K .......... .......... .......... .......... .......... 49% 20.7M 3s 2024-03-08T20:31:42.734 INFO:tasks.workunit.client.1.smithi144.stderr: 67500K .......... .......... .......... .......... .......... 49% 19.4M 3s 2024-03-08T20:31:42.736 INFO:tasks.workunit.client.1.smithi144.stderr: 67550K .......... .......... .......... .......... .......... 49% 44.5M 3s 2024-03-08T20:31:42.737 INFO:tasks.workunit.client.1.smithi144.stderr: 67600K .......... .......... .......... .......... .......... 49% 33.5M 3s 2024-03-08T20:31:42.739 INFO:tasks.workunit.client.1.smithi144.stderr: 67650K .......... .......... .......... .......... .......... 49% 28.6M 3s 2024-03-08T20:31:42.739 INFO:tasks.workunit.client.1.smithi144.stderr: 67700K .......... .......... .......... .......... .......... 49% 46.0M 3s 2024-03-08T20:31:42.741 INFO:tasks.workunit.client.1.smithi144.stderr: 67750K .......... .......... .......... .......... .......... 49% 28.2M 3s 2024-03-08T20:31:42.742 INFO:tasks.workunit.client.1.smithi144.stderr: 67800K .......... .......... .......... .......... .......... 49% 31.7M 3s 2024-03-08T20:31:42.745 INFO:tasks.workunit.client.1.smithi144.stderr: 67850K .......... .......... .......... .......... .......... 50% 23.0M 3s 2024-03-08T20:31:42.747 INFO:tasks.workunit.client.1.smithi144.stderr: 67900K .......... .......... .......... .......... .......... 50% 25.9M 3s 2024-03-08T20:31:42.748 INFO:tasks.workunit.client.1.smithi144.stderr: 67950K .......... .......... .......... .......... .......... 50% 40.4M 3s 2024-03-08T20:31:42.750 INFO:tasks.workunit.client.1.smithi144.stderr: 68000K .......... .......... .......... .......... .......... 50% 25.5M 3s 2024-03-08T20:31:42.752 INFO:tasks.workunit.client.1.smithi144.stderr: 68050K .......... .......... .......... .......... .......... 50% 31.9M 3s 2024-03-08T20:31:42.754 INFO:tasks.workunit.client.1.smithi144.stderr: 68100K .......... .......... .......... .......... .......... 50% 25.4M 3s 2024-03-08T20:31:42.756 INFO:tasks.workunit.client.1.smithi144.stderr: 68150K .......... .......... .......... .......... .......... 50% 26.1M 3s 2024-03-08T20:31:42.756 INFO:tasks.workunit.client.1.smithi144.stderr: 68200K .......... .......... .......... .......... .......... 50% 35.7M 3s 2024-03-08T20:31:42.758 INFO:tasks.workunit.client.1.smithi144.stderr: 68250K .......... .......... .......... .......... .......... 50% 30.5M 3s 2024-03-08T20:31:42.760 INFO:tasks.workunit.client.1.smithi144.stderr: 68300K .......... .......... .......... .......... .......... 50% 29.0M 3s 2024-03-08T20:31:42.762 INFO:tasks.workunit.client.1.smithi144.stderr: 68350K .......... .......... .......... .......... .......... 50% 22.7M 3s 2024-03-08T20:31:42.766 INFO:tasks.workunit.client.1.smithi144.stderr: 68400K .......... .......... .......... .......... .......... 50% 12.1M 3s 2024-03-08T20:31:42.770 INFO:tasks.workunit.client.1.smithi144.stderr: 68450K .......... .......... .......... .......... .......... 50% 22.3M 3s 2024-03-08T20:31:42.770 INFO:tasks.workunit.client.1.smithi144.stderr: 68500K .......... .......... .......... .......... .......... 50% 58.5M 3s 2024-03-08T20:31:42.770 INFO:tasks.workunit.client.1.smithi144.stderr: 68550K .......... .......... .......... .......... .......... 50% 63.1M 3s 2024-03-08T20:31:42.770 INFO:tasks.workunit.client.1.smithi144.stderr: 68600K .......... .......... .......... .......... .......... 50% 115M 3s 2024-03-08T20:31:42.774 INFO:tasks.workunit.client.1.smithi144.stderr: 68650K .......... .......... .......... .......... .......... 50% 14.5M 3s 2024-03-08T20:31:42.775 INFO:tasks.workunit.client.1.smithi144.stderr: 68700K .......... .......... .......... .......... .......... 50% 30.5M 3s 2024-03-08T20:31:42.780 INFO:tasks.workunit.client.1.smithi144.stderr: 68750K .......... .......... .......... .......... .......... 50% 12.4M 3s 2024-03-08T20:31:42.782 INFO:tasks.workunit.client.1.smithi144.stderr: 68800K .......... .......... .......... .......... .......... 50% 17.9M 3s 2024-03-08T20:31:42.785 INFO:tasks.workunit.client.1.smithi144.stderr: 68850K .......... .......... .......... .......... .......... 50% 23.2M 3s 2024-03-08T20:31:42.785 INFO:tasks.workunit.client.1.smithi144.stderr: 68900K .......... .......... .......... .......... .......... 50% 40.4M 3s 2024-03-08T20:31:42.787 INFO:tasks.workunit.client.1.smithi144.stderr: 68950K .......... .......... .......... .......... .......... 50% 28.3M 3s 2024-03-08T20:31:42.789 INFO:tasks.workunit.client.1.smithi144.stderr: 69000K .......... .......... .......... .......... .......... 50% 20.1M 3s 2024-03-08T20:31:42.791 INFO:tasks.workunit.client.1.smithi144.stderr: 69050K .......... .......... .......... .......... .......... 50% 31.1M 3s 2024-03-08T20:31:42.798 INFO:tasks.workunit.client.1.smithi144.stderr: 69100K .......... .......... .......... .......... .......... 50% 18.3M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69150K .......... .......... .......... .......... .......... 50% 29.9M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69200K .......... .......... .......... .......... .......... 51% 34.5M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69250K .......... .......... .......... .......... .......... 51% 35.1M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69300K .......... .......... .......... .......... .......... 51% 32.8M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69350K .......... .......... .......... .......... .......... 51% 25.5M 3s 2024-03-08T20:31:42.803 INFO:tasks.workunit.client.1.smithi144.stderr: 69400K .......... .......... .......... .......... .......... 51% 30.6M 3s 2024-03-08T20:31:42.805 INFO:tasks.workunit.client.1.smithi144.stderr: 69450K .......... .......... .......... .......... .......... 51% 21.3M 3s 2024-03-08T20:31:42.808 INFO:tasks.workunit.client.1.smithi144.stderr: 69500K .......... .......... .......... .......... .......... 51% 16.5M 3s 2024-03-08T20:31:42.809 INFO:tasks.workunit.client.1.smithi144.stderr: 69550K .......... .......... .......... .......... .......... 51% 31.9M 3s 2024-03-08T20:31:42.811 INFO:tasks.workunit.client.1.smithi144.stderr: 69600K .......... .......... .......... .......... .......... 51% 29.1M 3s 2024-03-08T20:31:42.813 INFO:tasks.workunit.client.1.smithi144.stderr: 69650K .......... .......... .......... .......... .......... 51% 36.0M 3s 2024-03-08T20:31:42.815 INFO:tasks.workunit.client.1.smithi144.stderr: 69700K .......... .......... .......... .......... .......... 51% 26.5M 3s 2024-03-08T20:31:42.816 INFO:tasks.workunit.client.1.smithi144.stderr: 69750K .......... .......... .......... .......... .......... 51% 30.1M 3s 2024-03-08T20:31:42.818 INFO:tasks.workunit.client.1.smithi144.stderr: 69800K .......... .......... .......... .......... .......... 51% 20.3M 3s 2024-03-08T20:31:42.820 INFO:tasks.workunit.client.1.smithi144.stderr: 69850K .......... .......... .......... .......... .......... 51% 26.4M 3s 2024-03-08T20:31:42.822 INFO:tasks.workunit.client.1.smithi144.stderr: 69900K .......... .......... .......... .......... .......... 51% 43.2M 3s 2024-03-08T20:31:42.823 INFO:tasks.workunit.client.1.smithi144.stderr: 69950K .......... .......... .......... .......... .......... 51% 23.8M 3s 2024-03-08T20:31:42.826 INFO:tasks.workunit.client.1.smithi144.stderr: 70000K .......... .......... .......... .......... .......... 51% 25.6M 3s 2024-03-08T20:31:42.827 INFO:tasks.workunit.client.1.smithi144.stderr: 70050K .......... .......... .......... .......... .......... 51% 31.9M 2s 2024-03-08T20:31:42.829 INFO:tasks.workunit.client.1.smithi144.stderr: 70100K .......... .......... .......... .......... .......... 51% 24.0M 2s 2024-03-08T20:31:42.831 INFO:tasks.workunit.client.1.smithi144.stderr: 70150K .......... .......... .......... .......... .......... 51% 32.7M 2s 2024-03-08T20:31:42.832 INFO:tasks.workunit.client.1.smithi144.stderr: 70200K .......... .......... .......... .......... .......... 51% 24.2M 2s 2024-03-08T20:31:42.835 INFO:tasks.workunit.client.1.smithi144.stderr: 70250K .......... .......... .......... .......... .......... 51% 26.3M 2s 2024-03-08T20:31:42.836 INFO:tasks.workunit.client.1.smithi144.stderr: 70300K .......... .......... .......... .......... .......... 51% 33.6M 2s 2024-03-08T20:31:42.837 INFO:tasks.workunit.client.1.smithi144.stderr: 70350K .......... .......... .......... .......... .......... 51% 31.5M 2s 2024-03-08T20:31:42.840 INFO:tasks.workunit.client.1.smithi144.stderr: 70400K .......... .......... .......... .......... .......... 51% 19.3M 2s 2024-03-08T20:31:42.841 INFO:tasks.workunit.client.1.smithi144.stderr: 70450K .......... .......... .......... .......... .......... 51% 38.2M 2s 2024-03-08T20:31:42.845 INFO:tasks.workunit.client.1.smithi144.stderr: 70500K .......... .......... .......... .......... .......... 51% 27.2M 2s 2024-03-08T20:31:42.845 INFO:tasks.workunit.client.1.smithi144.stderr: 70550K .......... .......... .......... .......... .......... 52% 72.8M 2s 2024-03-08T20:31:42.846 INFO:tasks.workunit.client.1.smithi144.stderr: 70600K .......... .......... .......... .......... .......... 52% 36.9M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70650K .......... .......... .......... .......... .......... 52% 42.7M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70700K .......... .......... .......... .......... .......... 52% 47.3M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70750K .......... .......... .......... .......... .......... 52% 61.1M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70800K .......... .......... .......... .......... .......... 52% 42.1M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70850K .......... .......... .......... .......... .......... 52% 79.9M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70900K .......... .......... .......... .......... .......... 52% 45.0M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 70950K .......... .......... .......... .......... .......... 52% 53.0M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 71000K .......... .......... .......... .......... .......... 52% 74.0M 2s 2024-03-08T20:31:42.855 INFO:tasks.workunit.client.1.smithi144.stderr: 71050K .......... .......... .......... .......... .......... 52% 60.2M 2s 2024-03-08T20:31:42.856 INFO:tasks.workunit.client.1.smithi144.stderr: 71100K .......... .......... .......... .......... .......... 52% 32.5M 2s 2024-03-08T20:31:42.858 INFO:tasks.workunit.client.1.smithi144.stderr: 71150K .......... .......... .......... .......... .......... 52% 28.6M 2s 2024-03-08T20:31:42.858 INFO:tasks.workunit.client.1.smithi144.stderr: 71200K .......... .......... .......... .......... .......... 52% 31.2M 2s 2024-03-08T20:31:42.860 INFO:tasks.workunit.client.1.smithi144.stderr: 71250K .......... .......... .......... .......... .......... 52% 24.7M 2s 2024-03-08T20:31:42.862 INFO:tasks.workunit.client.1.smithi144.stderr: 71300K .......... .......... .......... .......... .......... 52% 25.8M 2s 2024-03-08T20:31:42.863 INFO:tasks.workunit.client.1.smithi144.stderr: 71350K .......... .......... .......... .......... .......... 52% 40.7M 2s 2024-03-08T20:31:42.866 INFO:tasks.workunit.client.1.smithi144.stderr: 71400K .......... .......... .......... .......... .......... 52% 25.2M 2s 2024-03-08T20:31:42.866 INFO:tasks.workunit.client.1.smithi144.stderr: 71450K .......... .......... .......... .......... .......... 52% 45.0M 2s 2024-03-08T20:31:42.868 INFO:tasks.workunit.client.1.smithi144.stderr: 71500K .......... .......... .......... .......... .......... 52% 21.1M 2s 2024-03-08T20:31:42.870 INFO:tasks.workunit.client.1.smithi144.stderr: 71550K .......... .......... .......... .......... .......... 52% 26.8M 2s 2024-03-08T20:31:42.872 INFO:tasks.workunit.client.1.smithi144.stderr: 71600K .......... .......... .......... .......... .......... 52% 32.5M 2s 2024-03-08T20:31:42.874 INFO:tasks.workunit.client.1.smithi144.stderr: 71650K .......... .......... .......... .......... .......... 52% 26.7M 2s 2024-03-08T20:31:42.875 INFO:tasks.workunit.client.1.smithi144.stderr: 71700K .......... .......... .......... .......... .......... 52% 42.1M 2s 2024-03-08T20:31:42.876 INFO:tasks.workunit.client.1.smithi144.stderr: 71750K .......... .......... .......... .......... .......... 52% 28.0M 2s 2024-03-08T20:31:42.879 INFO:tasks.workunit.client.1.smithi144.stderr: 71800K .......... .......... .......... .......... .......... 52% 25.7M 2s 2024-03-08T20:31:42.881 INFO:tasks.workunit.client.1.smithi144.stderr: 71850K .......... .......... .......... .......... .......... 52% 20.3M 2s 2024-03-08T20:31:42.882 INFO:tasks.workunit.client.1.smithi144.stderr: 71900K .......... .......... .......... .......... .......... 53% 46.2M 2s 2024-03-08T20:31:42.883 INFO:tasks.workunit.client.1.smithi144.stderr: 71950K .......... .......... .......... .......... .......... 53% 36.6M 2s 2024-03-08T20:31:42.885 INFO:tasks.workunit.client.1.smithi144.stderr: 72000K .......... .......... .......... .......... .......... 53% 24.1M 2s 2024-03-08T20:31:42.887 INFO:tasks.workunit.client.1.smithi144.stderr: 72050K .......... .......... .......... .......... .......... 53% 26.6M 2s 2024-03-08T20:31:42.889 INFO:tasks.workunit.client.1.smithi144.stderr: 72100K .......... .......... .......... .......... .......... 53% 39.3M 2s 2024-03-08T20:31:42.890 INFO:tasks.workunit.client.1.smithi144.stderr: 72150K .......... .......... .......... .......... .......... 53% 25.6M 2s 2024-03-08T20:31:42.891 INFO:tasks.workunit.client.1.smithi144.stderr: 72200K .......... .......... .......... .......... .......... 53% 41.6M 2s 2024-03-08T20:31:42.893 INFO:tasks.workunit.client.1.smithi144.stderr: 72250K .......... .......... .......... .......... .......... 53% 25.4M 2s 2024-03-08T20:31:42.896 INFO:tasks.workunit.client.1.smithi144.stderr: 72300K .......... .......... .......... .......... .......... 53% 25.2M 2s 2024-03-08T20:31:42.896 INFO:tasks.workunit.client.1.smithi144.stderr: 72350K .......... .......... .......... .......... .......... 53% 33.4M 2s 2024-03-08T20:31:42.900 INFO:tasks.workunit.client.1.smithi144.stderr: 72400K .......... .......... .......... .......... .......... 53% 24.6M 2s 2024-03-08T20:31:42.900 INFO:tasks.workunit.client.1.smithi144.stderr: 72450K .......... .......... .......... .......... .......... 53% 45.6M 2s 2024-03-08T20:31:42.902 INFO:tasks.workunit.client.1.smithi144.stderr: 72500K .......... .......... .......... .......... .......... 53% 24.1M 2s 2024-03-08T20:31:42.904 INFO:tasks.workunit.client.1.smithi144.stderr: 72550K .......... .......... .......... .......... .......... 53% 24.1M 2s 2024-03-08T20:31:42.905 INFO:tasks.workunit.client.1.smithi144.stderr: 72600K .......... .......... .......... .......... .......... 53% 33.8M 2s 2024-03-08T20:31:42.908 INFO:tasks.workunit.client.1.smithi144.stderr: 72650K .......... .......... .......... .......... .......... 53% 26.3M 2s 2024-03-08T20:31:42.909 INFO:tasks.workunit.client.1.smithi144.stderr: 72700K .......... .......... .......... .......... .......... 53% 39.4M 2s 2024-03-08T20:31:42.910 INFO:tasks.workunit.client.1.smithi144.stderr: 72750K .......... .......... .......... .......... .......... 53% 23.0M 2s 2024-03-08T20:31:42.912 INFO:tasks.workunit.client.1.smithi144.stderr: 72800K .......... .......... .......... .......... .......... 53% 29.5M 2s 2024-03-08T20:31:42.913 INFO:tasks.workunit.client.1.smithi144.stderr: 72850K .......... .......... .......... .......... .......... 53% 31.8M 2s 2024-03-08T20:31:42.915 INFO:tasks.workunit.client.1.smithi144.stderr: 72900K .......... .......... .......... .......... .......... 53% 25.2M 2s 2024-03-08T20:31:42.919 INFO:tasks.workunit.client.1.smithi144.stderr: 72950K .......... .......... .......... .......... .......... 53% 23.8M 2s 2024-03-08T20:31:42.919 INFO:tasks.workunit.client.1.smithi144.stderr: 73000K .......... .......... .......... .......... .......... 53% 49.4M 2s 2024-03-08T20:31:42.920 INFO:tasks.workunit.client.1.smithi144.stderr: 73050K .......... .......... .......... .......... .......... 53% 27.9M 2s 2024-03-08T20:31:42.921 INFO:tasks.workunit.client.0.smithi118.stdout:checking how to run the C preprocessor... gcc -E 2024-03-08T20:31:42.923 INFO:tasks.workunit.client.1.smithi144.stderr: 73100K .......... .......... .......... .......... .......... 53% 25.6M 2s 2024-03-08T20:31:42.925 INFO:tasks.workunit.client.1.smithi144.stderr: 73150K .......... .......... .......... .......... .......... 53% 27.1M 2s 2024-03-08T20:31:42.927 INFO:tasks.workunit.client.1.smithi144.stderr: 73200K .......... .......... .......... .......... .......... 53% 26.8M 2s 2024-03-08T20:31:42.927 INFO:tasks.workunit.client.1.smithi144.stderr: 73250K .......... .......... .......... .......... .......... 53% 55.3M 2s 2024-03-08T20:31:42.929 INFO:tasks.workunit.client.1.smithi144.stderr: 73300K .......... .......... .......... .......... .......... 54% 21.3M 2s 2024-03-08T20:31:42.931 INFO:tasks.workunit.client.1.smithi144.stderr: 73350K .......... .......... .......... .......... .......... 54% 28.5M 2s 2024-03-08T20:31:42.932 INFO:tasks.workunit.client.1.smithi144.stderr: 73400K .......... .......... .......... .......... .......... 54% 34.4M 2s 2024-03-08T20:31:42.935 INFO:tasks.workunit.client.1.smithi144.stderr: 73450K .......... .......... .......... .......... .......... 54% 22.1M 2s 2024-03-08T20:31:42.935 INFO:tasks.workunit.client.1.smithi144.stderr: 73500K .......... .......... .......... .......... .......... 54% 67.3M 2s 2024-03-08T20:31:42.937 INFO:tasks.workunit.client.1.smithi144.stderr: 73550K .......... .......... .......... .......... .......... 54% 24.4M 2s 2024-03-08T20:31:42.939 INFO:tasks.workunit.client.1.smithi144.stderr: 73600K .......... .......... .......... .......... .......... 54% 25.1M 2s 2024-03-08T20:31:42.941 INFO:tasks.workunit.client.1.smithi144.stderr: 73650K .......... .......... .......... .......... .......... 54% 28.3M 2s 2024-03-08T20:31:42.944 INFO:tasks.workunit.client.1.smithi144.stderr: 73700K .......... .......... .......... .......... .......... 54% 23.8M 2s 2024-03-08T20:31:42.944 INFO:tasks.workunit.client.1.smithi144.stderr: 73750K .......... .......... .......... .......... .......... 54% 66.4M 2s 2024-03-08T20:31:42.945 INFO:tasks.workunit.client.1.smithi144.stderr: 73800K .......... .......... .......... .......... .......... 54% 25.1M 2s 2024-03-08T20:31:42.948 INFO:tasks.workunit.client.1.smithi144.stderr: 73850K .......... .......... .......... .......... .......... 54% 25.2M 2s 2024-03-08T20:31:42.950 INFO:tasks.workunit.client.1.smithi144.stderr: 73900K .......... .......... .......... .......... .......... 54% 25.5M 2s 2024-03-08T20:31:42.952 INFO:tasks.workunit.client.1.smithi144.stderr: 73950K .......... .......... .......... .......... .......... 54% 26.1M 2s 2024-03-08T20:31:42.952 INFO:tasks.workunit.client.1.smithi144.stderr: 74000K .......... .......... .......... .......... .......... 54% 79.0M 2s 2024-03-08T20:31:42.953 INFO:tasks.workunit.client.1.smithi144.stderr: 74050K .......... .......... .......... .......... .......... 54% 25.2M 2s 2024-03-08T20:31:42.957 INFO:tasks.workunit.client.1.smithi144.stderr: 74100K .......... .......... .......... .......... .......... 54% 19.7M 2s 2024-03-08T20:31:42.958 INFO:tasks.workunit.client.1.smithi144.stderr: 74150K .......... .......... .......... .......... .......... 54% 35.4M 2s 2024-03-08T20:31:42.960 INFO:tasks.workunit.client.1.smithi144.stderr: 74200K .......... .......... .......... .......... .......... 54% 23.3M 2s 2024-03-08T20:31:42.961 INFO:tasks.workunit.client.1.smithi144.stderr: 74250K .......... .......... .......... .......... .......... 54% 39.5M 2s 2024-03-08T20:31:42.963 INFO:tasks.workunit.client.1.smithi144.stderr: 74300K .......... .......... .......... .......... .......... 54% 23.1M 2s 2024-03-08T20:31:42.965 INFO:tasks.workunit.client.1.smithi144.stderr: 74350K .......... .......... .......... .......... .......... 54% 27.8M 2s 2024-03-08T20:31:42.968 INFO:tasks.workunit.client.1.smithi144.stderr: 74400K .......... .......... .......... .......... .......... 54% 21.2M 2s 2024-03-08T20:31:42.969 INFO:tasks.workunit.client.1.smithi144.stderr: 74450K .......... .......... .......... .......... .......... 54% 30.9M 2s 2024-03-08T20:31:42.970 INFO:tasks.workunit.client.1.smithi144.stderr: 74500K .......... .......... .......... .......... .......... 54% 53.6M 2s 2024-03-08T20:31:42.972 INFO:tasks.workunit.client.1.smithi144.stderr: 74550K .......... .......... .......... .......... .......... 54% 24.8M 2s 2024-03-08T20:31:42.973 INFO:tasks.workunit.client.1.smithi144.stderr: 74600K .......... .......... .......... .......... .......... 54% 27.8M 2s 2024-03-08T20:31:42.975 INFO:tasks.workunit.client.1.smithi144.stderr: 74650K .......... .......... .......... .......... .......... 55% 31.4M 2s 2024-03-08T20:31:42.977 INFO:tasks.workunit.client.1.smithi144.stderr: 74700K .......... .......... .......... .......... .......... 55% 24.6M 2s 2024-03-08T20:31:42.978 INFO:tasks.workunit.client.1.smithi144.stderr: 74750K .......... .......... .......... .......... .......... 55% 39.3M 2s 2024-03-08T20:31:42.980 INFO:tasks.workunit.client.1.smithi144.stderr: 74800K .......... .......... .......... .......... .......... 55% 27.2M 2s 2024-03-08T20:31:42.981 INFO:tasks.workunit.client.1.smithi144.stderr: 74850K .......... .......... .......... .......... .......... 55% 28.9M 2s 2024-03-08T20:31:42.984 INFO:tasks.workunit.client.1.smithi144.stderr: 74900K .......... .......... .......... .......... .......... 55% 25.0M 2s 2024-03-08T20:31:42.986 INFO:tasks.workunit.client.1.smithi144.stderr: 74950K .......... .......... .......... .......... .......... 55% 26.7M 2s 2024-03-08T20:31:42.987 INFO:tasks.workunit.client.1.smithi144.stderr: 75000K .......... .......... .......... .......... .......... 55% 42.2M 2s 2024-03-08T20:31:42.989 INFO:tasks.workunit.client.1.smithi144.stderr: 75050K .......... .......... .......... .......... .......... 55% 26.5M 2s 2024-03-08T20:31:42.990 INFO:tasks.workunit.client.1.smithi144.stderr: 75100K .......... .......... .......... .......... .......... 55% 31.2M 2s 2024-03-08T20:31:42.993 INFO:tasks.workunit.client.1.smithi144.stderr: 75150K .......... .......... .......... .......... .......... 55% 24.6M 2s 2024-03-08T20:31:42.994 INFO:tasks.workunit.client.1.smithi144.stderr: 75200K .......... .......... .......... .......... .......... 55% 26.8M 2s 2024-03-08T20:31:42.995 INFO:tasks.workunit.client.1.smithi144.stderr: 75250K .......... .......... .......... .......... .......... 55% 39.9M 2s 2024-03-08T20:31:42.997 INFO:tasks.workunit.client.1.smithi144.stderr: 75300K .......... .......... .......... .......... .......... 55% 24.6M 2s 2024-03-08T20:31:42.999 INFO:tasks.workunit.client.1.smithi144.stderr: 75350K .......... .......... .......... .......... .......... 55% 39.0M 2s 2024-03-08T20:31:43.001 INFO:tasks.workunit.client.1.smithi144.stderr: 75400K .......... .......... .......... .......... .......... 55% 20.8M 2s 2024-03-08T20:31:43.002 INFO:tasks.workunit.client.1.smithi144.stderr: 75450K .......... .......... .......... .......... .......... 55% 29.4M 2s 2024-03-08T20:31:43.003 INFO:tasks.workunit.client.1.smithi144.stderr: 75500K .......... .......... .......... .......... .......... 55% 37.0M 2s 2024-03-08T20:31:43.005 INFO:tasks.workunit.client.1.smithi144.stderr: 75550K .......... .......... .......... .......... .......... 55% 27.3M 2s 2024-03-08T20:31:43.008 INFO:tasks.workunit.client.1.smithi144.stderr: 75600K .......... .......... .......... .......... .......... 55% 23.3M 2s 2024-03-08T20:31:43.008 INFO:tasks.workunit.client.1.smithi144.stderr: 75650K .......... .......... .......... .......... .......... 55% 36.6M 2s 2024-03-08T20:31:43.012 INFO:tasks.workunit.client.1.smithi144.stderr: 75700K .......... .......... .......... .......... .......... 55% 23.3M 2s 2024-03-08T20:31:43.012 INFO:tasks.workunit.client.1.smithi144.stderr: 75750K .......... .......... .......... .......... .......... 55% 46.6M 2s 2024-03-08T20:31:43.014 INFO:tasks.workunit.client.1.smithi144.stderr: 75800K .......... .......... .......... .......... .......... 55% 25.3M 2s 2024-03-08T20:31:43.016 INFO:tasks.workunit.client.1.smithi144.stderr: 75850K .......... .......... .......... .......... .......... 55% 28.3M 2s 2024-03-08T20:31:43.018 INFO:tasks.workunit.client.1.smithi144.stderr: 75900K .......... .......... .......... .......... .......... 55% 27.7M 2s 2024-03-08T20:31:43.020 INFO:tasks.workunit.client.1.smithi144.stderr: 75950K .......... .......... .......... .......... .......... 55% 33.4M 2s 2024-03-08T20:31:43.021 INFO:tasks.workunit.client.1.smithi144.stderr: 76000K .......... .......... .......... .......... .......... 56% 24.8M 2s 2024-03-08T20:31:43.023 INFO:tasks.workunit.client.1.smithi144.stderr: 76050K .......... .......... .......... .......... .......... 56% 29.2M 2s 2024-03-08T20:31:43.024 INFO:tasks.workunit.client.1.smithi144.stderr: 76100K .......... .......... .......... .......... .......... 56% 34.7M 2s 2024-03-08T20:31:43.026 INFO:tasks.workunit.client.1.smithi144.stderr: 76150K .......... .......... .......... .......... .......... 56% 26.8M 2s 2024-03-08T20:31:43.027 INFO:tasks.workunit.client.1.smithi144.stderr: 76200K .......... .......... .......... .......... .......... 56% 43.8M 2s 2024-03-08T20:31:43.028 INFO:tasks.workunit.client.1.smithi144.stderr: 76250K .......... .......... .......... .......... .......... 56% 30.7M 2s 2024-03-08T20:31:43.031 INFO:tasks.workunit.client.1.smithi144.stderr: 76300K .......... .......... .......... .......... .......... 56% 23.1M 2s 2024-03-08T20:31:43.033 INFO:tasks.workunit.client.1.smithi144.stderr: 76350K .......... .......... .......... .......... .......... 56% 30.1M 2s 2024-03-08T20:31:43.035 INFO:tasks.workunit.client.1.smithi144.stderr: 76400K .......... .......... .......... .......... .......... 56% 23.0M 2s 2024-03-08T20:31:43.035 INFO:tasks.workunit.client.1.smithi144.stderr: 76450K .......... .......... .......... .......... .......... 56% 36.6M 2s 2024-03-08T20:31:43.037 INFO:tasks.workunit.client.1.smithi144.stderr: 76500K .......... .......... .......... .......... .......... 56% 26.0M 2s 2024-03-08T20:31:43.039 INFO:tasks.workunit.client.1.smithi144.stderr: 76550K .......... .......... .......... .......... .......... 56% 36.6M 2s 2024-03-08T20:31:43.041 INFO:tasks.workunit.client.1.smithi144.stderr: 76600K .......... .......... .......... .......... .......... 56% 28.7M 2s 2024-03-08T20:31:43.043 INFO:tasks.workunit.client.1.smithi144.stderr: 76650K .......... .......... .......... .......... .......... 56% 21.6M 2s 2024-03-08T20:31:43.044 INFO:tasks.workunit.client.1.smithi144.stderr: 76700K .......... .......... .......... .......... .......... 56% 36.7M 2s 2024-03-08T20:31:43.045 INFO:tasks.workunit.client.1.smithi144.stderr: 76750K .......... .......... .......... .......... .......... 56% 38.2M 2s 2024-03-08T20:31:43.048 INFO:tasks.workunit.client.1.smithi144.stderr: 76800K .......... .......... .......... .......... .......... 56% 20.8M 2s 2024-03-08T20:31:43.050 INFO:tasks.workunit.client.1.smithi144.stderr: 76850K .......... .......... .......... .......... .......... 56% 28.3M 2s 2024-03-08T20:31:43.051 INFO:tasks.workunit.client.1.smithi144.stderr: 76900K .......... .......... .......... .......... .......... 56% 28.3M 2s 2024-03-08T20:31:43.052 INFO:tasks.workunit.client.1.smithi144.stderr: 76950K .......... .......... .......... .......... .......... 56% 45.6M 2s 2024-03-08T20:31:43.054 INFO:tasks.workunit.client.1.smithi144.stderr: 77000K .......... .......... .......... .......... .......... 56% 30.3M 2s 2024-03-08T20:31:43.055 INFO:tasks.workunit.client.1.smithi144.stderr: 77050K .......... .......... .......... .......... .......... 56% 31.4M 2s 2024-03-08T20:31:43.058 INFO:tasks.workunit.client.1.smithi144.stderr: 77100K .......... .......... .......... .......... .......... 56% 22.7M 2s 2024-03-08T20:31:43.060 INFO:tasks.workunit.client.1.smithi144.stderr: 77150K .......... .......... .......... .......... .......... 56% 28.3M 2s 2024-03-08T20:31:43.061 INFO:tasks.workunit.client.1.smithi144.stderr: 77200K .......... .......... .......... .......... .......... 56% 27.8M 2s 2024-03-08T20:31:43.062 INFO:tasks.workunit.client.1.smithi144.stderr: 77250K .......... .......... .......... .......... .......... 56% 51.2M 2s 2024-03-08T20:31:43.064 INFO:tasks.workunit.client.1.smithi144.stderr: 77300K .......... .......... .......... .......... .......... 56% 26.6M 2s 2024-03-08T20:31:43.066 INFO:tasks.workunit.client.1.smithi144.stderr: 77350K .......... .......... .......... .......... .......... 57% 25.9M 2s 2024-03-08T20:31:43.067 INFO:tasks.workunit.client.1.smithi144.stderr: 77400K .......... .......... .......... .......... .......... 57% 28.9M 2s 2024-03-08T20:31:43.069 INFO:tasks.workunit.client.1.smithi144.stderr: 77450K .......... .......... .......... .......... .......... 57% 28.8M 2s 2024-03-08T20:31:43.070 INFO:tasks.workunit.client.1.smithi144.stderr: 77500K .......... .......... .......... .......... .......... 57% 32.3M 2s 2024-03-08T20:31:43.072 INFO:tasks.workunit.client.1.smithi144.stderr: 77550K .......... .......... .......... .......... .......... 57% 28.0M 2s 2024-03-08T20:31:43.074 INFO:tasks.workunit.client.1.smithi144.stderr: 77600K .......... .......... .......... .......... .......... 57% 25.3M 2s 2024-03-08T20:31:43.076 INFO:tasks.workunit.client.1.smithi144.stderr: 77650K .......... .......... .......... .......... .......... 57% 31.1M 2s 2024-03-08T20:31:43.078 INFO:tasks.workunit.client.1.smithi144.stderr: 77700K .......... .......... .......... .......... .......... 57% 27.1M 2s 2024-03-08T20:31:43.080 INFO:tasks.workunit.client.1.smithi144.stderr: 77750K .......... .......... .......... .......... .......... 57% 49.2M 2s 2024-03-08T20:31:43.085 INFO:tasks.workunit.client.1.smithi144.stderr: 77800K .......... .......... .......... .......... .......... 57% 9.81M 2s 2024-03-08T20:31:43.085 INFO:tasks.workunit.client.1.smithi144.stderr: 77850K .......... .......... .......... .......... .......... 57% 88.1M 2s 2024-03-08T20:31:43.085 INFO:tasks.workunit.client.1.smithi144.stderr: 77900K .......... .......... .......... .......... .......... 57% 87.6M 2s 2024-03-08T20:31:43.086 INFO:tasks.workunit.client.1.smithi144.stderr: 77950K .......... .......... .......... .......... .......... 57% 34.2M 2s 2024-03-08T20:31:43.088 INFO:tasks.workunit.client.1.smithi144.stderr: 78000K .......... .......... .......... .......... .......... 57% 41.5M 2s 2024-03-08T20:31:43.089 INFO:tasks.workunit.client.1.smithi144.stderr: 78050K .......... .......... .......... .......... .......... 57% 27.5M 2s 2024-03-08T20:31:43.091 INFO:tasks.workunit.client.1.smithi144.stderr: 78100K .......... .......... .......... .......... .......... 57% 23.7M 2s 2024-03-08T20:31:43.092 INFO:tasks.workunit.client.1.smithi144.stderr: 78150K .......... .......... .......... .......... .......... 57% 32.9M 2s 2024-03-08T20:31:43.094 INFO:tasks.workunit.client.1.smithi144.stderr: 78200K .......... .......... .......... .......... .......... 57% 27.9M 2s 2024-03-08T20:31:43.096 INFO:tasks.workunit.client.1.smithi144.stderr: 78250K .......... .......... .......... .......... .......... 57% 24.7M 2s 2024-03-08T20:31:43.098 INFO:tasks.workunit.client.1.smithi144.stderr: 78300K .......... .......... .......... .......... .......... 57% 42.2M 2s 2024-03-08T20:31:43.099 INFO:tasks.workunit.client.1.smithi144.stderr: 78350K .......... .......... .......... .......... .......... 57% 29.7M 2s 2024-03-08T20:31:43.101 INFO:tasks.workunit.client.1.smithi144.stderr: 78400K .......... .......... .......... .......... .......... 57% 24.2M 2s 2024-03-08T20:31:43.103 INFO:tasks.workunit.client.1.smithi144.stderr: 78450K .......... .......... .......... .......... .......... 57% 30.1M 2s 2024-03-08T20:31:43.105 INFO:tasks.workunit.client.1.smithi144.stderr: 78500K .......... .......... .......... .......... .......... 57% 24.3M 2s 2024-03-08T20:31:43.106 INFO:tasks.workunit.client.1.smithi144.stderr: 78550K .......... .......... .......... .......... .......... 57% 36.7M 2s 2024-03-08T20:31:43.108 INFO:tasks.workunit.client.1.smithi144.stderr: 78600K .......... .......... .......... .......... .......... 57% 30.8M 2s 2024-03-08T20:31:43.109 INFO:tasks.workunit.client.1.smithi144.stderr: 78650K .......... .......... .......... .......... .......... 57% 30.1M 2s 2024-03-08T20:31:43.111 INFO:tasks.workunit.client.1.smithi144.stderr: 78700K .......... .......... .......... .......... .......... 58% 24.6M 2s 2024-03-08T20:31:43.114 INFO:tasks.workunit.client.1.smithi144.stderr: 78750K .......... .......... .......... .......... .......... 58% 22.3M 2s 2024-03-08T20:31:43.115 INFO:tasks.workunit.client.1.smithi144.stderr: 78800K .......... .......... .......... .......... .......... 58% 43.9M 2s 2024-03-08T20:31:43.116 INFO:tasks.workunit.client.1.smithi144.stderr: 78850K .......... .......... .......... .......... .......... 58% 31.1M 2s 2024-03-08T20:31:43.118 INFO:tasks.workunit.client.1.smithi144.stderr: 78900K .......... .......... .......... .......... .......... 58% 32.3M 2s 2024-03-08T20:31:43.118 INFO:tasks.workunit.client.0.smithi118.stdout:checking for egrep... grep -E 2024-03-08T20:31:43.121 INFO:tasks.workunit.client.1.smithi144.stderr: 78950K .......... .......... .......... .......... .......... 58% 19.6M 2s 2024-03-08T20:31:43.122 INFO:tasks.workunit.client.1.smithi144.stderr: 79000K .......... .......... .......... .......... .......... 58% 26.3M 2s 2024-03-08T20:31:43.124 INFO:tasks.workunit.client.1.smithi144.stderr: 79050K .......... .......... .......... .......... .......... 58% 24.9M 2s 2024-03-08T20:31:43.127 INFO:tasks.workunit.client.1.smithi144.stderr: 79100K .......... .......... .......... .......... .......... 58% 28.3M 2s 2024-03-08T20:31:43.127 INFO:tasks.workunit.client.1.smithi144.stderr: 79150K .......... .......... .......... .......... .......... 58% 55.5M 2s 2024-03-08T20:31:43.129 INFO:tasks.workunit.client.1.smithi144.stderr: 79200K .......... .......... .......... .......... .......... 58% 25.0M 2s 2024-03-08T20:31:43.131 INFO:tasks.workunit.client.1.smithi144.stderr: 79250K .......... .......... .......... .......... .......... 58% 26.8M 2s 2024-03-08T20:31:43.131 INFO:tasks.workunit.client.1.smithi144.stderr: 79300K .......... .......... .......... .......... .......... 58% 43.1M 2s 2024-03-08T20:31:43.141 INFO:tasks.workunit.client.1.smithi144.stderr: 79350K .......... .......... .......... .......... .......... 58% 13.6M 2s 2024-03-08T20:31:43.141 INFO:tasks.workunit.client.1.smithi144.stderr: 79400K .......... .......... .......... .......... .......... 58% 16.3M 2s 2024-03-08T20:31:43.141 INFO:tasks.workunit.client.1.smithi144.stderr: 79450K .......... .......... .......... .......... .......... 58% 37.6M 2s 2024-03-08T20:31:43.141 INFO:tasks.workunit.client.1.smithi144.stderr: 79500K .......... .......... .......... .......... .......... 58% 43.4M 2s 2024-03-08T20:31:43.143 INFO:tasks.workunit.client.1.smithi144.stderr: 79550K .......... .......... .......... .......... .......... 58% 40.6M 2s 2024-03-08T20:31:43.144 INFO:tasks.workunit.client.1.smithi144.stderr: 79600K .......... .......... .......... .......... .......... 58% 18.7M 2s 2024-03-08T20:31:43.147 INFO:tasks.workunit.client.1.smithi144.stderr: 79650K .......... .......... .......... .......... .......... 58% 18.8M 2s 2024-03-08T20:31:43.151 INFO:tasks.workunit.client.1.smithi144.stderr: 79700K .......... .......... .......... .......... .......... 58% 11.9M 2s 2024-03-08T20:31:43.155 INFO:tasks.workunit.client.1.smithi144.stderr: 79750K .......... .......... .......... .......... .......... 58% 31.1M 2s 2024-03-08T20:31:43.155 INFO:tasks.workunit.client.1.smithi144.stderr: 79800K .......... .......... .......... .......... .......... 58% 88.8M 2s 2024-03-08T20:31:43.155 INFO:tasks.workunit.client.1.smithi144.stderr: 79850K .......... .......... .......... .......... .......... 58% 105M 2s 2024-03-08T20:31:43.155 INFO:tasks.workunit.client.1.smithi144.stderr: 79900K .......... .......... .......... .......... .......... 58% 41.5M 2s 2024-03-08T20:31:43.157 INFO:tasks.workunit.client.1.smithi144.stderr: 79950K .......... .......... .......... .......... .......... 58% 20.2M 2s 2024-03-08T20:31:43.162 INFO:tasks.workunit.client.1.smithi144.stderr: 80000K .......... .......... .......... .......... .......... 58% 24.2M 2s 2024-03-08T20:31:43.162 INFO:tasks.workunit.client.1.smithi144.stderr: 80050K .......... .......... .......... .......... .......... 59% 68.7M 2s 2024-03-08T20:31:43.162 INFO:tasks.workunit.client.1.smithi144.stderr: 80100K .......... .......... .......... .......... .......... 59% 59.4M 2s 2024-03-08T20:31:43.162 INFO:tasks.workunit.client.1.smithi144.stderr: 80150K .......... .......... .......... .......... .......... 59% 83.9M 2s 2024-03-08T20:31:43.163 INFO:tasks.workunit.client.0.smithi118.stdout:checking for AIX... no 2024-03-08T20:31:43.164 INFO:tasks.workunit.client.1.smithi144.stderr: 80200K .......... .......... .......... .......... .......... 59% 29.6M 2s 2024-03-08T20:31:43.166 INFO:tasks.workunit.client.1.smithi144.stderr: 80250K .......... .......... .......... .......... .......... 59% 26.6M 2s 2024-03-08T20:31:43.166 INFO:tasks.workunit.client.1.smithi144.stderr: 80300K .......... .......... .......... .......... .......... 59% 50.0M 2s 2024-03-08T20:31:43.168 INFO:tasks.workunit.client.1.smithi144.stderr: 80350K .......... .......... .......... .......... .......... 59% 22.2M 2s 2024-03-08T20:31:43.170 INFO:tasks.workunit.client.1.smithi144.stderr: 80400K .......... .......... .......... .......... .......... 59% 35.6M 2s 2024-03-08T20:31:43.171 INFO:tasks.workunit.client.1.smithi144.stderr: 80450K .......... .......... .......... .......... .......... 59% 23.7M 2s 2024-03-08T20:31:43.174 INFO:tasks.workunit.client.1.smithi144.stderr: 80500K .......... .......... .......... .......... .......... 59% 27.5M 2s 2024-03-08T20:31:43.174 INFO:tasks.workunit.client.1.smithi144.stderr: 80550K .......... .......... .......... .......... .......... 59% 52.8M 2s 2024-03-08T20:31:43.176 INFO:tasks.workunit.client.1.smithi144.stderr: 80600K .......... .......... .......... .......... .......... 59% 27.1M 2s 2024-03-08T20:31:43.178 INFO:tasks.workunit.client.1.smithi144.stderr: 80650K .......... .......... .......... .......... .......... 59% 26.7M 2s 2024-03-08T20:31:43.180 INFO:tasks.workunit.client.1.smithi144.stderr: 80700K .......... .......... .......... .......... .......... 59% 26.4M 2s 2024-03-08T20:31:43.181 INFO:tasks.workunit.client.1.smithi144.stderr: 80750K .......... .......... .......... .......... .......... 59% 32.1M 2s 2024-03-08T20:31:43.182 INFO:tasks.workunit.client.1.smithi144.stderr: 80800K .......... .......... .......... .......... .......... 59% 33.9M 2s 2024-03-08T20:31:43.185 INFO:tasks.workunit.client.1.smithi144.stderr: 80850K .......... .......... .......... .......... .......... 59% 29.2M 2s 2024-03-08T20:31:43.186 INFO:tasks.workunit.client.1.smithi144.stderr: 80900K .......... .......... .......... .......... .......... 59% 25.5M 2s 2024-03-08T20:31:43.189 INFO:tasks.workunit.client.1.smithi144.stderr: 80950K .......... .......... .......... .......... .......... 59% 23.5M 2s 2024-03-08T20:31:43.190 INFO:tasks.workunit.client.1.smithi144.stderr: 81000K .......... .......... .......... .......... .......... 59% 29.6M 2s 2024-03-08T20:31:43.191 INFO:tasks.workunit.client.1.smithi144.stderr: 81050K .......... .......... .......... .......... .......... 59% 39.6M 2s 2024-03-08T20:31:43.193 INFO:tasks.workunit.client.1.smithi144.stderr: 81100K .......... .......... .......... .......... .......... 59% 31.5M 2s 2024-03-08T20:31:43.199 INFO:tasks.workunit.client.1.smithi144.stderr: 81150K .......... .......... .......... .......... .......... 59% 7.98M 2s 2024-03-08T20:31:43.206 INFO:tasks.workunit.client.1.smithi144.stderr: 81200K .......... .......... .......... .......... .......... 59% 9.06M 2s 2024-03-08T20:31:43.206 INFO:tasks.workunit.client.1.smithi144.stderr: 81250K .......... .......... .......... .......... .......... 59% 66.8M 2s 2024-03-08T20:31:43.206 INFO:tasks.workunit.client.1.smithi144.stderr: 81300K .......... .......... .......... .......... .......... 59% 65.4M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81350K .......... .......... .......... .......... .......... 59% 33.4M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81400K .......... .......... .......... .......... .......... 59% 41.7M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81450K .......... .......... .......... .......... .......... 60% 58.0M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81500K .......... .......... .......... .......... .......... 60% 76.5M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81550K .......... .......... .......... .......... .......... 60% 74.7M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81600K .......... .......... .......... .......... .......... 60% 82.5M 2s 2024-03-08T20:31:43.214 INFO:tasks.workunit.client.1.smithi144.stderr: 81650K .......... .......... .......... .......... .......... 60% 81.8M 2s 2024-03-08T20:31:43.215 INFO:tasks.workunit.client.1.smithi144.stderr: 81700K .......... .......... .......... .......... .......... 60% 34.6M 2s 2024-03-08T20:31:43.216 INFO:tasks.workunit.client.1.smithi144.stderr: 81750K .......... .......... .......... .......... .......... 60% 24.0M 2s 2024-03-08T20:31:43.216 INFO:tasks.workunit.client.1.smithi144.stderr: 81800K .......... .......... .......... .......... .......... 60% 39.7M 2s 2024-03-08T20:31:43.218 INFO:tasks.workunit.client.1.smithi144.stderr: 81850K .......... .......... .......... .......... .......... 60% 27.7M 2s 2024-03-08T20:31:43.220 INFO:tasks.workunit.client.1.smithi144.stderr: 81900K .......... .......... .......... .......... .......... 60% 24.0M 2s 2024-03-08T20:31:43.222 INFO:tasks.workunit.client.1.smithi144.stderr: 81950K .......... .......... .......... .......... .......... 60% 30.9M 2s 2024-03-08T20:31:43.223 INFO:tasks.workunit.client.1.smithi144.stderr: 82000K .......... .......... .......... .......... .......... 60% 26.4M 2s 2024-03-08T20:31:43.224 INFO:tasks.workunit.client.1.smithi144.stderr: 82050K .......... .......... .......... .......... .......... 60% 48.5M 2s 2024-03-08T20:31:43.226 INFO:tasks.workunit.client.1.smithi144.stderr: 82100K .......... .......... .......... .......... .......... 60% 24.8M 2s 2024-03-08T20:31:43.229 INFO:tasks.workunit.client.1.smithi144.stderr: 82150K .......... .......... .......... .......... .......... 60% 22.6M 2s 2024-03-08T20:31:43.230 INFO:tasks.workunit.client.1.smithi144.stderr: 82200K .......... .......... .......... .......... .......... 60% 40.5M 2s 2024-03-08T20:31:43.232 INFO:tasks.workunit.client.1.smithi144.stderr: 82250K .......... .......... .......... .......... .......... 60% 24.3M 2s 2024-03-08T20:31:43.233 INFO:tasks.workunit.client.1.smithi144.stderr: 82300K .......... .......... .......... .......... .......... 60% 40.5M 2s 2024-03-08T20:31:43.235 INFO:tasks.workunit.client.1.smithi144.stderr: 82350K .......... .......... .......... .......... .......... 60% 22.8M 2s 2024-03-08T20:31:43.237 INFO:tasks.workunit.client.1.smithi144.stderr: 82400K .......... .......... .......... .......... .......... 60% 30.2M 2s 2024-03-08T20:31:43.241 INFO:tasks.workunit.client.1.smithi144.stderr: 82450K .......... .......... .......... .......... .......... 60% 11.5M 2s 2024-03-08T20:31:43.249 INFO:tasks.workunit.client.1.smithi144.stderr: 82500K .......... .......... .......... .......... .......... 60% 6.59M 2s 2024-03-08T20:31:43.249 INFO:tasks.workunit.client.1.smithi144.stderr: 82550K .......... .......... .......... .......... .......... 60% 60.7M 2s 2024-03-08T20:31:43.251 INFO:tasks.workunit.client.1.smithi144.stderr: 82600K .......... .......... .......... .......... .......... 60% 31.7M 2s 2024-03-08T20:31:43.252 INFO:tasks.workunit.client.1.smithi144.stderr: 82650K .......... .......... .......... .......... .......... 60% 44.3M 2s 2024-03-08T20:31:43.255 INFO:tasks.workunit.client.1.smithi144.stderr: 82700K .......... .......... .......... .......... .......... 60% 56.4M 2s 2024-03-08T20:31:43.255 INFO:tasks.workunit.client.1.smithi144.stderr: 82750K .......... .......... .......... .......... .......... 60% 73.2M 2s 2024-03-08T20:31:43.255 INFO:tasks.workunit.client.1.smithi144.stderr: 82800K .......... .......... .......... .......... .......... 61% 44.1M 2s 2024-03-08T20:31:43.256 INFO:tasks.workunit.client.1.smithi144.stderr: 82850K .......... .......... .......... .......... .......... 61% 68.4M 2s 2024-03-08T20:31:43.261 INFO:tasks.workunit.client.1.smithi144.stderr: 82900K .......... .......... .......... .......... .......... 61% 69.9M 2s 2024-03-08T20:31:43.261 INFO:tasks.workunit.client.1.smithi144.stderr: 82950K .......... .......... .......... .......... .......... 61% 46.1M 2s 2024-03-08T20:31:43.262 INFO:tasks.workunit.client.1.smithi144.stderr: 83000K .......... .......... .......... .......... .......... 61% 40.5M 2s 2024-03-08T20:31:43.262 INFO:tasks.workunit.client.1.smithi144.stderr: 83050K .......... .......... .......... .......... .......... 61% 51.6M 2s 2024-03-08T20:31:43.262 INFO:tasks.workunit.client.1.smithi144.stderr: 83100K .......... .......... .......... .......... .......... 61% 42.6M 2s 2024-03-08T20:31:43.264 INFO:tasks.workunit.client.1.smithi144.stderr: 83150K .......... .......... .......... .......... .......... 61% 27.5M 2s 2024-03-08T20:31:43.264 INFO:tasks.workunit.client.1.smithi144.stderr: 83200K .......... .......... .......... .......... .......... 61% 29.9M 2s 2024-03-08T20:31:43.266 INFO:tasks.workunit.client.1.smithi144.stderr: 83250K .......... .......... .......... .......... .......... 61% 31.5M 2s 2024-03-08T20:31:43.267 INFO:tasks.workunit.client.1.smithi144.stderr: 83300K .......... .......... .......... .......... .......... 61% 39.7M 2s 2024-03-08T20:31:43.268 INFO:tasks.workunit.client.1.smithi144.stderr: 83350K .......... .......... .......... .......... .......... 61% 23.3M 2s 2024-03-08T20:31:43.271 INFO:tasks.workunit.client.1.smithi144.stderr: 83400K .......... .......... .......... .......... .......... 61% 24.1M 2s 2024-03-08T20:31:43.272 INFO:tasks.workunit.client.1.smithi144.stderr: 83450K .......... .......... .......... .......... .......... 61% 29.1M 2s 2024-03-08T20:31:43.274 INFO:tasks.workunit.client.1.smithi144.stderr: 83500K .......... .......... .......... .......... .......... 61% 27.3M 2s 2024-03-08T20:31:43.278 INFO:tasks.workunit.client.1.smithi144.stderr: 83550K .......... .......... .......... .......... .......... 61% 14.4M 2s 2024-03-08T20:31:43.288 INFO:tasks.workunit.client.1.smithi144.stderr: 83600K .......... .......... .......... .......... .......... 61% 6.46M 2s 2024-03-08T20:31:43.288 INFO:tasks.workunit.client.1.smithi144.stderr: 83650K .......... .......... .......... .......... .......... 61% 67.4M 2s 2024-03-08T20:31:43.289 INFO:tasks.workunit.client.1.smithi144.stderr: 83700K .......... .......... .......... .......... .......... 61% 60.0M 2s 2024-03-08T20:31:43.289 INFO:tasks.workunit.client.1.smithi144.stderr: 83750K .......... .......... .......... .......... .......... 61% 78.7M 2s 2024-03-08T20:31:43.289 INFO:tasks.workunit.client.1.smithi144.stderr: 83800K .......... .......... .......... .......... .......... 61% 73.6M 2s 2024-03-08T20:31:43.294 INFO:tasks.workunit.client.1.smithi144.stderr: 83850K .......... .......... .......... .......... .......... 61% 30.5M 2s 2024-03-08T20:31:43.294 INFO:tasks.workunit.client.1.smithi144.stderr: 83900K .......... .......... .......... .......... .......... 61% 75.0M 2s 2024-03-08T20:31:43.294 INFO:tasks.workunit.client.1.smithi144.stderr: 83950K .......... .......... .......... .......... .......... 61% 73.0M 2s 2024-03-08T20:31:43.294 INFO:tasks.workunit.client.1.smithi144.stderr: 84000K .......... .......... .......... .......... .......... 61% 67.3M 2s 2024-03-08T20:31:43.295 INFO:tasks.workunit.client.1.smithi144.stderr: 84050K .......... .......... .......... .......... .......... 61% 27.5M 2s 2024-03-08T20:31:43.295 INFO:tasks.workunit.client.1.smithi144.stderr: 84100K .......... .......... .......... .......... .......... 61% 52.5M 2s 2024-03-08T20:31:43.297 INFO:tasks.workunit.client.1.smithi144.stderr: 84150K .......... .......... .......... .......... .......... 62% 24.8M 2s 2024-03-08T20:31:43.298 INFO:tasks.workunit.client.1.smithi144.stderr: 84200K .......... .......... .......... .......... .......... 62% 24.8M 2s 2024-03-08T20:31:43.300 INFO:tasks.workunit.client.1.smithi144.stderr: 84250K .......... .......... .......... .......... .......... 62% 31.9M 2s 2024-03-08T20:31:43.303 INFO:tasks.workunit.client.1.smithi144.stderr: 84300K .......... .......... .......... .......... .......... 62% 24.4M 2s 2024-03-08T20:31:43.303 INFO:tasks.workunit.client.1.smithi144.stderr: 84350K .......... .......... .......... .......... .......... 62% 48.5M 2s 2024-03-08T20:31:43.304 INFO:tasks.workunit.client.1.smithi144.stderr: 84400K .......... .......... .......... .......... .......... 62% 25.7M 2s 2024-03-08T20:31:43.307 INFO:tasks.workunit.client.1.smithi144.stderr: 84450K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-03-08T20:31:43.308 INFO:tasks.workunit.client.1.smithi144.stderr: 84500K .......... .......... .......... .......... .......... 62% 32.2M 2s 2024-03-08T20:31:43.309 INFO:tasks.workunit.client.1.smithi144.stderr: 84550K .......... .......... .......... .......... .......... 62% 38.6M 2s 2024-03-08T20:31:43.311 INFO:tasks.workunit.client.1.smithi144.stderr: 84600K .......... .......... .......... .......... .......... 62% 27.6M 2s 2024-03-08T20:31:43.313 INFO:tasks.workunit.client.1.smithi144.stderr: 84650K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-03-08T20:31:43.315 INFO:tasks.workunit.client.1.smithi144.stderr: 84700K .......... .......... .......... .......... .......... 62% 32.0M 2s 2024-03-08T20:31:43.317 INFO:tasks.workunit.client.1.smithi144.stderr: 84750K .......... .......... .......... .......... .......... 62% 25.9M 2s 2024-03-08T20:31:43.319 INFO:tasks.workunit.client.1.smithi144.stderr: 84800K .......... .......... .......... .......... .......... 62% 26.2M 2s 2024-03-08T20:31:43.319 INFO:tasks.workunit.client.1.smithi144.stderr: 84850K .......... .......... .......... .......... .......... 62% 39.3M 2s 2024-03-08T20:31:43.321 INFO:tasks.workunit.client.1.smithi144.stderr: 84900K .......... .......... .......... .......... .......... 62% 26.3M 2s 2024-03-08T20:31:43.323 INFO:tasks.workunit.client.1.smithi144.stderr: 84950K .......... .......... .......... .......... .......... 62% 36.4M 2s 2024-03-08T20:31:43.325 INFO:tasks.workunit.client.1.smithi144.stderr: 85000K .......... .......... .......... .......... .......... 62% 23.6M 2s 2024-03-08T20:31:43.329 INFO:tasks.workunit.client.1.smithi144.stderr: 85050K .......... .......... .......... .......... .......... 62% 11.9M 2s 2024-03-08T20:31:43.332 INFO:tasks.workunit.client.1.smithi144.stderr: 85100K .......... .......... .......... .......... .......... 62% 46.2M 2s 2024-03-08T20:31:43.332 INFO:tasks.workunit.client.1.smithi144.stderr: 85150K .......... .......... .......... .......... .......... 62% 45.1M 2s 2024-03-08T20:31:43.332 INFO:tasks.workunit.client.1.smithi144.stderr: 85200K .......... .......... .......... .......... .......... 62% 97.3M 2s 2024-03-08T20:31:43.334 INFO:tasks.workunit.client.1.smithi144.stderr: 85250K .......... .......... .......... .......... .......... 62% 25.0M 2s 2024-03-08T20:31:43.336 INFO:tasks.workunit.client.1.smithi144.stderr: 85300K .......... .......... .......... .......... .......... 62% 26.3M 2s 2024-03-08T20:31:43.337 INFO:tasks.workunit.client.1.smithi144.stderr: 85350K .......... .......... .......... .......... .......... 62% 40.8M 2s 2024-03-08T20:31:43.339 INFO:tasks.workunit.client.1.smithi144.stderr: 85400K .......... .......... .......... .......... .......... 62% 22.5M 2s 2024-03-08T20:31:43.341 INFO:tasks.workunit.client.1.smithi144.stderr: 85450K .......... .......... .......... .......... .......... 62% 31.4M 2s 2024-03-08T20:31:43.342 INFO:tasks.workunit.client.1.smithi144.stderr: 85500K .......... .......... .......... .......... .......... 63% 30.5M 2s 2024-03-08T20:31:43.345 INFO:tasks.workunit.client.1.smithi144.stderr: 85550K .......... .......... .......... .......... .......... 63% 16.4M 2s 2024-03-08T20:31:43.351 INFO:tasks.workunit.client.1.smithi144.stderr: 85600K .......... .......... .......... .......... .......... 63% 16.0M 2s 2024-03-08T20:31:43.351 INFO:tasks.workunit.client.1.smithi144.stderr: 85650K .......... .......... .......... .......... .......... 63% 69.2M 2s 2024-03-08T20:31:43.351 INFO:tasks.workunit.client.1.smithi144.stderr: 85700K .......... .......... .......... .......... .......... 63% 80.3M 2s 2024-03-08T20:31:43.351 INFO:tasks.workunit.client.1.smithi144.stderr: 85750K .......... .......... .......... .......... .......... 63% 32.6M 2s 2024-03-08T20:31:43.353 INFO:tasks.workunit.client.1.smithi144.stderr: 85800K .......... .......... .......... .......... .......... 63% 22.9M 2s 2024-03-08T20:31:43.355 INFO:tasks.workunit.client.1.smithi144.stderr: 85850K .......... .......... .......... .......... .......... 63% 42.9M 2s 2024-03-08T20:31:43.356 INFO:tasks.workunit.client.1.smithi144.stderr: 85900K .......... .......... .......... .......... .......... 63% 29.3M 2s 2024-03-08T20:31:43.357 INFO:tasks.workunit.client.1.smithi144.stderr: 85950K .......... .......... .......... .......... .......... 63% 35.8M 2s 2024-03-08T20:31:43.359 INFO:tasks.workunit.client.1.smithi144.stderr: 86000K .......... .......... .......... .......... .......... 63% 24.8M 2s 2024-03-08T20:31:43.361 INFO:tasks.workunit.client.1.smithi144.stderr: 86050K .......... .......... .......... .......... .......... 63% 27.4M 2s 2024-03-08T20:31:43.362 INFO:tasks.workunit.client.1.smithi144.stderr: 86100K .......... .......... .......... .......... .......... 63% 37.8M 2s 2024-03-08T20:31:43.364 INFO:tasks.workunit.client.1.smithi144.stderr: 86150K .......... .......... .......... .......... .......... 63% 26.2M 2s 2024-03-08T20:31:43.366 INFO:tasks.workunit.client.1.smithi144.stderr: 86200K .......... .......... .......... .......... .......... 63% 23.6M 2s 2024-03-08T20:31:43.367 INFO:tasks.workunit.client.1.smithi144.stderr: 86250K .......... .......... .......... .......... .......... 63% 34.2M 2s 2024-03-08T20:31:43.370 INFO:tasks.workunit.client.1.smithi144.stderr: 86300K .......... .......... .......... .......... .......... 63% 27.0M 2s 2024-03-08T20:31:43.370 INFO:tasks.workunit.client.1.smithi144.stderr: 86350K .......... .......... .......... .......... .......... 63% 45.3M 2s 2024-03-08T20:31:43.372 INFO:tasks.workunit.client.1.smithi144.stderr: 86400K .......... .......... .......... .......... .......... 63% 23.4M 2s 2024-03-08T20:31:43.374 INFO:tasks.workunit.client.1.smithi144.stderr: 86450K .......... .......... .......... .......... .......... 63% 35.3M 2s 2024-03-08T20:31:43.377 INFO:tasks.workunit.client.1.smithi144.stderr: 86500K .......... .......... .......... .......... .......... 63% 23.9M 2s 2024-03-08T20:31:43.378 INFO:tasks.workunit.client.1.smithi144.stderr: 86550K .......... .......... .......... .......... .......... 63% 28.6M 2s 2024-03-08T20:31:43.379 INFO:tasks.workunit.client.1.smithi144.stderr: 86600K .......... .......... .......... .......... .......... 63% 29.6M 2s 2024-03-08T20:31:43.380 INFO:tasks.workunit.client.1.smithi144.stderr: 86650K .......... .......... .......... .......... .......... 63% 36.0M 2s 2024-03-08T20:31:43.382 INFO:tasks.workunit.client.1.smithi144.stderr: 86700K .......... .......... .......... .......... .......... 63% 27.3M 2s 2024-03-08T20:31:43.384 INFO:tasks.workunit.client.1.smithi144.stderr: 86750K .......... .......... .......... .......... .......... 63% 24.1M 2s 2024-03-08T20:31:43.387 INFO:tasks.workunit.client.1.smithi144.stderr: 86800K .......... .......... .......... .......... .......... 63% 24.8M 2s 2024-03-08T20:31:43.388 INFO:tasks.workunit.client.1.smithi144.stderr: 86850K .......... .......... .......... .......... .......... 64% 51.2M 2s 2024-03-08T20:31:43.389 INFO:tasks.workunit.client.1.smithi144.stderr: 86900K .......... .......... .......... .......... .......... 64% 24.0M 2s 2024-03-08T20:31:43.391 INFO:tasks.workunit.client.1.smithi144.stderr: 86950K .......... .......... .......... .......... .......... 64% 30.8M 2s 2024-03-08T20:31:43.394 INFO:tasks.workunit.client.1.smithi144.stderr: 87000K .......... .......... .......... .......... .......... 64% 25.4M 2s 2024-03-08T20:31:43.396 INFO:tasks.workunit.client.1.smithi144.stderr: 87050K .......... .......... .......... .......... .......... 64% 25.1M 2s 2024-03-08T20:31:43.396 INFO:tasks.workunit.client.1.smithi144.stderr: 87100K .......... .......... .......... .......... .......... 64% 35.6M 2s 2024-03-08T20:31:43.398 INFO:tasks.workunit.client.1.smithi144.stderr: 87150K .......... .......... .......... .......... .......... 64% 31.3M 2s 2024-03-08T20:31:43.399 INFO:tasks.workunit.client.1.smithi144.stderr: 87200K .......... .......... .......... .......... .......... 64% 27.1M 2s 2024-03-08T20:31:43.401 INFO:tasks.workunit.client.1.smithi144.stderr: 87250K .......... .......... .......... .......... .......... 64% 32.0M 2s 2024-03-08T20:31:43.405 INFO:tasks.workunit.client.1.smithi144.stderr: 87300K .......... .......... .......... .......... .......... 64% 12.9M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87350K .......... .......... .......... .......... .......... 64% 25.3M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87400K .......... .......... .......... .......... .......... 64% 67.2M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87450K .......... .......... .......... .......... .......... 64% 79.7M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87500K .......... .......... .......... .......... .......... 64% 50.7M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87550K .......... .......... .......... .......... .......... 64% 20.8M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87600K .......... .......... .......... .......... .......... 64% 53.7M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87650K .......... .......... .......... .......... .......... 64% 27.5M 2s 2024-03-08T20:31:43.417 INFO:tasks.workunit.client.1.smithi144.stderr: 87700K .......... .......... .......... .......... .......... 64% 24.8M 2s 2024-03-08T20:31:43.419 INFO:tasks.workunit.client.1.smithi144.stderr: 87750K .......... .......... .......... .......... .......... 64% 32.5M 2s 2024-03-08T20:31:43.420 INFO:tasks.workunit.client.1.smithi144.stderr: 87800K .......... .......... .......... .......... .......... 64% 22.2M 2s 2024-03-08T20:31:43.421 INFO:tasks.workunit.client.1.smithi144.stderr: 87850K .......... .......... .......... .......... .......... 64% 41.8M 2s 2024-03-08T20:31:43.423 INFO:tasks.workunit.client.1.smithi144.stderr: 87900K .......... .......... .......... .......... .......... 64% 26.2M 2s 2024-03-08T20:31:43.425 INFO:tasks.workunit.client.1.smithi144.stderr: 87950K .......... .......... .......... .......... .......... 64% 33.2M 2s 2024-03-08T20:31:43.427 INFO:tasks.workunit.client.1.smithi144.stderr: 88000K .......... .......... .......... .......... .......... 64% 20.6M 2s 2024-03-08T20:31:43.428 INFO:tasks.workunit.client.1.smithi144.stderr: 88050K .......... .......... .......... .......... .......... 64% 28.8M 2s 2024-03-08T20:31:43.429 INFO:tasks.workunit.client.1.smithi144.stderr: 88100K .......... .......... .......... .......... .......... 64% 40.3M 2s 2024-03-08T20:31:43.431 INFO:tasks.workunit.client.1.smithi144.stderr: 88150K .......... .......... .......... .......... .......... 64% 25.0M 2s 2024-03-08T20:31:43.433 INFO:tasks.workunit.client.1.smithi144.stderr: 88200K .......... .......... .......... .......... .......... 65% 38.4M 2s 2024-03-08T20:31:43.435 INFO:tasks.workunit.client.1.smithi144.stderr: 88250K .......... .......... .......... .......... .......... 65% 26.3M 2s 2024-03-08T20:31:43.437 INFO:tasks.workunit.client.1.smithi144.stderr: 88300K .......... .......... .......... .......... .......... 65% 23.1M 2s 2024-03-08T20:31:43.440 INFO:tasks.workunit.client.1.smithi144.stderr: 88350K .......... .......... .......... .......... .......... 65% 42.3M 2s 2024-03-08T20:31:43.440 INFO:tasks.workunit.client.1.smithi144.stderr: 88400K .......... .......... .......... .......... .......... 65% 27.0M 2s 2024-03-08T20:31:43.442 INFO:tasks.workunit.client.1.smithi144.stderr: 88450K .......... .......... .......... .......... .......... 65% 29.3M 2s 2024-03-08T20:31:43.444 INFO:tasks.workunit.client.1.smithi144.stderr: 88500K .......... .......... .......... .......... .......... 65% 29.3M 2s 2024-03-08T20:31:43.445 INFO:tasks.workunit.client.1.smithi144.stderr: 88550K .......... .......... .......... .......... .......... 65% 27.3M 2s 2024-03-08T20:31:43.448 INFO:tasks.workunit.client.1.smithi144.stderr: 88600K .......... .......... .......... .......... .......... 65% 37.5M 2s 2024-03-08T20:31:43.448 INFO:tasks.workunit.client.1.smithi144.stderr: 88650K .......... .......... .......... .......... .......... 65% 29.0M 2s 2024-03-08T20:31:43.449 INFO:tasks.workunit.client.0.smithi118.stdout:checking for library containing strerror... none required 2024-03-08T20:31:43.451 INFO:tasks.workunit.client.1.smithi144.stderr: 88700K .......... .......... .......... .......... .......... 65% 23.1M 2s 2024-03-08T20:31:43.452 INFO:tasks.workunit.client.1.smithi144.stderr: 88750K .......... .......... .......... .......... .......... 65% 28.3M 2s 2024-03-08T20:31:43.454 INFO:tasks.workunit.client.1.smithi144.stderr: 88800K .......... .......... .......... .......... .......... 65% 27.9M 2s 2024-03-08T20:31:43.456 INFO:tasks.workunit.client.1.smithi144.stderr: 88850K .......... .......... .......... .......... .......... 65% 23.3M 2s 2024-03-08T20:31:43.457 INFO:tasks.workunit.client.1.smithi144.stderr: 88900K .......... .......... .......... .......... .......... 65% 53.5M 2s 2024-03-08T20:31:43.459 INFO:tasks.workunit.client.1.smithi144.stderr: 88950K .......... .......... .......... .......... .......... 65% 26.5M 2s 2024-03-08T20:31:43.461 INFO:tasks.workunit.client.1.smithi144.stderr: 89000K .......... .......... .......... .......... .......... 65% 23.6M 2s 2024-03-08T20:31:43.462 INFO:tasks.workunit.client.1.smithi144.stderr: 89050K .......... .......... .......... .......... .......... 65% 31.7M 2s 2024-03-08T20:31:43.463 INFO:tasks.workunit.client.1.smithi144.stderr: 89100K .......... .......... .......... .......... .......... 65% 29.3M 2s 2024-03-08T20:31:43.465 INFO:tasks.workunit.client.1.smithi144.stderr: 89150K .......... .......... .......... .......... .......... 65% 45.2M 2s 2024-03-08T20:31:43.472 INFO:tasks.workunit.client.1.smithi144.stderr: 89200K .......... .......... .......... .......... .......... 65% 9.36M 2s 2024-03-08T20:31:43.472 INFO:tasks.workunit.client.1.smithi144.stderr: 89250K .......... .......... .......... .......... .......... 65% 69.4M 2s 2024-03-08T20:31:43.472 INFO:tasks.workunit.client.1.smithi144.stderr: 89300K .......... .......... .......... .......... .......... 65% 113M 2s 2024-03-08T20:31:43.473 INFO:tasks.workunit.client.1.smithi144.stderr: 89350K .......... .......... .......... .......... .......... 65% 47.4M 2s 2024-03-08T20:31:43.473 INFO:tasks.workunit.client.1.smithi144.stderr: 89400K .......... .......... .......... .......... .......... 65% 46.4M 2s 2024-03-08T20:31:43.475 INFO:tasks.workunit.client.1.smithi144.stderr: 89450K .......... .......... .......... .......... .......... 65% 26.7M 2s 2024-03-08T20:31:43.500 INFO:tasks.workunit.client.1.smithi144.stderr: 89500K .......... .......... .......... .......... .......... 65% 31.0M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89550K .......... .......... .......... .......... .......... 66% 25.8M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89600K .......... .......... .......... .......... .......... 66% 25.2M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89650K .......... .......... .......... .......... .......... 66% 42.5M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89700K .......... .......... .......... .......... .......... 66% 25.5M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89750K .......... .......... .......... .......... .......... 66% 33.8M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89800K .......... .......... .......... .......... .......... 66% 25.9M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89850K .......... .......... .......... .......... .......... 66% 30.3M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89900K .......... .......... .......... .......... .......... 66% 35.2M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 89950K .......... .......... .......... .......... .......... 66% 21.6M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 90000K .......... .......... .......... .......... .......... 66% 35.1M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 90050K .......... .......... .......... .......... .......... 66% 11.1M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 90100K .......... .......... .......... .......... .......... 66% 126M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 90150K .......... .......... .......... .......... .......... 66% 118M 2s 2024-03-08T20:31:43.501 INFO:tasks.workunit.client.1.smithi144.stderr: 90200K .......... .......... .......... .......... .......... 66% 32.9M 2s 2024-03-08T20:31:43.503 INFO:tasks.workunit.client.1.smithi144.stderr: 90250K .......... .......... .......... .......... .......... 66% 31.6M 2s 2024-03-08T20:31:43.504 INFO:tasks.workunit.client.1.smithi144.stderr: 90300K .......... .......... .......... .......... .......... 66% 23.1M 2s 2024-03-08T20:31:43.506 INFO:tasks.workunit.client.1.smithi144.stderr: 90350K .......... .......... .......... .......... .......... 66% 49.9M 2s 2024-03-08T20:31:43.506 INFO:tasks.workunit.client.1.smithi144.stderr: 90400K .......... .......... .......... .......... .......... 66% 26.3M 2s 2024-03-08T20:31:43.509 INFO:tasks.workunit.client.1.smithi144.stderr: 90450K .......... .......... .......... .......... .......... 66% 22.6M 2s 2024-03-08T20:31:43.510 INFO:tasks.workunit.client.1.smithi144.stderr: 90500K .......... .......... .......... .......... .......... 66% 27.4M 2s 2024-03-08T20:31:43.512 INFO:tasks.workunit.client.1.smithi144.stderr: 90550K .......... .......... .......... .......... .......... 66% 31.2M 2s 2024-03-08T20:31:43.514 INFO:tasks.workunit.client.1.smithi144.stderr: 90600K .......... .......... .......... .......... .......... 66% 25.5M 2s 2024-03-08T20:31:43.515 INFO:tasks.workunit.client.1.smithi144.stderr: 90650K .......... .......... .......... .......... .......... 66% 43.1M 2s 2024-03-08T20:31:43.517 INFO:tasks.workunit.client.1.smithi144.stderr: 90700K .......... .......... .......... .......... .......... 66% 26.7M 2s 2024-03-08T20:31:43.519 INFO:tasks.workunit.client.1.smithi144.stderr: 90750K .......... .......... .......... .......... .......... 66% 23.9M 2s 2024-03-08T20:31:43.521 INFO:tasks.workunit.client.1.smithi144.stderr: 90800K .......... .......... .......... .......... .......... 66% 25.3M 2s 2024-03-08T20:31:43.522 INFO:tasks.workunit.client.1.smithi144.stderr: 90850K .......... .......... .......... .......... .......... 66% 37.7M 2s 2024-03-08T20:31:43.524 INFO:tasks.workunit.client.1.smithi144.stderr: 90900K .......... .......... .......... .......... .......... 66% 29.9M 2s 2024-03-08T20:31:43.526 INFO:tasks.workunit.client.1.smithi144.stderr: 90950K .......... .......... .......... .......... .......... 67% 25.1M 2s 2024-03-08T20:31:43.528 INFO:tasks.workunit.client.1.smithi144.stderr: 91000K .......... .......... .......... .......... .......... 67% 23.8M 2s 2024-03-08T20:31:43.530 INFO:tasks.workunit.client.1.smithi144.stderr: 91050K .......... .......... .......... .......... .......... 67% 26.4M 2s 2024-03-08T20:31:43.531 INFO:tasks.workunit.client.1.smithi144.stderr: 91100K .......... .......... .......... .......... .......... 67% 46.3M 2s 2024-03-08T20:31:43.533 INFO:tasks.workunit.client.1.smithi144.stderr: 91150K .......... .......... .......... .......... .......... 67% 29.7M 2s 2024-03-08T20:31:43.534 INFO:tasks.workunit.client.1.smithi144.stderr: 91200K .......... .......... .......... .......... .......... 67% 26.9M 2s 2024-03-08T20:31:43.537 INFO:tasks.workunit.client.1.smithi144.stderr: 91250K .......... .......... .......... .......... .......... 67% 21.5M 2s 2024-03-08T20:31:43.538 INFO:tasks.workunit.client.1.smithi144.stderr: 91300K .......... .......... .......... .......... .......... 67% 36.9M 2s 2024-03-08T20:31:43.539 INFO:tasks.workunit.client.1.smithi144.stderr: 91350K .......... .......... .......... .......... .......... 67% 37.3M 2s 2024-03-08T20:31:43.541 INFO:tasks.workunit.client.1.smithi144.stderr: 91400K .......... .......... .......... .......... .......... 67% 26.6M 2s 2024-03-08T20:31:43.543 INFO:tasks.workunit.client.1.smithi144.stderr: 91450K .......... .......... .......... .......... .......... 67% 25.2M 2s 2024-03-08T20:31:43.545 INFO:tasks.workunit.client.1.smithi144.stderr: 91500K .......... .......... .......... .......... .......... 67% 29.8M 2s 2024-03-08T20:31:43.548 INFO:tasks.workunit.client.1.smithi144.stderr: 91550K .......... .......... .......... .......... .......... 67% 30.0M 2s 2024-03-08T20:31:43.548 INFO:tasks.workunit.client.1.smithi144.stderr: 91600K .......... .......... .......... .......... .......... 67% 35.5M 2s 2024-03-08T20:31:43.556 INFO:tasks.workunit.client.1.smithi144.stderr: 91650K .......... .......... .......... .......... .......... 67% 22.1M 2s 2024-03-08T20:31:43.556 INFO:tasks.workunit.client.1.smithi144.stderr: 91700K .......... .......... .......... .......... .......... 67% 35.7M 2s 2024-03-08T20:31:43.556 INFO:tasks.workunit.client.1.smithi144.stderr: 91750K .......... .......... .......... .......... .......... 67% 30.3M 2s 2024-03-08T20:31:43.556 INFO:tasks.workunit.client.1.smithi144.stderr: 91800K .......... .......... .......... .......... .......... 67% 35.7M 2s 2024-03-08T20:31:43.558 INFO:tasks.workunit.client.1.smithi144.stderr: 91850K .......... .......... .......... .......... .......... 67% 19.2M 2s 2024-03-08T20:31:43.558 INFO:tasks.workunit.client.1.smithi144.stderr: 91900K .......... .......... .......... .......... .......... 67% 50.2M 2s 2024-03-08T20:31:43.559 INFO:tasks.workunit.client.1.smithi144.stderr: 91950K .......... .......... .......... .......... .......... 67% 26.5M 2s 2024-03-08T20:31:43.562 INFO:tasks.workunit.client.1.smithi144.stderr: 92000K .......... .......... .......... .......... .......... 67% 21.3M 2s 2024-03-08T20:31:43.564 INFO:tasks.workunit.client.1.smithi144.stderr: 92050K .......... .......... .......... .......... .......... 67% 29.7M 2s 2024-03-08T20:31:43.565 INFO:tasks.workunit.client.1.smithi144.stderr: 92100K .......... .......... .......... .......... .......... 67% 33.7M 2s 2024-03-08T20:31:43.566 INFO:tasks.workunit.client.1.smithi144.stderr: 92150K .......... .......... .......... .......... .......... 67% 32.0M 2s 2024-03-08T20:31:43.568 INFO:tasks.workunit.client.1.smithi144.stderr: 92200K .......... .......... .......... .......... .......... 67% 23.6M 2s 2024-03-08T20:31:43.577 INFO:tasks.workunit.client.1.smithi144.stderr: 92250K .......... .......... .......... .......... .......... 67% 35.5M 2s 2024-03-08T20:31:43.577 INFO:tasks.workunit.client.1.smithi144.stderr: 92300K .......... .......... .......... .......... .......... 68% 11.8M 2s 2024-03-08T20:31:43.577 INFO:tasks.workunit.client.1.smithi144.stderr: 92350K .......... .......... .......... .......... .......... 68% 61.4M 2s 2024-03-08T20:31:43.577 INFO:tasks.workunit.client.1.smithi144.stderr: 92400K .......... .......... .......... .......... .......... 68% 75.8M 2s 2024-03-08T20:31:43.577 INFO:tasks.workunit.client.1.smithi144.stderr: 92450K .......... .......... .......... .......... .......... 68% 36.9M 2s 2024-03-08T20:31:43.579 INFO:tasks.workunit.client.1.smithi144.stderr: 92500K .......... .......... .......... .......... .......... 68% 24.6M 2s 2024-03-08T20:31:43.581 INFO:tasks.workunit.client.1.smithi144.stderr: 92550K .......... .......... .......... .......... .......... 68% 23.8M 2s 2024-03-08T20:31:43.582 INFO:tasks.workunit.client.1.smithi144.stderr: 92600K .......... .......... .......... .......... .......... 68% 40.4M 2s 2024-03-08T20:31:43.583 INFO:tasks.workunit.client.1.smithi144.stderr: 92650K .......... .......... .......... .......... .......... 68% 38.1M 2s 2024-03-08T20:31:43.585 INFO:tasks.workunit.client.1.smithi144.stderr: 92700K .......... .......... .......... .......... .......... 68% 26.9M 2s 2024-03-08T20:31:43.595 INFO:tasks.workunit.client.1.smithi144.stderr: 92750K .......... .......... .......... .......... .......... 68% 5.92M 2s 2024-03-08T20:31:43.595 INFO:tasks.workunit.client.1.smithi144.stderr: 92800K .......... .......... .......... .......... .......... 68% 67.2M 2s 2024-03-08T20:31:43.605 INFO:tasks.workunit.client.1.smithi144.stderr: 92850K .......... .......... .......... .......... .......... 68% 17.4M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 92900K .......... .......... .......... .......... .......... 68% 70.2M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 92950K .......... .......... .......... .......... .......... 68% 64.3M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93000K .......... .......... .......... .......... .......... 68% 73.3M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93050K .......... .......... .......... .......... .......... 68% 69.2M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93100K .......... .......... .......... .......... .......... 68% 69.0M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93150K .......... .......... .......... .......... .......... 68% 73.5M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93200K .......... .......... .......... .......... .......... 68% 72.6M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93250K .......... .......... .......... .......... .......... 68% 31.0M 2s 2024-03-08T20:31:43.606 INFO:tasks.workunit.client.1.smithi144.stderr: 93300K .......... .......... .......... .......... .......... 68% 26.4M 2s 2024-03-08T20:31:43.607 INFO:tasks.workunit.client.1.smithi144.stderr: 93350K .......... .......... .......... .......... .......... 68% 24.5M 2s 2024-03-08T20:31:43.608 INFO:tasks.workunit.client.1.smithi144.stderr: 93400K .......... .......... .......... .......... .......... 68% 45.0M 2s 2024-03-08T20:31:43.610 INFO:tasks.workunit.client.1.smithi144.stderr: 93450K .......... .......... .......... .......... .......... 68% 28.8M 2s 2024-03-08T20:31:43.612 INFO:tasks.workunit.client.1.smithi144.stderr: 93500K .......... .......... .......... .......... .......... 68% 22.6M 2s 2024-03-08T20:31:43.615 INFO:tasks.workunit.client.1.smithi144.stderr: 93550K .......... .......... .......... .......... .......... 68% 27.3M 2s 2024-03-08T20:31:43.616 INFO:tasks.workunit.client.1.smithi144.stderr: 93600K .......... .......... .......... .......... .......... 68% 28.7M 2s 2024-03-08T20:31:43.618 INFO:tasks.workunit.client.1.smithi144.stderr: 93650K .......... .......... .......... .......... .......... 69% 35.5M 2s 2024-03-08T20:31:43.619 INFO:tasks.workunit.client.1.smithi144.stderr: 93700K .......... .......... .......... .......... .......... 69% 25.8M 2s 2024-03-08T20:31:43.620 INFO:tasks.workunit.client.1.smithi144.stderr: 93750K .......... .......... .......... .......... .......... 69% 30.6M 2s 2024-03-08T20:31:43.622 INFO:tasks.workunit.client.1.smithi144.stderr: 93800K .......... .......... .......... .......... .......... 69% 36.0M 2s 2024-03-08T20:31:43.624 INFO:tasks.workunit.client.1.smithi144.stderr: 93850K .......... .......... .......... .......... .......... 69% 22.6M 2s 2024-03-08T20:31:43.626 INFO:tasks.workunit.client.1.smithi144.stderr: 93900K .......... .......... .......... .......... .......... 69% 26.8M 2s 2024-03-08T20:31:43.627 INFO:tasks.workunit.client.1.smithi144.stderr: 93950K .......... .......... .......... .......... .......... 69% 43.0M 2s 2024-03-08T20:31:43.630 INFO:tasks.workunit.client.1.smithi144.stderr: 94000K .......... .......... .......... .......... .......... 69% 15.0M 2s 2024-03-08T20:31:43.644 INFO:tasks.workunit.client.1.smithi144.stderr: 94050K .......... .......... .......... .......... .......... 69% 7.40M 2s 2024-03-08T20:31:43.644 INFO:tasks.workunit.client.1.smithi144.stderr: 94100K .......... .......... .......... .......... .......... 69% 61.7M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94150K .......... .......... .......... .......... .......... 69% 91.8M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94200K .......... .......... .......... .......... .......... 69% 89.7M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94250K .......... .......... .......... .......... .......... 69% 85.5M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94300K .......... .......... .......... .......... .......... 69% 102M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94350K .......... .......... .......... .......... .......... 69% 57.7M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94400K .......... .......... .......... .......... .......... 69% 25.1M 2s 2024-03-08T20:31:43.645 INFO:tasks.workunit.client.1.smithi144.stderr: 94450K .......... .......... .......... .......... .......... 69% 42.4M 2s 2024-03-08T20:31:43.647 INFO:tasks.workunit.client.1.smithi144.stderr: 94500K .......... .......... .......... .......... .......... 69% 29.4M 2s 2024-03-08T20:31:43.648 INFO:tasks.workunit.client.1.smithi144.stderr: 94550K .......... .......... .......... .......... .......... 69% 26.6M 2s 2024-03-08T20:31:43.650 INFO:tasks.workunit.client.1.smithi144.stderr: 94600K .......... .......... .......... .......... .......... 69% 26.3M 2s 2024-03-08T20:31:43.654 INFO:tasks.workunit.client.1.smithi144.stderr: 94650K .......... .......... .......... .......... .......... 69% 25.8M 2s 2024-03-08T20:31:43.655 INFO:tasks.workunit.client.1.smithi144.stderr: 94700K .......... .......... .......... .......... .......... 69% 52.3M 2s 2024-03-08T20:31:43.655 INFO:tasks.workunit.client.1.smithi144.stderr: 94750K .......... .......... .......... .......... .......... 69% 29.5M 2s 2024-03-08T20:31:43.656 INFO:tasks.workunit.client.1.smithi144.stderr: 94800K .......... .......... .......... .......... .......... 69% 24.5M 2s 2024-03-08T20:31:43.657 INFO:tasks.workunit.client.1.smithi144.stderr: 94850K .......... .......... .......... .......... .......... 69% 26.2M 2s 2024-03-08T20:31:43.659 INFO:tasks.workunit.client.1.smithi144.stderr: 94900K .......... .......... .......... .......... .......... 69% 26.8M 2s 2024-03-08T20:31:43.661 INFO:tasks.workunit.client.1.smithi144.stderr: 94950K .......... .......... .......... .......... .......... 69% 30.8M 2s 2024-03-08T20:31:43.663 INFO:tasks.workunit.client.1.smithi144.stderr: 95000K .......... .......... .......... .......... .......... 70% 34.3M 1s 2024-03-08T20:31:43.665 INFO:tasks.workunit.client.1.smithi144.stderr: 95050K .......... .......... .......... .......... .......... 70% 26.6M 1s 2024-03-08T20:31:43.666 INFO:tasks.workunit.client.1.smithi144.stderr: 95100K .......... .......... .......... .......... .......... 70% 28.6M 1s 2024-03-08T20:31:43.668 INFO:tasks.workunit.client.1.smithi144.stderr: 95150K .......... .......... .......... .......... .......... 70% 26.1M 1s 2024-03-08T20:31:43.669 INFO:tasks.workunit.client.1.smithi144.stderr: 95200K .......... .......... .......... .......... .......... 70% 44.4M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95250K .......... .......... .......... .......... .......... 70% 13.2M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95300K .......... .......... .......... .......... .......... 70% 113M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95350K .......... .......... .......... .......... .......... 70% 40.2M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95400K .......... .......... .......... .......... .......... 70% 23.7M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95450K .......... .......... .......... .......... .......... 70% 53.6M 1s 2024-03-08T20:31:43.680 INFO:tasks.workunit.client.1.smithi144.stderr: 95500K .......... .......... .......... .......... .......... 70% 29.1M 1s 2024-03-08T20:31:43.691 INFO:tasks.workunit.client.1.smithi144.stderr: 95550K .......... .......... .......... .......... .......... 70% 5.76M 1s 2024-03-08T20:31:43.691 INFO:tasks.workunit.client.1.smithi144.stderr: 95600K .......... .......... .......... .......... .......... 70% 78.7M 1s 2024-03-08T20:31:43.691 INFO:tasks.workunit.client.1.smithi144.stderr: 95650K .......... .......... .......... .......... .......... 70% 71.1M 1s 2024-03-08T20:31:43.691 INFO:tasks.workunit.client.1.smithi144.stderr: 95700K .......... .......... .......... .......... .......... 70% 89.6M 1s 2024-03-08T20:31:43.691 INFO:tasks.workunit.client.1.smithi144.stderr: 95750K .......... .......... .......... .......... .......... 70% 41.8M 1s 2024-03-08T20:31:43.697 INFO:tasks.workunit.client.1.smithi144.stderr: 95800K .......... .......... .......... .......... .......... 70% 20.5M 1s 2024-03-08T20:31:43.697 INFO:tasks.workunit.client.1.smithi144.stderr: 95850K .......... .......... .......... .......... .......... 70% 71.2M 1s 2024-03-08T20:31:43.697 INFO:tasks.workunit.client.1.smithi144.stderr: 95900K .......... .......... .......... .......... .......... 70% 68.8M 1s 2024-03-08T20:31:43.697 INFO:tasks.workunit.client.1.smithi144.stderr: 95950K .......... .......... .......... .......... .......... 70% 78.9M 1s 2024-03-08T20:31:43.697 INFO:tasks.workunit.client.1.smithi144.stderr: 96000K .......... .......... .......... .......... .......... 70% 38.3M 1s 2024-03-08T20:31:43.698 INFO:tasks.workunit.client.1.smithi144.stderr: 96050K .......... .......... .......... .......... .......... 70% 26.7M 1s 2024-03-08T20:31:43.700 INFO:tasks.workunit.client.1.smithi144.stderr: 96100K .......... .......... .......... .......... .......... 70% 24.3M 1s 2024-03-08T20:31:43.703 INFO:tasks.workunit.client.1.smithi144.stderr: 96150K .......... .......... .......... .......... .......... 70% 13.8M 1s 2024-03-08T20:31:43.705 INFO:tasks.workunit.client.1.smithi144.stderr: 96200K .......... .......... .......... .......... .......... 70% 20.6M 1s 2024-03-08T20:31:43.710 INFO:tasks.workunit.client.1.smithi144.stderr: 96250K .......... .......... .......... .......... .......... 70% 30.7M 1s 2024-03-08T20:31:43.710 INFO:tasks.workunit.client.1.smithi144.stderr: 96300K .......... .......... .......... .......... .......... 70% 61.7M 1s 2024-03-08T20:31:43.710 INFO:tasks.workunit.client.1.smithi144.stderr: 96350K .......... .......... .......... .......... .......... 71% 76.7M 1s 2024-03-08T20:31:43.711 INFO:tasks.workunit.client.1.smithi144.stderr: 96400K .......... .......... .......... .......... .......... 71% 28.5M 1s 2024-03-08T20:31:43.712 INFO:tasks.workunit.client.1.smithi144.stderr: 96450K .......... .......... .......... .......... .......... 71% 21.6M 1s 2024-03-08T20:31:43.717 INFO:tasks.workunit.client.1.smithi144.stderr: 96500K .......... .......... .......... .......... .......... 71% 13.2M 1s 2024-03-08T20:31:43.719 INFO:tasks.workunit.client.1.smithi144.stderr: 96550K .......... .......... .......... .......... .......... 71% 18.9M 1s 2024-03-08T20:31:43.722 INFO:tasks.workunit.client.1.smithi144.stderr: 96600K .......... .......... .......... .......... .......... 71% 17.6M 1s 2024-03-08T20:31:43.724 INFO:tasks.workunit.client.1.smithi144.stderr: 96650K .......... .......... .......... .......... .......... 71% 40.8M 1s 2024-03-08T20:31:43.724 INFO:tasks.workunit.client.1.smithi144.stderr: 96700K .......... .......... .......... .......... .......... 71% 69.2M 1s 2024-03-08T20:31:43.727 INFO:tasks.workunit.client.1.smithi144.stderr: 96750K .......... .......... .......... .......... .......... 71% 13.6M 1s 2024-03-08T20:31:43.728 INFO:tasks.workunit.client.1.smithi144.stderr: 96800K .......... .......... .......... .......... .......... 71% 32.9M 1s 2024-03-08T20:31:43.731 INFO:tasks.workunit.client.1.smithi144.stderr: 96850K .......... .......... .......... .......... .......... 71% 19.1M 1s 2024-03-08T20:31:43.734 INFO:tasks.workunit.client.1.smithi144.stderr: 96900K .......... .......... .......... .......... .......... 71% 21.2M 1s 2024-03-08T20:31:43.735 INFO:tasks.workunit.client.1.smithi144.stderr: 96950K .......... .......... .......... .......... .......... 71% 34.0M 1s 2024-03-08T20:31:43.737 INFO:tasks.workunit.client.1.smithi144.stderr: 97000K .......... .......... .......... .......... .......... 71% 23.2M 1s 2024-03-08T20:31:43.739 INFO:tasks.workunit.client.1.smithi144.stderr: 97050K .......... .......... .......... .......... .......... 71% 26.4M 1s 2024-03-08T20:31:43.747 INFO:tasks.workunit.client.1.smithi144.stderr: 97100K .......... .......... .......... .......... .......... 71% 12.1M 1s 2024-03-08T20:31:43.747 INFO:tasks.workunit.client.1.smithi144.stderr: 97150K .......... .......... .......... .......... .......... 71% 71.4M 1s 2024-03-08T20:31:43.747 INFO:tasks.workunit.client.1.smithi144.stderr: 97200K .......... .......... .......... .......... .......... 71% 66.2M 1s 2024-03-08T20:31:43.747 INFO:tasks.workunit.client.1.smithi144.stderr: 97250K .......... .......... .......... .......... .......... 71% 74.9M 1s 2024-03-08T20:31:43.747 INFO:tasks.workunit.client.1.smithi144.stderr: 97300K .......... .......... .......... .......... .......... 71% 48.6M 1s 2024-03-08T20:31:43.749 INFO:tasks.workunit.client.1.smithi144.stderr: 97350K .......... .......... .......... .......... .......... 71% 17.8M 1s 2024-03-08T20:31:43.751 INFO:tasks.workunit.client.1.smithi144.stderr: 97400K .......... .......... .......... .......... .......... 71% 23.5M 1s 2024-03-08T20:31:43.751 INFO:tasks.workunit.client.1.smithi144.stderr: 97450K .......... .......... .......... .......... .......... 71% 72.6M 1s 2024-03-08T20:31:43.755 INFO:tasks.workunit.client.1.smithi144.stderr: 97500K .......... .......... .......... .......... .......... 71% 16.0M 1s 2024-03-08T20:31:43.756 INFO:tasks.workunit.client.1.smithi144.stderr: 97550K .......... .......... .......... .......... .......... 71% 24.8M 1s 2024-03-08T20:31:43.757 INFO:tasks.workunit.client.1.smithi144.stderr: 97600K .......... .......... .......... .......... .......... 71% 44.1M 1s 2024-03-08T20:31:43.760 INFO:tasks.workunit.client.1.smithi144.stderr: 97650K .......... .......... .......... .......... .......... 71% 34.2M 1s 2024-03-08T20:31:43.760 INFO:tasks.workunit.client.1.smithi144.stderr: 97700K .......... .......... .......... .......... .......... 72% 50.4M 1s 2024-03-08T20:31:43.761 INFO:tasks.workunit.client.1.smithi144.stderr: 97750K .......... .......... .......... .......... .......... 72% 62.2M 1s 2024-03-08T20:31:43.764 INFO:tasks.workunit.client.1.smithi144.stderr: 97800K .......... .......... .......... .......... .......... 72% 29.7M 1s 2024-03-08T20:31:43.764 INFO:tasks.workunit.client.1.smithi144.stderr: 97850K .......... .......... .......... .......... .......... 72% 37.3M 1s 2024-03-08T20:31:43.766 INFO:tasks.workunit.client.1.smithi144.stderr: 97900K .......... .......... .......... .......... .......... 72% 25.1M 1s 2024-03-08T20:31:43.767 INFO:tasks.workunit.client.1.smithi144.stderr: 97950K .......... .......... .......... .......... .......... 72% 41.6M 1s 2024-03-08T20:31:43.770 INFO:tasks.workunit.client.1.smithi144.stderr: 98000K .......... .......... .......... .......... .......... 72% 29.2M 1s 2024-03-08T20:31:43.770 INFO:tasks.workunit.client.1.smithi144.stderr: 98050K .......... .......... .......... .......... .......... 72% 53.1M 1s 2024-03-08T20:31:43.770 INFO:tasks.workunit.client.1.smithi144.stderr: 98100K .......... .......... .......... .......... .......... 72% 51.1M 1s 2024-03-08T20:31:43.774 INFO:tasks.workunit.client.1.smithi144.stderr: 98150K .......... .......... .......... .......... .......... 72% 30.8M 1s 2024-03-08T20:31:43.774 INFO:tasks.workunit.client.1.smithi144.stderr: 98200K .......... .......... .......... .......... .......... 72% 71.1M 1s 2024-03-08T20:31:43.774 INFO:tasks.workunit.client.1.smithi144.stderr: 98250K .......... .......... .......... .......... .......... 72% 50.5M 1s 2024-03-08T20:31:43.775 INFO:tasks.workunit.client.1.smithi144.stderr: 98300K .......... .......... .......... .......... .......... 72% 35.9M 1s 2024-03-08T20:31:43.777 INFO:tasks.workunit.client.1.smithi144.stderr: 98350K .......... .......... .......... .......... .......... 72% 30.0M 1s 2024-03-08T20:31:43.778 INFO:tasks.workunit.client.1.smithi144.stderr: 98400K .......... .......... .......... .......... .......... 72% 47.0M 1s 2024-03-08T20:31:43.779 INFO:tasks.workunit.client.1.smithi144.stderr: 98450K .......... .......... .......... .......... .......... 72% 27.5M 1s 2024-03-08T20:31:43.781 INFO:tasks.workunit.client.1.smithi144.stderr: 98500K .......... .......... .......... .......... .......... 72% 30.1M 1s 2024-03-08T20:31:43.783 INFO:tasks.workunit.client.1.smithi144.stderr: 98550K .......... .......... .......... .......... .......... 72% 26.8M 1s 2024-03-08T20:31:43.785 INFO:tasks.workunit.client.1.smithi144.stderr: 98600K .......... .......... .......... .......... .......... 72% 26.7M 1s 2024-03-08T20:31:43.786 INFO:tasks.workunit.client.1.smithi144.stderr: 98650K .......... .......... .......... .......... .......... 72% 34.9M 1s 2024-03-08T20:31:43.788 INFO:tasks.workunit.client.1.smithi144.stderr: 98700K .......... .......... .......... .......... .......... 72% 30.3M 1s 2024-03-08T20:31:43.790 INFO:tasks.workunit.client.1.smithi144.stderr: 98750K .......... .......... .......... .......... .......... 72% 22.5M 1s 2024-03-08T20:31:43.791 INFO:tasks.workunit.client.1.smithi144.stderr: 98800K .......... .......... .......... .......... .......... 72% 28.3M 1s 2024-03-08T20:31:43.793 INFO:tasks.workunit.client.1.smithi144.stderr: 98850K .......... .......... .......... .......... .......... 72% 38.9M 1s 2024-03-08T20:31:43.796 INFO:tasks.workunit.client.1.smithi144.stderr: 98900K .......... .......... .......... .......... .......... 72% 26.9M 1s 2024-03-08T20:31:43.797 INFO:tasks.workunit.client.1.smithi144.stderr: 98950K .......... .......... .......... .......... .......... 72% 35.3M 1s 2024-03-08T20:31:43.798 INFO:tasks.workunit.client.1.smithi144.stderr: 99000K .......... .......... .......... .......... .......... 72% 24.9M 1s 2024-03-08T20:31:43.801 INFO:tasks.workunit.client.1.smithi144.stderr: 99050K .......... .......... .......... .......... .......... 73% 26.4M 1s 2024-03-08T20:31:43.802 INFO:tasks.workunit.client.1.smithi144.stderr: 99100K .......... .......... .......... .......... .......... 73% 30.9M 1s 2024-03-08T20:31:43.803 INFO:tasks.workunit.client.1.smithi144.stderr: 99150K .......... .......... .......... .......... .......... 73% 36.6M 1s 2024-03-08T20:31:43.804 INFO:tasks.workunit.client.1.smithi144.stderr: 99200K .......... .......... .......... .......... .......... 73% 30.4M 1s 2024-03-08T20:31:43.807 INFO:tasks.workunit.client.1.smithi144.stderr: 99250K .......... .......... .......... .......... .......... 73% 26.6M 1s 2024-03-08T20:31:43.808 INFO:tasks.workunit.client.1.smithi144.stderr: 99300K .......... .......... .......... .......... .......... 73% 27.8M 1s 2024-03-08T20:31:43.809 INFO:tasks.workunit.client.1.smithi144.stderr: 99350K .......... .......... .......... .......... .......... 73% 32.0M 1s 2024-03-08T20:31:43.812 INFO:tasks.workunit.client.1.smithi144.stderr: 99400K .......... .......... .......... .......... .......... 73% 25.5M 1s 2024-03-08T20:31:43.814 INFO:tasks.workunit.client.1.smithi144.stderr: 99450K .......... .......... .......... .......... .......... 73% 26.9M 1s 2024-03-08T20:31:43.815 INFO:tasks.workunit.client.1.smithi144.stderr: 99500K .......... .......... .......... .......... .......... 73% 34.2M 1s 2024-03-08T20:31:43.818 INFO:tasks.workunit.client.1.smithi144.stderr: 99550K .......... .......... .......... .......... .......... 73% 22.5M 1s 2024-03-08T20:31:43.820 INFO:tasks.workunit.client.1.smithi144.stderr: 99600K .......... .......... .......... .......... .......... 73% 30.1M 1s 2024-03-08T20:31:43.820 INFO:tasks.workunit.client.1.smithi144.stderr: 99650K .......... .......... .......... .......... .......... 73% 38.8M 1s 2024-03-08T20:31:43.823 INFO:tasks.workunit.client.1.smithi144.stderr: 99700K .......... .......... .......... .......... .......... 73% 22.2M 1s 2024-03-08T20:31:43.823 INFO:tasks.workunit.client.1.smithi144.stderr: 99750K .......... .......... .......... .......... .......... 73% 38.4M 1s 2024-03-08T20:31:43.825 INFO:tasks.workunit.client.1.smithi144.stderr: 99800K .......... .......... .......... .......... .......... 73% 27.8M 1s 2024-03-08T20:31:43.827 INFO:tasks.workunit.client.1.smithi144.stderr: 99850K .......... .......... .......... .......... .......... 73% 26.2M 1s 2024-03-08T20:31:43.829 INFO:tasks.workunit.client.1.smithi144.stderr: 99900K .......... .......... .......... .......... .......... 73% 28.5M 1s 2024-03-08T20:31:43.830 INFO:tasks.workunit.client.1.smithi144.stderr: 99950K .......... .......... .......... .......... .......... 73% 30.4M 1s 2024-03-08T20:31:43.832 INFO:tasks.workunit.client.1.smithi144.stderr:100000K .......... .......... .......... .......... .......... 73% 33.1M 1s 2024-03-08T20:31:43.834 INFO:tasks.workunit.client.1.smithi144.stderr:100050K .......... .......... .......... .......... .......... 73% 26.9M 1s 2024-03-08T20:31:43.836 INFO:tasks.workunit.client.1.smithi144.stderr:100100K .......... .......... .......... .......... .......... 73% 23.3M 1s 2024-03-08T20:31:43.837 INFO:tasks.workunit.client.1.smithi144.stderr:100150K .......... .......... .......... .......... .......... 73% 40.9M 1s 2024-03-08T20:31:43.838 INFO:tasks.workunit.client.1.smithi144.stderr:100200K .......... .......... .......... .......... .......... 73% 29.1M 1s 2024-03-08T20:31:43.840 INFO:tasks.workunit.client.1.smithi144.stderr:100250K .......... .......... .......... .......... .......... 73% 23.3M 1s 2024-03-08T20:31:43.842 INFO:tasks.workunit.client.1.smithi144.stderr:100300K .......... .......... .......... .......... .......... 73% 34.9M 1s 2024-03-08T20:31:43.843 INFO:tasks.workunit.client.1.smithi144.stderr:100350K .......... .......... .......... .......... .......... 73% 30.1M 1s 2024-03-08T20:31:43.845 INFO:tasks.workunit.client.1.smithi144.stderr:100400K .......... .......... .......... .......... .......... 73% 27.5M 1s 2024-03-08T20:31:43.848 INFO:tasks.workunit.client.1.smithi144.stderr:100450K .......... .......... .......... .......... .......... 74% 24.0M 1s 2024-03-08T20:31:43.849 INFO:tasks.workunit.client.1.smithi144.stderr:100500K .......... .......... .......... .......... .......... 74% 35.8M 1s 2024-03-08T20:31:43.851 INFO:tasks.workunit.client.1.smithi144.stderr:100550K .......... .......... .......... .......... .......... 74% 22.5M 1s 2024-03-08T20:31:43.855 INFO:tasks.workunit.client.1.smithi144.stderr:100600K .......... .......... .......... .......... .......... 74% 23.6M 1s 2024-03-08T20:31:43.855 INFO:tasks.workunit.client.1.smithi144.stderr:100650K .......... .......... .......... .......... .......... 74% 45.5M 1s 2024-03-08T20:31:43.857 INFO:tasks.workunit.client.1.smithi144.stderr:100700K .......... .......... .......... .......... .......... 74% 28.5M 1s 2024-03-08T20:31:43.857 INFO:tasks.workunit.client.1.smithi144.stderr:100750K .......... .......... .......... .......... .......... 74% 41.0M 1s 2024-03-08T20:31:43.859 INFO:tasks.workunit.client.1.smithi144.stderr:100800K .......... .......... .......... .......... .......... 74% 24.6M 1s 2024-03-08T20:31:43.861 INFO:tasks.workunit.client.1.smithi144.stderr:100850K .......... .......... .......... .......... .......... 74% 24.3M 1s 2024-03-08T20:31:43.863 INFO:tasks.workunit.client.1.smithi144.stderr:100900K .......... .......... .......... .......... .......... 74% 32.8M 1s 2024-03-08T20:31:43.865 INFO:tasks.workunit.client.1.smithi144.stderr:100950K .......... .......... .......... .......... .......... 74% 26.7M 1s 2024-03-08T20:31:43.866 INFO:tasks.workunit.client.1.smithi144.stderr:101000K .......... .......... .......... .......... .......... 74% 37.2M 1s 2024-03-08T20:31:43.867 INFO:tasks.workunit.client.1.smithi144.stderr:101050K .......... .......... .......... .......... .......... 74% 31.3M 1s 2024-03-08T20:31:43.869 INFO:tasks.workunit.client.1.smithi144.stderr:101100K .......... .......... .......... .......... .......... 74% 27.1M 1s 2024-03-08T20:31:43.870 INFO:tasks.workunit.client.1.smithi144.stderr:101150K .......... .......... .......... .......... .......... 74% 28.4M 1s 2024-03-08T20:31:43.873 INFO:tasks.workunit.client.1.smithi144.stderr:101200K .......... .......... .......... .......... .......... 74% 27.3M 1s 2024-03-08T20:31:43.874 INFO:tasks.workunit.client.1.smithi144.stderr:101250K .......... .......... .......... .......... .......... 74% 30.0M 1s 2024-03-08T20:31:43.876 INFO:tasks.workunit.client.1.smithi144.stderr:101300K .......... .......... .......... .......... .......... 74% 29.7M 1s 2024-03-08T20:31:43.878 INFO:tasks.workunit.client.1.smithi144.stderr:101350K .......... .......... .......... .......... .......... 74% 26.0M 1s 2024-03-08T20:31:43.879 INFO:tasks.workunit.client.1.smithi144.stderr:101400K .......... .......... .......... .......... .......... 74% 32.5M 1s 2024-03-08T20:31:43.882 INFO:tasks.workunit.client.1.smithi144.stderr:101450K .......... .......... .......... .......... .......... 74% 22.4M 1s 2024-03-08T20:31:43.882 INFO:tasks.workunit.client.1.smithi144.stderr:101500K .......... .......... .......... .......... .......... 74% 45.0M 1s 2024-03-08T20:31:43.884 INFO:tasks.workunit.client.1.smithi144.stderr:101550K .......... .......... .......... .......... .......... 74% 25.5M 1s 2024-03-08T20:31:43.885 INFO:tasks.workunit.client.1.smithi144.stderr:101600K .......... .......... .......... .......... .......... 74% 33.9M 1s 2024-03-08T20:31:43.888 INFO:tasks.workunit.client.1.smithi144.stderr:101650K .......... .......... .......... .......... .......... 74% 22.7M 1s 2024-03-08T20:31:43.890 INFO:tasks.workunit.client.1.smithi144.stderr:101700K .......... .......... .......... .......... .......... 74% 29.1M 1s 2024-03-08T20:31:43.892 INFO:tasks.workunit.client.1.smithi144.stderr:101750K .......... .......... .......... .......... .......... 74% 39.4M 1s 2024-03-08T20:31:43.893 INFO:tasks.workunit.client.1.smithi144.stderr:101800K .......... .......... .......... .......... .......... 75% 24.6M 1s 2024-03-08T20:31:43.895 INFO:tasks.workunit.client.1.smithi144.stderr:101850K .......... .......... .......... .......... .......... 75% 23.1M 1s 2024-03-08T20:31:43.897 INFO:tasks.workunit.client.1.smithi144.stderr:101900K .......... .......... .......... .......... .......... 75% 21.0M 1s 2024-03-08T20:31:43.899 INFO:tasks.workunit.client.1.smithi144.stderr:101950K .......... .......... .......... .......... .......... 75% 29.1M 1s 2024-03-08T20:31:43.900 INFO:tasks.workunit.client.1.smithi144.stderr:102000K .......... .......... .......... .......... .......... 75% 38.0M 1s 2024-03-08T20:31:43.902 INFO:tasks.workunit.client.1.smithi144.stderr:102050K .......... .......... .......... .......... .......... 75% 24.1M 1s 2024-03-08T20:31:43.904 INFO:tasks.workunit.client.1.smithi144.stderr:102100K .......... .......... .......... .......... .......... 75% 30.0M 1s 2024-03-08T20:31:43.906 INFO:tasks.workunit.client.1.smithi144.stderr:102150K .......... .......... .......... .......... .......... 75% 25.5M 1s 2024-03-08T20:31:43.908 INFO:tasks.workunit.client.1.smithi144.stderr:102200K .......... .......... .......... .......... .......... 75% 28.4M 1s 2024-03-08T20:31:43.909 INFO:tasks.workunit.client.1.smithi144.stderr:102250K .......... .......... .......... .......... .......... 75% 39.2M 1s 2024-03-08T20:31:43.911 INFO:tasks.workunit.client.1.smithi144.stderr:102300K .......... .......... .......... .......... .......... 75% 23.9M 1s 2024-03-08T20:31:43.913 INFO:tasks.workunit.client.1.smithi144.stderr:102350K .......... .......... .......... .......... .......... 75% 30.9M 1s 2024-03-08T20:31:43.915 INFO:tasks.workunit.client.1.smithi144.stderr:102400K .......... .......... .......... .......... .......... 75% 26.0M 1s 2024-03-08T20:31:43.916 INFO:tasks.workunit.client.1.smithi144.stderr:102450K .......... .......... .......... .......... .......... 75% 28.3M 1s 2024-03-08T20:31:43.917 INFO:tasks.workunit.client.1.smithi144.stderr:102500K .......... .......... .......... .......... .......... 75% 40.1M 1s 2024-03-08T20:31:43.919 INFO:tasks.workunit.client.1.smithi144.stderr:102550K .......... .......... .......... .......... .......... 75% 27.0M 1s 2024-03-08T20:31:43.921 INFO:tasks.workunit.client.1.smithi144.stderr:102600K .......... .......... .......... .......... .......... 75% 28.5M 1s 2024-03-08T20:31:43.923 INFO:tasks.workunit.client.1.smithi144.stderr:102650K .......... .......... .......... .......... .......... 75% 24.8M 1s 2024-03-08T20:31:43.925 INFO:tasks.workunit.client.1.smithi144.stderr:102700K .......... .......... .......... .......... .......... 75% 27.3M 1s 2024-03-08T20:31:43.926 INFO:tasks.workunit.client.1.smithi144.stderr:102750K .......... .......... .......... .......... .......... 75% 40.9M 1s 2024-03-08T20:31:43.927 INFO:tasks.workunit.client.1.smithi144.stderr:102800K .......... .......... .......... .......... .......... 75% 28.6M 1s 2024-03-08T20:31:43.930 INFO:tasks.workunit.client.1.smithi144.stderr:102850K .......... .......... .......... .......... .......... 75% 25.5M 1s 2024-03-08T20:31:43.932 INFO:tasks.workunit.client.1.smithi144.stderr:102900K .......... .......... .......... .......... .......... 75% 27.9M 1s 2024-03-08T20:31:43.933 INFO:tasks.workunit.client.1.smithi144.stderr:102950K .......... .......... .......... .......... .......... 75% 26.8M 1s 2024-03-08T20:31:43.935 INFO:tasks.workunit.client.1.smithi144.stderr:103000K .......... .......... .......... .......... .......... 75% 34.9M 1s 2024-03-08T20:31:43.936 INFO:tasks.workunit.client.1.smithi144.stderr:103050K .......... .......... .......... .......... .......... 75% 28.4M 1s 2024-03-08T20:31:43.938 INFO:tasks.workunit.client.1.smithi144.stderr:103100K .......... .......... .......... .......... .......... 75% 28.1M 1s 2024-03-08T20:31:43.939 INFO:tasks.workunit.client.1.smithi144.stderr:103150K .......... .......... .......... .......... .......... 76% 26.0M 1s 2024-03-08T20:31:43.941 INFO:tasks.workunit.client.1.smithi144.stderr:103200K .......... .......... .......... .......... .......... 76% 28.5M 1s 2024-03-08T20:31:43.942 INFO:tasks.workunit.client.1.smithi144.stderr:103250K .......... .......... .......... .......... .......... 76% 49.9M 1s 2024-03-08T20:31:43.944 INFO:tasks.workunit.client.1.smithi144.stderr:103300K .......... .......... .......... .......... .......... 76% 24.1M 1s 2024-03-08T20:31:43.946 INFO:tasks.workunit.client.1.smithi144.stderr:103350K .......... .......... .......... .......... .......... 76% 32.7M 1s 2024-03-08T20:31:43.948 INFO:tasks.workunit.client.1.smithi144.stderr:103400K .......... .......... .......... .......... .......... 76% 25.6M 1s 2024-03-08T20:31:43.951 INFO:tasks.workunit.client.1.smithi144.stderr:103450K .......... .......... .......... .......... .......... 76% 24.6M 1s 2024-03-08T20:31:43.951 INFO:tasks.workunit.client.1.smithi144.stderr:103500K .......... .......... .......... .......... .......... 76% 39.1M 1s 2024-03-08T20:31:43.953 INFO:tasks.workunit.client.1.smithi144.stderr:103550K .......... .......... .......... .......... .......... 76% 27.6M 1s 2024-03-08T20:31:43.955 INFO:tasks.workunit.client.1.smithi144.stderr:103600K .......... .......... .......... .......... .......... 76% 22.7M 1s 2024-03-08T20:31:43.957 INFO:tasks.workunit.client.1.smithi144.stderr:103650K .......... .......... .......... .......... .......... 76% 34.0M 1s 2024-03-08T20:31:43.959 INFO:tasks.workunit.client.1.smithi144.stderr:103700K .......... .......... .......... .......... .......... 76% 24.8M 1s 2024-03-08T20:31:43.960 INFO:tasks.workunit.client.1.smithi144.stderr:103750K .......... .......... .......... .......... .......... 76% 55.0M 1s 2024-03-08T20:31:43.961 INFO:tasks.workunit.client.1.smithi144.stderr:103800K .......... .......... .......... .......... .......... 76% 19.2M 1s 2024-03-08T20:31:43.963 INFO:tasks.workunit.client.1.smithi144.stderr:103850K .......... .......... .......... .......... .......... 76% 32.6M 1s 2024-03-08T20:31:43.966 INFO:tasks.workunit.client.1.smithi144.stderr:103900K .......... .......... .......... .......... .......... 76% 29.6M 1s 2024-03-08T20:31:43.967 INFO:tasks.workunit.client.1.smithi144.stderr:103950K .......... .......... .......... .......... .......... 76% 25.9M 1s 2024-03-08T20:31:43.969 INFO:tasks.workunit.client.1.smithi144.stderr:104000K .......... .......... .......... .......... .......... 76% 43.5M 1s 2024-03-08T20:31:43.970 INFO:tasks.workunit.client.1.smithi144.stderr:104050K .......... .......... .......... .......... .......... 76% 27.3M 1s 2024-03-08T20:31:43.972 INFO:tasks.workunit.client.1.smithi144.stderr:104100K .......... .......... .......... .......... .......... 76% 24.9M 1s 2024-03-08T20:31:43.973 INFO:tasks.workunit.client.1.smithi144.stderr:104150K .......... .......... .......... .......... .......... 76% 31.9M 1s 2024-03-08T20:31:43.975 INFO:tasks.workunit.client.1.smithi144.stderr:104200K .......... .......... .......... .......... .......... 76% 25.7M 1s 2024-03-08T20:31:43.978 INFO:tasks.workunit.client.1.smithi144.stderr:104250K .......... .......... .......... .......... .......... 76% 62.3M 1s 2024-03-08T20:31:43.978 INFO:tasks.workunit.client.1.smithi144.stderr:104300K .......... .......... .......... .......... .......... 76% 26.2M 1s 2024-03-08T20:31:43.980 INFO:tasks.workunit.client.1.smithi144.stderr:104350K .......... .......... .......... .......... .......... 76% 23.3M 1s 2024-03-08T20:31:43.982 INFO:tasks.workunit.client.1.smithi144.stderr:104400K .......... .......... .......... .......... .......... 76% 29.5M 1s 2024-03-08T20:31:43.984 INFO:tasks.workunit.client.1.smithi144.stderr:104450K .......... .......... .......... .......... .......... 76% 22.0M 1s 2024-03-08T20:31:43.985 INFO:tasks.workunit.client.1.smithi144.stderr:104500K .......... .......... .......... .......... .......... 77% 29.3M 1s 2024-03-08T20:31:43.986 INFO:tasks.workunit.client.1.smithi144.stderr:104550K .......... .......... .......... .......... .......... 77% 38.2M 1s 2024-03-08T20:31:43.988 INFO:tasks.workunit.client.1.smithi144.stderr:104600K .......... .......... .......... .......... .......... 77% 27.1M 1s 2024-03-08T20:31:43.991 INFO:tasks.workunit.client.1.smithi144.stderr:104650K .......... .......... .......... .......... .......... 77% 32.1M 1s 2024-03-08T20:31:43.993 INFO:tasks.workunit.client.1.smithi144.stderr:104700K .......... .......... .......... .......... .......... 77% 23.3M 1s 2024-03-08T20:31:43.995 INFO:tasks.workunit.client.1.smithi144.stderr:104750K .......... .......... .......... .......... .......... 77% 27.8M 1s 2024-03-08T20:31:43.995 INFO:tasks.workunit.client.1.smithi144.stderr:104800K .......... .......... .......... .......... .......... 77% 51.6M 1s 2024-03-08T20:31:43.997 INFO:tasks.workunit.client.1.smithi144.stderr:104850K .......... .......... .......... .......... .......... 77% 27.1M 1s 2024-03-08T20:31:43.999 INFO:tasks.workunit.client.1.smithi144.stderr:104900K .......... .......... .......... .......... .......... 77% 26.6M 1s 2024-03-08T20:31:44.001 INFO:tasks.workunit.client.1.smithi144.stderr:104950K .......... .......... .......... .......... .......... 77% 26.1M 1s 2024-03-08T20:31:44.002 INFO:tasks.workunit.client.1.smithi144.stderr:105000K .......... .......... .......... .......... .......... 77% 25.8M 1s 2024-03-08T20:31:44.004 INFO:tasks.workunit.client.1.smithi144.stderr:105050K .......... .......... .......... .......... .......... 77% 30.0M 1s 2024-03-08T20:31:44.005 INFO:tasks.workunit.client.1.smithi144.stderr:105100K .......... .......... .......... .......... .......... 77% 34.6M 1s 2024-03-08T20:31:44.007 INFO:tasks.workunit.client.1.smithi144.stderr:105150K .......... .......... .......... .......... .......... 77% 31.7M 1s 2024-03-08T20:31:44.009 INFO:tasks.workunit.client.1.smithi144.stderr:105200K .......... .......... .......... .......... .......... 77% 25.0M 1s 2024-03-08T20:31:44.011 INFO:tasks.workunit.client.1.smithi144.stderr:105250K .......... .......... .......... .......... .......... 77% 28.5M 1s 2024-03-08T20:31:44.011 INFO:tasks.workunit.client.1.smithi144.stderr:105300K .......... .......... .......... .......... .......... 77% 35.4M 1s 2024-03-08T20:31:44.014 INFO:tasks.workunit.client.1.smithi144.stderr:105350K .......... .......... .......... .......... .......... 77% 25.6M 1s 2024-03-08T20:31:44.015 INFO:tasks.workunit.client.1.smithi144.stderr:105400K .......... .......... .......... .......... .......... 77% 32.6M 1s 2024-03-08T20:31:44.017 INFO:tasks.workunit.client.1.smithi144.stderr:105450K .......... .......... .......... .......... .......... 77% 24.5M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105500K .......... .......... .......... .......... .......... 77% 26.8M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105550K .......... .......... .......... .......... .......... 77% 35.1M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105600K .......... .......... .......... .......... .......... 77% 30.6M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105650K .......... .......... .......... .......... .......... 77% 32.0M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105700K .......... .......... .......... .......... .......... 77% 25.8M 1s 2024-03-08T20:31:44.035 INFO:tasks.workunit.client.1.smithi144.stderr:105750K .......... .......... .......... .......... .......... 77% 25.4M 1s 2024-03-08T20:31:44.036 INFO:tasks.workunit.client.1.smithi144.stderr:105800K .......... .......... .......... .......... .......... 77% 34.9M 1s 2024-03-08T20:31:44.036 INFO:tasks.workunit.client.1.smithi144.stderr:105850K .......... .......... .......... .......... .......... 78% 25.1M 1s 2024-03-08T20:31:44.036 INFO:tasks.workunit.client.1.smithi144.stderr:105900K .......... .......... .......... .......... .......... 78% 32.1M 1s 2024-03-08T20:31:44.036 INFO:tasks.workunit.client.1.smithi144.stderr:105950K .......... .......... .......... .......... .......... 78% 27.4M 1s 2024-03-08T20:31:44.036 INFO:tasks.workunit.client.1.smithi144.stderr:106000K .......... .......... .......... .......... .......... 78% 43.2M 1s 2024-03-08T20:31:44.041 INFO:tasks.workunit.client.1.smithi144.stderr:106050K .......... .......... .......... .......... .......... 78% 28.8M 1s 2024-03-08T20:31:44.041 INFO:tasks.workunit.client.1.smithi144.stderr:106100K .......... .......... .......... .......... .......... 78% 25.4M 1s 2024-03-08T20:31:44.041 INFO:tasks.workunit.client.1.smithi144.stderr:106150K .......... .......... .......... .......... .......... 78% 30.0M 1s 2024-03-08T20:31:44.043 INFO:tasks.workunit.client.1.smithi144.stderr:106200K .......... .......... .......... .......... .......... 78% 24.9M 1s 2024-03-08T20:31:44.043 INFO:tasks.workunit.client.1.smithi144.stderr:106250K .......... .......... .......... .......... .......... 78% 45.7M 1s 2024-03-08T20:31:44.045 INFO:tasks.workunit.client.1.smithi144.stderr:106300K .......... .......... .......... .......... .......... 78% 25.3M 1s 2024-03-08T20:31:44.047 INFO:tasks.workunit.client.1.smithi144.stderr:106350K .......... .......... .......... .......... .......... 78% 26.4M 1s 2024-03-08T20:31:44.048 INFO:tasks.workunit.client.1.smithi144.stderr:106400K .......... .......... .......... .......... .......... 78% 31.9M 1s 2024-03-08T20:31:44.052 INFO:tasks.workunit.client.1.smithi144.stderr:106450K .......... .......... .......... .......... .......... 78% 23.4M 1s 2024-03-08T20:31:44.052 INFO:tasks.workunit.client.1.smithi144.stderr:106500K .......... .......... .......... .......... .......... 78% 41.9M 1s 2024-03-08T20:31:44.054 INFO:tasks.workunit.client.1.smithi144.stderr:106550K .......... .......... .......... .......... .......... 78% 27.1M 1s 2024-03-08T20:31:44.056 INFO:tasks.workunit.client.1.smithi144.stderr:106600K .......... .......... .......... .......... .......... 78% 27.8M 1s 2024-03-08T20:31:44.057 INFO:tasks.workunit.client.1.smithi144.stderr:106650K .......... .......... .......... .......... .......... 78% 26.1M 1s 2024-03-08T20:31:44.059 INFO:tasks.workunit.client.1.smithi144.stderr:106700K .......... .......... .......... .......... .......... 78% 28.2M 1s 2024-03-08T20:31:44.060 INFO:tasks.workunit.client.1.smithi144.stderr:106750K .......... .......... .......... .......... .......... 78% 37.9M 1s 2024-03-08T20:31:44.062 INFO:tasks.workunit.client.1.smithi144.stderr:106800K .......... .......... .......... .......... .......... 78% 29.5M 1s 2024-03-08T20:31:44.064 INFO:tasks.workunit.client.1.smithi144.stderr:106850K .......... .......... .......... .......... .......... 78% 28.7M 1s 2024-03-08T20:31:44.065 INFO:tasks.workunit.client.1.smithi144.stderr:106900K .......... .......... .......... .......... .......... 78% 30.5M 1s 2024-03-08T20:31:44.066 INFO:tasks.workunit.client.1.smithi144.stderr:106950K .......... .......... .......... .......... .......... 78% 33.2M 1s 2024-03-08T20:31:44.071 INFO:tasks.workunit.client.1.smithi144.stderr:107000K .......... .......... .......... .......... .......... 78% 20.9M 1s 2024-03-08T20:31:44.071 INFO:tasks.workunit.client.1.smithi144.stderr:107050K .......... .......... .......... .......... .......... 78% 40.8M 1s 2024-03-08T20:31:44.072 INFO:tasks.workunit.client.1.smithi144.stderr:107100K .......... .......... .......... .......... .......... 78% 27.1M 1s 2024-03-08T20:31:44.075 INFO:tasks.workunit.client.1.smithi144.stderr:107150K .......... .......... .......... .......... .......... 78% 18.1M 1s 2024-03-08T20:31:44.077 INFO:tasks.workunit.client.1.smithi144.stderr:107200K .......... .......... .......... .......... .......... 79% 34.3M 1s 2024-03-08T20:31:44.077 INFO:tasks.workunit.client.1.smithi144.stderr:107250K .......... .......... .......... .......... .......... 79% 54.7M 1s 2024-03-08T20:31:44.078 INFO:tasks.workunit.client.0.smithi118.stdout:checking for ANSI C header files... yes 2024-03-08T20:31:44.079 INFO:tasks.workunit.client.1.smithi144.stderr:107300K .......... .......... .......... .......... .......... 79% 24.7M 1s 2024-03-08T20:31:44.088 INFO:tasks.workunit.client.1.smithi144.stderr:107350K .......... .......... .......... .......... .......... 79% 8.79M 1s 2024-03-08T20:31:44.088 INFO:tasks.workunit.client.1.smithi144.stderr:107400K .......... .......... .......... .......... .......... 79% 38.4M 1s 2024-03-08T20:31:44.088 INFO:tasks.workunit.client.1.smithi144.stderr:107450K .......... .......... .......... .......... .......... 79% 75.0M 1s 2024-03-08T20:31:44.088 INFO:tasks.workunit.client.1.smithi144.stderr:107500K .......... .......... .......... .......... .......... 79% 68.4M 1s 2024-03-08T20:31:44.088 INFO:tasks.workunit.client.1.smithi144.stderr:107550K .......... .......... .......... .......... .......... 79% 75.8M 1s 2024-03-08T20:31:44.090 INFO:tasks.workunit.client.1.smithi144.stderr:107600K .......... .......... .......... .......... .......... 79% 28.4M 1s 2024-03-08T20:31:44.092 INFO:tasks.workunit.client.1.smithi144.stderr:107650K .......... .......... .......... .......... .......... 79% 24.0M 1s 2024-03-08T20:31:44.094 INFO:tasks.workunit.client.1.smithi144.stderr:107700K .......... .......... .......... .......... .......... 79% 28.3M 1s 2024-03-08T20:31:44.096 INFO:tasks.workunit.client.1.smithi144.stderr:107750K .......... .......... .......... .......... .......... 79% 27.1M 1s 2024-03-08T20:31:44.096 INFO:tasks.workunit.client.1.smithi144.stderr:107800K .......... .......... .......... .......... .......... 79% 44.4M 1s 2024-03-08T20:31:44.098 INFO:tasks.workunit.client.1.smithi144.stderr:107850K .......... .......... .......... .......... .......... 79% 24.4M 1s 2024-03-08T20:31:44.099 INFO:tasks.workunit.client.1.smithi144.stderr:107900K .......... .......... .......... .......... .......... 79% 31.8M 1s 2024-03-08T20:31:44.101 INFO:tasks.workunit.client.1.smithi144.stderr:107950K .......... .......... .......... .......... .......... 79% 32.0M 1s 2024-03-08T20:31:44.103 INFO:tasks.workunit.client.1.smithi144.stderr:108000K .......... .......... .......... .......... .......... 79% 28.5M 1s 2024-03-08T20:31:44.104 INFO:tasks.workunit.client.1.smithi144.stderr:108050K .......... .......... .......... .......... .......... 79% 30.0M 1s 2024-03-08T20:31:44.107 INFO:tasks.workunit.client.1.smithi144.stderr:108100K .......... .......... .......... .......... .......... 79% 23.2M 1s 2024-03-08T20:31:44.108 INFO:tasks.workunit.client.1.smithi144.stderr:108150K .......... .......... .......... .......... .......... 79% 34.6M 1s 2024-03-08T20:31:44.110 INFO:tasks.workunit.client.1.smithi144.stderr:108200K .......... .......... .......... .......... .......... 79% 28.0M 1s 2024-03-08T20:31:44.112 INFO:tasks.workunit.client.1.smithi144.stderr:108250K .......... .......... .......... .......... .......... 79% 25.5M 1s 2024-03-08T20:31:44.113 INFO:tasks.workunit.client.1.smithi144.stderr:108300K .......... .......... .......... .......... .......... 79% 40.1M 1s 2024-03-08T20:31:44.115 INFO:tasks.workunit.client.1.smithi144.stderr:108350K .......... .......... .......... .......... .......... 79% 22.9M 1s 2024-03-08T20:31:44.117 INFO:tasks.workunit.client.1.smithi144.stderr:108400K .......... .......... .......... .......... .......... 79% 27.9M 1s 2024-03-08T20:31:44.118 INFO:tasks.workunit.client.1.smithi144.stderr:108450K .......... .......... .......... .......... .......... 79% 43.1M 1s 2024-03-08T20:31:44.120 INFO:tasks.workunit.client.1.smithi144.stderr:108500K .......... .......... .......... .......... .......... 79% 25.1M 1s 2024-03-08T20:31:44.122 INFO:tasks.workunit.client.1.smithi144.stderr:108550K .......... .......... .......... .......... .......... 79% 27.0M 1s 2024-03-08T20:31:44.124 INFO:tasks.workunit.client.1.smithi144.stderr:108600K .......... .......... .......... .......... .......... 80% 30.3M 1s 2024-03-08T20:31:44.126 INFO:tasks.workunit.client.1.smithi144.stderr:108650K .......... .......... .......... .......... .......... 80% 23.4M 1s 2024-03-08T20:31:44.128 INFO:tasks.workunit.client.1.smithi144.stderr:108700K .......... .......... .......... .......... .......... 80% 36.7M 1s 2024-03-08T20:31:44.129 INFO:tasks.workunit.client.1.smithi144.stderr:108750K .......... .......... .......... .......... .......... 80% 25.5M 1s 2024-03-08T20:31:44.132 INFO:tasks.workunit.client.1.smithi144.stderr:108800K .......... .......... .......... .......... .......... 80% 36.6M 1s 2024-03-08T20:31:44.132 INFO:tasks.workunit.client.1.smithi144.stderr:108850K .......... .......... .......... .......... .......... 80% 26.4M 1s 2024-03-08T20:31:44.134 INFO:tasks.workunit.client.1.smithi144.stderr:108900K .......... .......... .......... .......... .......... 80% 27.5M 1s 2024-03-08T20:31:44.136 INFO:tasks.workunit.client.1.smithi144.stderr:108950K .......... .......... .......... .......... .......... 80% 31.4M 1s 2024-03-08T20:31:44.139 INFO:tasks.workunit.client.1.smithi144.stderr:109000K .......... .......... .......... .......... .......... 80% 24.0M 1s 2024-03-08T20:31:44.139 INFO:tasks.workunit.client.1.smithi144.stderr:109050K .......... .......... .......... .......... .......... 80% 52.0M 1s 2024-03-08T20:31:44.140 INFO:tasks.workunit.client.1.smithi144.stderr:109100K .......... .......... .......... .......... .......... 80% 25.3M 1s 2024-03-08T20:31:44.142 INFO:tasks.workunit.client.1.smithi144.stderr:109150K .......... .......... .......... .......... .......... 80% 24.1M 1s 2024-03-08T20:31:44.143 INFO:tasks.workunit.client.1.smithi144.stderr:109200K .......... .......... .......... .......... .......... 80% 39.0M 1s 2024-03-08T20:31:44.147 INFO:tasks.workunit.client.1.smithi144.stderr:109250K .......... .......... .......... .......... .......... 80% 22.3M 1s 2024-03-08T20:31:44.148 INFO:tasks.workunit.client.1.smithi144.stderr:109300K .......... .......... .......... .......... .......... 80% 51.0M 1s 2024-03-08T20:31:44.149 INFO:tasks.workunit.client.1.smithi144.stderr:109350K .......... .......... .......... .......... .......... 80% 21.4M 1s 2024-03-08T20:31:44.151 INFO:tasks.workunit.client.1.smithi144.stderr:109400K .......... .......... .......... .......... .......... 80% 31.7M 1s 2024-03-08T20:31:44.153 INFO:tasks.workunit.client.1.smithi144.stderr:109450K .......... .......... .......... .......... .......... 80% 26.7M 1s 2024-03-08T20:31:44.155 INFO:tasks.workunit.client.1.smithi144.stderr:109500K .......... .......... .......... .......... .......... 80% 24.6M 1s 2024-03-08T20:31:44.157 INFO:tasks.workunit.client.1.smithi144.stderr:109550K .......... .......... .......... .......... .......... 80% 55.8M 1s 2024-03-08T20:31:44.157 INFO:tasks.workunit.client.1.smithi144.stderr:109600K .......... .......... .......... .......... .......... 80% 27.3M 1s 2024-03-08T20:31:44.159 INFO:tasks.workunit.client.1.smithi144.stderr:109650K .......... .......... .......... .......... .......... 80% 23.2M 1s 2024-03-08T20:31:44.161 INFO:tasks.workunit.client.1.smithi144.stderr:109700K .......... .......... .......... .......... .......... 80% 29.0M 1s 2024-03-08T20:31:44.163 INFO:tasks.workunit.client.1.smithi144.stderr:109750K .......... .......... .......... .......... .......... 80% 27.3M 1s 2024-03-08T20:31:44.165 INFO:tasks.workunit.client.1.smithi144.stderr:109800K .......... .......... .......... .......... .......... 80% 26.9M 1s 2024-03-08T20:31:44.165 INFO:tasks.workunit.client.1.smithi144.stderr:109850K .......... .......... .......... .......... .......... 80% 45.4M 1s 2024-03-08T20:31:44.168 INFO:tasks.workunit.client.1.smithi144.stderr:109900K .......... .......... .......... .......... .......... 80% 23.2M 1s 2024-03-08T20:31:44.169 INFO:tasks.workunit.client.1.smithi144.stderr:109950K .......... .......... .......... .......... .......... 81% 33.8M 1s 2024-03-08T20:31:44.171 INFO:tasks.workunit.client.1.smithi144.stderr:110000K .......... .......... .......... .......... .......... 81% 26.2M 1s 2024-03-08T20:31:44.174 INFO:tasks.workunit.client.1.smithi144.stderr:110050K .......... .......... .......... .......... .......... 81% 25.0M 1s 2024-03-08T20:31:44.174 INFO:tasks.workunit.client.1.smithi144.stderr:110100K .......... .......... .......... .......... .......... 81% 39.3M 1s 2024-03-08T20:31:44.176 INFO:tasks.workunit.client.1.smithi144.stderr:110150K .......... .......... .......... .......... .......... 81% 26.5M 1s 2024-03-08T20:31:44.178 INFO:tasks.workunit.client.1.smithi144.stderr:110200K .......... .......... .......... .......... .......... 81% 30.2M 1s 2024-03-08T20:31:44.179 INFO:tasks.workunit.client.1.smithi144.stderr:110250K .......... .......... .......... .......... .......... 81% 28.4M 1s 2024-03-08T20:31:44.182 INFO:tasks.workunit.client.1.smithi144.stderr:110300K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-03-08T20:31:44.182 INFO:tasks.workunit.client.1.smithi144.stderr:110350K .......... .......... .......... .......... .......... 81% 46.1M 1s 2024-03-08T20:31:44.184 INFO:tasks.workunit.client.1.smithi144.stderr:110400K .......... .......... .......... .......... .......... 81% 23.9M 1s 2024-03-08T20:31:44.186 INFO:tasks.workunit.client.1.smithi144.stderr:110450K .......... .......... .......... .......... .......... 81% 30.9M 1s 2024-03-08T20:31:44.188 INFO:tasks.workunit.client.1.smithi144.stderr:110500K .......... .......... .......... .......... .......... 81% 27.0M 1s 2024-03-08T20:31:44.190 INFO:tasks.workunit.client.1.smithi144.stderr:110550K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-03-08T20:31:44.191 INFO:tasks.workunit.client.1.smithi144.stderr:110600K .......... .......... .......... .......... .......... 81% 42.9M 1s 2024-03-08T20:31:44.193 INFO:tasks.workunit.client.1.smithi144.stderr:110650K .......... .......... .......... .......... .......... 81% 28.4M 1s 2024-03-08T20:31:44.195 INFO:tasks.workunit.client.1.smithi144.stderr:110700K .......... .......... .......... .......... .......... 81% 29.1M 1s 2024-03-08T20:31:44.196 INFO:tasks.workunit.client.1.smithi144.stderr:110750K .......... .......... .......... .......... .......... 81% 26.6M 1s 2024-03-08T20:31:44.198 INFO:tasks.workunit.client.1.smithi144.stderr:110800K .......... .......... .......... .......... .......... 81% 26.0M 1s 2024-03-08T20:31:44.200 INFO:tasks.workunit.client.1.smithi144.stderr:110850K .......... .......... .......... .......... .......... 81% 34.9M 1s 2024-03-08T20:31:44.201 INFO:tasks.workunit.client.1.smithi144.stderr:110900K .......... .......... .......... .......... .......... 81% 32.6M 1s 2024-03-08T20:31:44.203 INFO:tasks.workunit.client.1.smithi144.stderr:110950K .......... .......... .......... .......... .......... 81% 27.8M 1s 2024-03-08T20:31:44.205 INFO:tasks.workunit.client.1.smithi144.stderr:111000K .......... .......... .......... .......... .......... 81% 25.8M 1s 2024-03-08T20:31:44.207 INFO:tasks.workunit.client.1.smithi144.stderr:111050K .......... .......... .......... .......... .......... 81% 26.9M 1s 2024-03-08T20:31:44.207 INFO:tasks.workunit.client.1.smithi144.stderr:111100K .......... .......... .......... .......... .......... 81% 50.3M 1s 2024-03-08T20:31:44.209 INFO:tasks.workunit.client.1.smithi144.stderr:111150K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-03-08T20:31:44.211 INFO:tasks.workunit.client.1.smithi144.stderr:111200K .......... .......... .......... .......... .......... 81% 30.2M 1s 2024-03-08T20:31:44.213 INFO:tasks.workunit.client.1.smithi144.stderr:111250K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-03-08T20:31:44.216 INFO:tasks.workunit.client.1.smithi144.stderr:111300K .......... .......... .......... .......... .......... 82% 27.6M 1s 2024-03-08T20:31:44.216 INFO:tasks.workunit.client.1.smithi144.stderr:111350K .......... .......... .......... .......... .......... 82% 48.6M 1s 2024-03-08T20:31:44.218 INFO:tasks.workunit.client.1.smithi144.stderr:111400K .......... .......... .......... .......... .......... 82% 24.9M 1s 2024-03-08T20:31:44.220 INFO:tasks.workunit.client.1.smithi144.stderr:111450K .......... .......... .......... .......... .......... 82% 22.3M 1s 2024-03-08T20:31:44.221 INFO:tasks.workunit.client.1.smithi144.stderr:111500K .......... .......... .......... .......... .......... 82% 35.2M 1s 2024-03-08T20:31:44.222 INFO:tasks.workunit.client.1.smithi144.stderr:111550K .......... .......... .......... .......... .......... 82% 38.4M 1s 2024-03-08T20:31:44.224 INFO:tasks.workunit.client.1.smithi144.stderr:111600K .......... .......... .......... .......... .......... 82% 28.0M 1s 2024-03-08T20:31:44.226 INFO:tasks.workunit.client.1.smithi144.stderr:111650K .......... .......... .......... .......... .......... 82% 23.0M 1s 2024-03-08T20:31:44.228 INFO:tasks.workunit.client.1.smithi144.stderr:111700K .......... .......... .......... .......... .......... 82% 30.7M 1s 2024-03-08T20:31:44.231 INFO:tasks.workunit.client.1.smithi144.stderr:111750K .......... .......... .......... .......... .......... 82% 23.4M 1s 2024-03-08T20:31:44.232 INFO:tasks.workunit.client.1.smithi144.stderr:111800K .......... .......... .......... .......... .......... 82% 31.3M 1s 2024-03-08T20:31:44.232 INFO:tasks.workunit.client.1.smithi144.stderr:111850K .......... .......... .......... .......... .......... 82% 58.1M 1s 2024-03-08T20:31:44.234 INFO:tasks.workunit.client.1.smithi144.stderr:111900K .......... .......... .......... .......... .......... 82% 30.5M 1s 2024-03-08T20:31:44.236 INFO:tasks.workunit.client.1.smithi144.stderr:111950K .......... .......... .......... .......... .......... 82% 26.5M 1s 2024-03-08T20:31:44.239 INFO:tasks.workunit.client.1.smithi144.stderr:112000K .......... .......... .......... .......... .......... 82% 21.5M 1s 2024-03-08T20:31:44.240 INFO:tasks.workunit.client.1.smithi144.stderr:112050K .......... .......... .......... .......... .......... 82% 27.7M 1s 2024-03-08T20:31:44.241 INFO:tasks.workunit.client.1.smithi144.stderr:112100K .......... .......... .......... .......... .......... 82% 58.5M 1s 2024-03-08T20:31:44.243 INFO:tasks.workunit.client.1.smithi144.stderr:112150K .......... .......... .......... .......... .......... 82% 20.4M 1s 2024-03-08T20:31:44.244 INFO:tasks.workunit.client.1.smithi144.stderr:112200K .......... .......... .......... .......... .......... 82% 29.5M 1s 2024-03-08T20:31:44.247 INFO:tasks.workunit.client.1.smithi144.stderr:112250K .......... .......... .......... .......... .......... 82% 24.5M 1s 2024-03-08T20:31:44.249 INFO:tasks.workunit.client.1.smithi144.stderr:112300K .......... .......... .......... .......... .......... 82% 27.2M 1s 2024-03-08T20:31:44.250 INFO:tasks.workunit.client.1.smithi144.stderr:112350K .......... .......... .......... .......... .......... 82% 53.3M 1s 2024-03-08T20:31:44.252 INFO:tasks.workunit.client.1.smithi144.stderr:112400K .......... .......... .......... .......... .......... 82% 22.4M 1s 2024-03-08T20:31:44.254 INFO:tasks.workunit.client.1.smithi144.stderr:112450K .......... .......... .......... .......... .......... 82% 26.3M 1s 2024-03-08T20:31:44.255 INFO:tasks.workunit.client.1.smithi144.stderr:112500K .......... .......... .......... .......... .......... 82% 32.1M 1s 2024-03-08T20:31:44.258 INFO:tasks.workunit.client.1.smithi144.stderr:112550K .......... .......... .......... .......... .......... 82% 24.4M 1s 2024-03-08T20:31:44.258 INFO:tasks.workunit.client.1.smithi144.stderr:112600K .......... .......... .......... .......... .......... 82% 49.6M 1s 2024-03-08T20:31:44.260 INFO:tasks.workunit.client.1.smithi144.stderr:112650K .......... .......... .......... .......... .......... 83% 25.4M 1s 2024-03-08T20:31:44.262 INFO:tasks.workunit.client.1.smithi144.stderr:112700K .......... .......... .......... .......... .......... 83% 28.2M 1s 2024-03-08T20:31:44.264 INFO:tasks.workunit.client.1.smithi144.stderr:112750K .......... .......... .......... .......... .......... 83% 25.1M 1s 2024-03-08T20:31:44.266 INFO:tasks.workunit.client.1.smithi144.stderr:112800K .......... .......... .......... .......... .......... 83% 28.6M 1s 2024-03-08T20:31:44.266 INFO:tasks.workunit.client.1.smithi144.stderr:112850K .......... .......... .......... .......... .......... 83% 47.4M 1s 2024-03-08T20:31:44.269 INFO:tasks.workunit.client.1.smithi144.stderr:112900K .......... .......... .......... .......... .......... 83% 17.5M 1s 2024-03-08T20:31:44.271 INFO:tasks.workunit.client.1.smithi144.stderr:112950K .......... .......... .......... .......... .......... 83% 38.4M 1s 2024-03-08T20:31:44.272 INFO:tasks.workunit.client.1.smithi144.stderr:113000K .......... .......... .......... .......... .......... 83% 23.7M 1s 2024-03-08T20:31:44.275 INFO:tasks.workunit.client.1.smithi144.stderr:113050K .......... .......... .......... .......... .......... 83% 27.0M 1s 2024-03-08T20:31:44.275 INFO:tasks.workunit.client.1.smithi144.stderr:113100K .......... .......... .......... .......... .......... 83% 51.4M 1s 2024-03-08T20:31:44.278 INFO:tasks.workunit.client.1.smithi144.stderr:113150K .......... .......... .......... .......... .......... 83% 19.0M 1s 2024-03-08T20:31:44.280 INFO:tasks.workunit.client.1.smithi144.stderr:113200K .......... .......... .......... .......... .......... 83% 26.9M 1s 2024-03-08T20:31:44.281 INFO:tasks.workunit.client.1.smithi144.stderr:113250K .......... .......... .......... .......... .......... 83% 34.7M 1s 2024-03-08T20:31:44.283 INFO:tasks.workunit.client.1.smithi144.stderr:113300K .......... .......... .......... .......... .......... 83% 27.7M 1s 2024-03-08T20:31:44.284 INFO:tasks.workunit.client.1.smithi144.stderr:113350K .......... .......... .......... .......... .......... 83% 55.8M 1s 2024-03-08T20:31:44.286 INFO:tasks.workunit.client.1.smithi144.stderr:113400K .......... .......... .......... .......... .......... 83% 19.9M 1s 2024-03-08T20:31:44.288 INFO:tasks.workunit.client.1.smithi144.stderr:113450K .......... .......... .......... .......... .......... 83% 27.2M 1s 2024-03-08T20:31:44.290 INFO:tasks.workunit.client.1.smithi144.stderr:113500K .......... .......... .......... .......... .......... 83% 32.7M 1s 2024-03-08T20:31:44.291 INFO:tasks.workunit.client.1.smithi144.stderr:113550K .......... .......... .......... .......... .......... 83% 31.3M 1s 2024-03-08T20:31:44.292 INFO:tasks.workunit.client.1.smithi144.stderr:113600K .......... .......... .......... .......... .......... 83% 44.9M 1s 2024-03-08T20:31:44.292 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-08T20:31:44.294 INFO:tasks.workunit.client.1.smithi144.stderr:113650K .......... .......... .......... .......... .......... 83% 22.1M 1s 2024-03-08T20:31:44.296 INFO:tasks.workunit.client.1.smithi144.stderr:113700K .......... .......... .......... .......... .......... 83% 39.3M 1s 2024-03-08T20:31:44.297 INFO:tasks.workunit.client.1.smithi144.stderr:113750K .......... .......... .......... .......... .......... 83% 22.8M 1s 2024-03-08T20:31:44.300 INFO:tasks.workunit.client.1.smithi144.stderr:113800K .......... .......... .......... .......... .......... 83% 22.5M 1s 2024-03-08T20:31:44.300 INFO:tasks.workunit.client.1.smithi144.stderr:113850K .......... .......... .......... .......... .......... 83% 55.6M 1s 2024-03-08T20:31:44.302 INFO:tasks.workunit.client.1.smithi144.stderr:113900K .......... .......... .......... .......... .......... 83% 25.9M 1s 2024-03-08T20:31:44.304 INFO:tasks.workunit.client.1.smithi144.stderr:113950K .......... .......... .......... .......... .......... 83% 28.8M 1s 2024-03-08T20:31:44.306 INFO:tasks.workunit.client.1.smithi144.stderr:114000K .......... .......... .......... .......... .......... 84% 25.2M 1s 2024-03-08T20:31:44.309 INFO:tasks.workunit.client.1.smithi144.stderr:114050K .......... .......... .......... .......... .......... 84% 23.4M 1s 2024-03-08T20:31:44.309 INFO:tasks.workunit.client.1.smithi144.stderr:114100K .......... .......... .......... .......... .......... 84% 50.5M 1s 2024-03-08T20:31:44.313 INFO:tasks.workunit.client.1.smithi144.stderr:114150K .......... .......... .......... .......... .......... 84% 15.7M 1s 2024-03-08T20:31:44.313 INFO:tasks.workunit.client.1.smithi144.stderr:114200K .......... .......... .......... .......... .......... 84% 65.8M 1s 2024-03-08T20:31:44.315 INFO:tasks.workunit.client.1.smithi144.stderr:114250K .......... .......... .......... .......... .......... 84% 30.7M 1s 2024-03-08T20:31:44.316 INFO:tasks.workunit.client.1.smithi144.stderr:114300K .......... .......... .......... .......... .......... 84% 32.4M 1s 2024-03-08T20:31:44.317 INFO:tasks.workunit.client.1.smithi144.stderr:114350K .......... .......... .......... .......... .......... 84% 37.4M 1s 2024-03-08T20:31:44.319 INFO:tasks.workunit.client.1.smithi144.stderr:114400K .......... .......... .......... .......... .......... 84% 27.6M 1s 2024-03-08T20:31:44.321 INFO:tasks.workunit.client.1.smithi144.stderr:114450K .......... .......... .......... .......... .......... 84% 23.4M 1s 2024-03-08T20:31:44.322 INFO:tasks.workunit.client.1.smithi144.stderr:114500K .......... .......... .......... .......... .......... 84% 48.6M 1s 2024-03-08T20:31:44.325 INFO:tasks.workunit.client.1.smithi144.stderr:114550K .......... .......... .......... .......... .......... 84% 21.8M 1s 2024-03-08T20:31:44.325 INFO:tasks.workunit.client.1.smithi144.stderr:114600K .......... .......... .......... .......... .......... 84% 52.8M 1s 2024-03-08T20:31:44.327 INFO:tasks.workunit.client.1.smithi144.stderr:114650K .......... .......... .......... .......... .......... 84% 24.3M 1s 2024-03-08T20:31:44.330 INFO:tasks.workunit.client.1.smithi144.stderr:114700K .......... .......... .......... .......... .......... 84% 29.0M 1s 2024-03-08T20:31:44.331 INFO:tasks.workunit.client.1.smithi144.stderr:114750K .......... .......... .......... .......... .......... 84% 22.7M 1s 2024-03-08T20:31:44.333 INFO:tasks.workunit.client.1.smithi144.stderr:114800K .......... .......... .......... .......... .......... 84% 37.1M 1s 2024-03-08T20:31:44.335 INFO:tasks.workunit.client.1.smithi144.stderr:114850K .......... .......... .......... .......... .......... 84% 40.5M 1s 2024-03-08T20:31:44.337 INFO:tasks.workunit.client.1.smithi144.stderr:114900K .......... .......... .......... .......... .......... 84% 22.4M 1s 2024-03-08T20:31:44.338 INFO:tasks.workunit.client.1.smithi144.stderr:114950K .......... .......... .......... .......... .......... 84% 24.7M 1s 2024-03-08T20:31:44.340 INFO:tasks.workunit.client.1.smithi144.stderr:115000K .......... .......... .......... .......... .......... 84% 29.5M 1s 2024-03-08T20:31:44.341 INFO:tasks.workunit.client.1.smithi144.stderr:115050K .......... .......... .......... .......... .......... 84% 31.9M 1s 2024-03-08T20:31:44.342 INFO:tasks.workunit.client.1.smithi144.stderr:115100K .......... .......... .......... .......... .......... 84% 32.8M 1s 2024-03-08T20:31:44.345 INFO:tasks.workunit.client.1.smithi144.stderr:115150K .......... .......... .......... .......... .......... 84% 30.4M 1s 2024-03-08T20:31:44.347 INFO:tasks.workunit.client.1.smithi144.stderr:115200K .......... .......... .......... .......... .......... 84% 24.9M 1s 2024-03-08T20:31:44.348 INFO:tasks.workunit.client.1.smithi144.stderr:115250K .......... .......... .......... .......... .......... 84% 26.9M 1s 2024-03-08T20:31:44.350 INFO:tasks.workunit.client.1.smithi144.stderr:115300K .......... .......... .......... .......... .......... 84% 32.2M 1s 2024-03-08T20:31:44.351 INFO:tasks.workunit.client.1.smithi144.stderr:115350K .......... .......... .......... .......... .......... 85% 46.0M 1s 2024-03-08T20:31:44.353 INFO:tasks.workunit.client.1.smithi144.stderr:115400K .......... .......... .......... .......... .......... 85% 26.0M 1s 2024-03-08T20:31:44.357 INFO:tasks.workunit.client.1.smithi144.stderr:115450K .......... .......... .......... .......... .......... 85% 20.0M 1s 2024-03-08T20:31:44.358 INFO:tasks.workunit.client.1.smithi144.stderr:115500K .......... .......... .......... .......... .......... 85% 34.0M 1s 2024-03-08T20:31:44.358 INFO:tasks.workunit.client.1.smithi144.stderr:115550K .......... .......... .......... .......... .......... 85% 40.6M 1s 2024-03-08T20:31:44.360 INFO:tasks.workunit.client.1.smithi144.stderr:115600K .......... .......... .......... .......... .......... 85% 20.7M 1s 2024-03-08T20:31:44.364 INFO:tasks.workunit.client.1.smithi144.stderr:115650K .......... .......... .......... .......... .......... 85% 19.1M 1s 2024-03-08T20:31:44.364 INFO:tasks.workunit.client.1.smithi144.stderr:115700K .......... .......... .......... .......... .......... 85% 83.0M 1s 2024-03-08T20:31:44.365 INFO:tasks.workunit.client.1.smithi144.stderr:115750K .......... .......... .......... .......... .......... 85% 25.4M 1s 2024-03-08T20:31:44.366 INFO:tasks.workunit.client.1.smithi144.stderr:115800K .......... .......... .......... .......... .......... 85% 32.0M 1s 2024-03-08T20:31:44.368 INFO:tasks.workunit.client.1.smithi144.stderr:115850K .......... .......... .......... .......... .......... 85% 43.5M 1s 2024-03-08T20:31:44.369 INFO:tasks.workunit.client.1.smithi144.stderr:115900K .......... .......... .......... .......... .......... 85% 30.0M 1s 2024-03-08T20:31:44.371 INFO:tasks.workunit.client.1.smithi144.stderr:115950K .......... .......... .......... .......... .......... 85% 20.6M 1s 2024-03-08T20:31:44.374 INFO:tasks.workunit.client.1.smithi144.stderr:116000K .......... .......... .......... .......... .......... 85% 26.6M 1s 2024-03-08T20:31:44.375 INFO:tasks.workunit.client.1.smithi144.stderr:116050K .......... .......... .......... .......... .......... 85% 35.1M 1s 2024-03-08T20:31:44.376 INFO:tasks.workunit.client.1.smithi144.stderr:116100K .......... .......... .......... .......... .......... 85% 41.1M 1s 2024-03-08T20:31:44.378 INFO:tasks.workunit.client.1.smithi144.stderr:116150K .......... .......... .......... .......... .......... 85% 27.9M 1s 2024-03-08T20:31:44.380 INFO:tasks.workunit.client.1.smithi144.stderr:116200K .......... .......... .......... .......... .......... 85% 24.1M 1s 2024-03-08T20:31:44.382 INFO:tasks.workunit.client.1.smithi144.stderr:116250K .......... .......... .......... .......... .......... 85% 29.2M 1s 2024-03-08T20:31:44.383 INFO:tasks.workunit.client.1.smithi144.stderr:116300K .......... .......... .......... .......... .......... 85% 29.4M 1s 2024-03-08T20:31:44.384 INFO:tasks.workunit.client.1.smithi144.stderr:116350K .......... .......... .......... .......... .......... 85% 38.5M 1s 2024-03-08T20:31:44.386 INFO:tasks.workunit.client.1.smithi144.stderr:116400K .......... .......... .......... .......... .......... 85% 27.3M 1s 2024-03-08T20:31:44.389 INFO:tasks.workunit.client.1.smithi144.stderr:116450K .......... .......... .......... .......... .......... 85% 21.7M 1s 2024-03-08T20:31:44.390 INFO:tasks.workunit.client.1.smithi144.stderr:116500K .......... .......... .......... .......... .......... 85% 27.9M 1s 2024-03-08T20:31:44.392 INFO:tasks.workunit.client.1.smithi144.stderr:116550K .......... .......... .......... .......... .......... 85% 30.8M 1s 2024-03-08T20:31:44.393 INFO:tasks.workunit.client.1.smithi144.stderr:116600K .......... .......... .......... .......... .......... 85% 37.9M 1s 2024-03-08T20:31:44.395 INFO:tasks.workunit.client.1.smithi144.stderr:116650K .......... .......... .......... .......... .......... 85% 26.7M 1s 2024-03-08T20:31:44.397 INFO:tasks.workunit.client.1.smithi144.stderr:116700K .......... .......... .......... .......... .......... 86% 27.9M 1s 2024-03-08T20:31:44.399 INFO:tasks.workunit.client.1.smithi144.stderr:116750K .......... .......... .......... .......... .......... 86% 23.7M 1s 2024-03-08T20:31:44.400 INFO:tasks.workunit.client.1.smithi144.stderr:116800K .......... .......... .......... .......... .......... 86% 33.1M 1s 2024-03-08T20:31:44.402 INFO:tasks.workunit.client.1.smithi144.stderr:116850K .......... .......... .......... .......... .......... 86% 25.9M 1s 2024-03-08T20:31:44.405 INFO:tasks.workunit.client.1.smithi144.stderr:116900K .......... .......... .......... .......... .......... 86% 21.6M 1s 2024-03-08T20:31:44.406 INFO:tasks.workunit.client.1.smithi144.stderr:116950K .......... .......... .......... .......... .......... 86% 37.4M 1s 2024-03-08T20:31:44.406 INFO:tasks.workunit.client.1.smithi144.stderr:117000K .......... .......... .......... .......... .......... 86% 44.5M 1s 2024-03-08T20:31:44.408 INFO:tasks.workunit.client.1.smithi144.stderr:117050K .......... .......... .......... .......... .......... 86% 29.1M 1s 2024-03-08T20:31:44.411 INFO:tasks.workunit.client.1.smithi144.stderr:117100K .......... .......... .......... .......... .......... 86% 21.6M 1s 2024-03-08T20:31:44.413 INFO:tasks.workunit.client.1.smithi144.stderr:117150K .......... .......... .......... .......... .......... 86% 37.9M 1s 2024-03-08T20:31:44.415 INFO:tasks.workunit.client.1.smithi144.stderr:117200K .......... .......... .......... .......... .......... 86% 24.9M 1s 2024-03-08T20:31:44.416 INFO:tasks.workunit.client.1.smithi144.stderr:117250K .......... .......... .......... .......... .......... 86% 26.7M 1s 2024-03-08T20:31:44.417 INFO:tasks.workunit.client.1.smithi144.stderr:117300K .......... .......... .......... .......... .......... 86% 30.5M 1s 2024-03-08T20:31:44.421 INFO:tasks.workunit.client.1.smithi144.stderr:117350K .......... .......... .......... .......... .......... 86% 26.6M 1s 2024-03-08T20:31:44.421 INFO:tasks.workunit.client.1.smithi144.stderr:117400K .......... .......... .......... .......... .......... 86% 46.9M 1s 2024-03-08T20:31:44.423 INFO:tasks.workunit.client.1.smithi144.stderr:117450K .......... .......... .......... .......... .......... 86% 23.5M 1s 2024-03-08T20:31:44.423 INFO:tasks.workunit.client.1.smithi144.stderr:117500K .......... .......... .......... .......... .......... 86% 35.8M 1s 2024-03-08T20:31:44.426 INFO:tasks.workunit.client.1.smithi144.stderr:117550K .......... .......... .......... .......... .......... 86% 26.2M 1s 2024-03-08T20:31:44.432 INFO:tasks.workunit.client.1.smithi144.stderr:117600K .......... .......... .......... .......... .......... 86% 25.8M 1s 2024-03-08T20:31:44.433 INFO:tasks.workunit.client.1.smithi144.stderr:117650K .......... .......... .......... .......... .......... 86% 40.4M 1s 2024-03-08T20:31:44.433 INFO:tasks.workunit.client.1.smithi144.stderr:117700K .......... .......... .......... .......... .......... 86% 24.3M 1s 2024-03-08T20:31:44.433 INFO:tasks.workunit.client.1.smithi144.stderr:117750K .......... .......... .......... .......... .......... 86% 35.6M 1s 2024-03-08T20:31:44.434 INFO:tasks.workunit.client.1.smithi144.stderr:117800K .......... .......... .......... .......... .......... 86% 26.4M 1s 2024-03-08T20:31:44.436 INFO:tasks.workunit.client.1.smithi144.stderr:117850K .......... .......... .......... .......... .......... 86% 23.6M 1s 2024-03-08T20:31:44.438 INFO:tasks.workunit.client.1.smithi144.stderr:117900K .......... .......... .......... .......... .......... 86% 36.7M 1s 2024-03-08T20:31:44.439 INFO:tasks.workunit.client.1.smithi144.stderr:117950K .......... .......... .......... .......... .......... 86% 23.4M 1s 2024-03-08T20:31:44.441 INFO:tasks.workunit.client.1.smithi144.stderr:118000K .......... .......... .......... .......... .......... 86% 30.2M 1s 2024-03-08T20:31:44.443 INFO:tasks.workunit.client.1.smithi144.stderr:118050K .......... .......... .......... .......... .......... 86% 28.1M 1s 2024-03-08T20:31:44.445 INFO:tasks.workunit.client.1.smithi144.stderr:118100K .......... .......... .......... .......... .......... 87% 25.9M 1s 2024-03-08T20:31:44.445 INFO:tasks.workunit.client.1.smithi144.stderr:118150K .......... .......... .......... .......... .......... 87% 43.7M 1s 2024-03-08T20:31:44.448 INFO:tasks.workunit.client.1.smithi144.stderr:118200K .......... .......... .......... .......... .......... 87% 25.9M 1s 2024-03-08T20:31:44.453 INFO:tasks.workunit.client.1.smithi144.stderr:118250K .......... .......... .......... .......... .......... 87% 10.2M 1s 2024-03-08T20:31:44.455 INFO:tasks.workunit.client.1.smithi144.stderr:118300K .......... .......... .......... .......... .......... 87% 27.6M 1s 2024-03-08T20:31:44.458 INFO:tasks.workunit.client.1.smithi144.stderr:118350K .......... .......... .......... .......... .......... 87% 27.3M 1s 2024-03-08T20:31:44.458 INFO:tasks.workunit.client.1.smithi144.stderr:118400K .......... .......... .......... .......... .......... 87% 60.4M 1s 2024-03-08T20:31:44.458 INFO:tasks.workunit.client.1.smithi144.stderr:118450K .......... .......... .......... .......... .......... 87% 40.7M 1s 2024-03-08T20:31:44.459 INFO:tasks.workunit.client.1.smithi144.stderr:118500K .......... .......... .......... .......... .......... 87% 99.9M 1s 2024-03-08T20:31:44.461 INFO:tasks.workunit.client.1.smithi144.stderr:118550K .......... .......... .......... .......... .......... 87% 21.0M 1s 2024-03-08T20:31:44.463 INFO:tasks.workunit.client.1.smithi144.stderr:118600K .......... .......... .......... .......... .......... 87% 27.7M 1s 2024-03-08T20:31:44.463 INFO:tasks.workunit.client.1.smithi144.stderr:118650K .......... .......... .......... .......... .......... 87% 70.4M 1s 2024-03-08T20:31:44.466 INFO:tasks.workunit.client.1.smithi144.stderr:118700K .......... .......... .......... .......... .......... 87% 18.5M 1s 2024-03-08T20:31:44.467 INFO:tasks.workunit.client.1.smithi144.stderr:118750K .......... .......... .......... .......... .......... 87% 38.1M 1s 2024-03-08T20:31:44.469 INFO:tasks.workunit.client.1.smithi144.stderr:118800K .......... .......... .......... .......... .......... 87% 23.3M 1s 2024-03-08T20:31:44.471 INFO:tasks.workunit.client.1.smithi144.stderr:118850K .......... .......... .......... .......... .......... 87% 24.3M 1s 2024-03-08T20:31:44.471 INFO:tasks.workunit.client.1.smithi144.stderr:118900K .......... .......... .......... .......... .......... 87% 99.7M 1s 2024-03-08T20:31:44.474 INFO:tasks.workunit.client.1.smithi144.stderr:118950K .......... .......... .......... .......... .......... 87% 22.7M 1s 2024-03-08T20:31:44.474 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/types.h... yes 2024-03-08T20:31:44.476 INFO:tasks.workunit.client.1.smithi144.stderr:119000K .......... .......... .......... .......... .......... 87% 32.8M 1s 2024-03-08T20:31:44.477 INFO:tasks.workunit.client.1.smithi144.stderr:119050K .......... .......... .......... .......... .......... 87% 26.1M 1s 2024-03-08T20:31:44.479 INFO:tasks.workunit.client.1.smithi144.stderr:119100K .......... .......... .......... .......... .......... 87% 23.0M 1s 2024-03-08T20:31:44.480 INFO:tasks.workunit.client.1.smithi144.stderr:119150K .......... .......... .......... .......... .......... 87% 46.7M 1s 2024-03-08T20:31:44.482 INFO:tasks.workunit.client.1.smithi144.stderr:119200K .......... .......... .......... .......... .......... 87% 26.2M 1s 2024-03-08T20:31:44.484 INFO:tasks.workunit.client.1.smithi144.stderr:119250K .......... .......... .......... .......... .......... 87% 24.4M 1s 2024-03-08T20:31:44.486 INFO:tasks.workunit.client.1.smithi144.stderr:119300K .......... .......... .......... .......... .......... 87% 28.8M 1s 2024-03-08T20:31:44.488 INFO:tasks.workunit.client.1.smithi144.stderr:119350K .......... .......... .......... .......... .......... 87% 27.9M 1s 2024-03-08T20:31:44.489 INFO:tasks.workunit.client.1.smithi144.stderr:119400K .......... .......... .......... .......... .......... 87% 39.0M 1s 2024-03-08T20:31:44.491 INFO:tasks.workunit.client.1.smithi144.stderr:119450K .......... .......... .......... .......... .......... 88% 29.1M 1s 2024-03-08T20:31:44.493 INFO:tasks.workunit.client.1.smithi144.stderr:119500K .......... .......... .......... .......... .......... 88% 22.8M 1s 2024-03-08T20:31:44.494 INFO:tasks.workunit.client.1.smithi144.stderr:119550K .......... .......... .......... .......... .......... 88% 35.3M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119600K .......... .......... .......... .......... .......... 88% 15.6M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119650K .......... .......... .......... .......... .......... 88% 104M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119700K .......... .......... .......... .......... .......... 88% 35.0M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119750K .......... .......... .......... .......... .......... 88% 25.4M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119800K .......... .......... .......... .......... .......... 88% 35.3M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119850K .......... .......... .......... .......... .......... 88% 24.2M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119900K .......... .......... .......... .......... .......... 88% 54.8M 1s 2024-03-08T20:31:44.508 INFO:tasks.workunit.client.1.smithi144.stderr:119950K .......... .......... .......... .......... .......... 88% 24.3M 1s 2024-03-08T20:31:44.510 INFO:tasks.workunit.client.1.smithi144.stderr:120000K .......... .......... .......... .......... .......... 88% 23.0M 1s 2024-03-08T20:31:44.511 INFO:tasks.workunit.client.1.smithi144.stderr:120050K .......... .......... .......... .......... .......... 88% 37.3M 1s 2024-03-08T20:31:44.514 INFO:tasks.workunit.client.1.smithi144.stderr:120100K .......... .......... .......... .......... .......... 88% 21.9M 1s 2024-03-08T20:31:44.516 INFO:tasks.workunit.client.1.smithi144.stderr:120150K .......... .......... .......... .......... .......... 88% 27.6M 1s 2024-03-08T20:31:44.516 INFO:tasks.workunit.client.1.smithi144.stderr:120200K .......... .......... .......... .......... .......... 88% 49.3M 1s 2024-03-08T20:31:44.518 INFO:tasks.workunit.client.1.smithi144.stderr:120250K .......... .......... .......... .......... .......... 88% 25.5M 1s 2024-03-08T20:31:44.520 INFO:tasks.workunit.client.1.smithi144.stderr:120300K .......... .......... .......... .......... .......... 88% 30.3M 1s 2024-03-08T20:31:44.521 INFO:tasks.workunit.client.1.smithi144.stderr:120350K .......... .......... .......... .......... .......... 88% 35.7M 1s 2024-03-08T20:31:44.523 INFO:tasks.workunit.client.1.smithi144.stderr:120400K .......... .......... .......... .......... .......... 88% 18.3M 1s 2024-03-08T20:31:44.524 INFO:tasks.workunit.client.1.smithi144.stderr:120450K .......... .......... .......... .......... .......... 88% 47.7M 1s 2024-03-08T20:31:44.526 INFO:tasks.workunit.client.1.smithi144.stderr:120500K .......... .......... .......... .......... .......... 88% 24.1M 1s 2024-03-08T20:31:44.528 INFO:tasks.workunit.client.1.smithi144.stderr:120550K .......... .......... .......... .......... .......... 88% 36.3M 1s 2024-03-08T20:31:44.531 INFO:tasks.workunit.client.1.smithi144.stderr:120600K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-03-08T20:31:44.532 INFO:tasks.workunit.client.1.smithi144.stderr:120650K .......... .......... .......... .......... .......... 88% 27.9M 1s 2024-03-08T20:31:44.533 INFO:tasks.workunit.client.1.smithi144.stderr:120700K .......... .......... .......... .......... .......... 88% 45.5M 1s 2024-03-08T20:31:44.535 INFO:tasks.workunit.client.1.smithi144.stderr:120750K .......... .......... .......... .......... .......... 88% 34.0M 1s 2024-03-08T20:31:44.536 INFO:tasks.workunit.client.1.smithi144.stderr:120800K .......... .......... .......... .......... .......... 89% 25.9M 1s 2024-03-08T20:31:44.539 INFO:tasks.workunit.client.1.smithi144.stderr:120850K .......... .......... .......... .......... .......... 89% 22.2M 1s 2024-03-08T20:31:44.541 INFO:tasks.workunit.client.1.smithi144.stderr:120900K .......... .......... .......... .......... .......... 89% 27.1M 1s 2024-03-08T20:31:44.541 INFO:tasks.workunit.client.1.smithi144.stderr:120950K .......... .......... .......... .......... .......... 89% 53.4M 1s 2024-03-08T20:31:44.543 INFO:tasks.workunit.client.1.smithi144.stderr:121000K .......... .......... .......... .......... .......... 89% 27.6M 1s 2024-03-08T20:31:44.545 INFO:tasks.workunit.client.1.smithi144.stderr:121050K .......... .......... .......... .......... .......... 89% 25.0M 1s 2024-03-08T20:31:44.546 INFO:tasks.workunit.client.1.smithi144.stderr:121100K .......... .......... .......... .......... .......... 89% 28.1M 1s 2024-03-08T20:31:44.550 INFO:tasks.workunit.client.1.smithi144.stderr:121150K .......... .......... .......... .......... .......... 89% 24.4M 1s 2024-03-08T20:31:44.550 INFO:tasks.workunit.client.1.smithi144.stderr:121200K .......... .......... .......... .......... .......... 89% 54.1M 1s 2024-03-08T20:31:44.552 INFO:tasks.workunit.client.1.smithi144.stderr:121250K .......... .......... .......... .......... .......... 89% 21.3M 1s 2024-03-08T20:31:44.553 INFO:tasks.workunit.client.1.smithi144.stderr:121300K .......... .......... .......... .......... .......... 89% 32.6M 1s 2024-03-08T20:31:44.556 INFO:tasks.workunit.client.1.smithi144.stderr:121350K .......... .......... .......... .......... .......... 89% 25.9M 1s 2024-03-08T20:31:44.557 INFO:tasks.workunit.client.1.smithi144.stderr:121400K .......... .......... .......... .......... .......... 89% 25.4M 1s 2024-03-08T20:31:44.558 INFO:tasks.workunit.client.1.smithi144.stderr:121450K .......... .......... .......... .......... .......... 89% 44.9M 1s 2024-03-08T20:31:44.560 INFO:tasks.workunit.client.1.smithi144.stderr:121500K .......... .......... .......... .......... .......... 89% 31.5M 1s 2024-03-08T20:31:44.562 INFO:tasks.workunit.client.1.smithi144.stderr:121550K .......... .......... .......... .......... .......... 89% 27.9M 1s 2024-03-08T20:31:44.564 INFO:tasks.workunit.client.1.smithi144.stderr:121600K .......... .......... .......... .......... .......... 89% 23.3M 1s 2024-03-08T20:31:44.566 INFO:tasks.workunit.client.1.smithi144.stderr:121650K .......... .......... .......... .......... .......... 89% 25.1M 1s 2024-03-08T20:31:44.566 INFO:tasks.workunit.client.1.smithi144.stderr:121700K .......... .......... .......... .......... .......... 89% 41.4M 1s 2024-03-08T20:31:44.568 INFO:tasks.workunit.client.1.smithi144.stderr:121750K .......... .......... .......... .......... .......... 89% 30.6M 1s 2024-03-08T20:31:44.570 INFO:tasks.workunit.client.1.smithi144.stderr:121800K .......... .......... .......... .......... .......... 89% 26.4M 1s 2024-03-08T20:31:44.573 INFO:tasks.workunit.client.1.smithi144.stderr:121850K .......... .......... .......... .......... .......... 89% 23.3M 1s 2024-03-08T20:31:44.574 INFO:tasks.workunit.client.1.smithi144.stderr:121900K .......... .......... .......... .......... .......... 89% 27.9M 0s 2024-03-08T20:31:44.575 INFO:tasks.workunit.client.1.smithi144.stderr:121950K .......... .......... .......... .......... .......... 89% 53.2M 0s 2024-03-08T20:31:44.577 INFO:tasks.workunit.client.1.smithi144.stderr:122000K .......... .......... .......... .......... .......... 89% 20.9M 0s 2024-03-08T20:31:44.578 INFO:tasks.workunit.client.1.smithi144.stderr:122050K .......... .......... .......... .......... .......... 89% 41.5M 0s 2024-03-08T20:31:44.581 INFO:tasks.workunit.client.1.smithi144.stderr:122100K .......... .......... .......... .......... .......... 89% 20.7M 0s 2024-03-08T20:31:44.582 INFO:tasks.workunit.client.1.smithi144.stderr:122150K .......... .......... .......... .......... .......... 90% 31.1M 0s 2024-03-08T20:31:44.583 INFO:tasks.workunit.client.1.smithi144.stderr:122200K .......... .......... .......... .......... .......... 90% 41.8M 0s 2024-03-08T20:31:44.585 INFO:tasks.workunit.client.1.smithi144.stderr:122250K .......... .......... .......... .......... .......... 90% 28.5M 0s 2024-03-08T20:31:44.586 INFO:tasks.workunit.client.1.smithi144.stderr:122300K .......... .......... .......... .......... .......... 90% 34.9M 0s 2024-03-08T20:31:44.588 INFO:tasks.workunit.client.1.smithi144.stderr:122350K .......... .......... .......... .......... .......... 90% 24.5M 0s 2024-03-08T20:31:44.592 INFO:tasks.workunit.client.1.smithi144.stderr:122400K .......... .......... .......... .......... .......... 90% 24.2M 0s 2024-03-08T20:31:44.592 INFO:tasks.workunit.client.1.smithi144.stderr:122450K .......... .......... .......... .......... .......... 90% 40.7M 0s 2024-03-08T20:31:44.593 INFO:tasks.workunit.client.1.smithi144.stderr:122500K .......... .......... .......... .......... .......... 90% 28.1M 0s 2024-03-08T20:31:44.595 INFO:tasks.workunit.client.1.smithi144.stderr:122550K .......... .......... .......... .......... .......... 90% 31.0M 0s 2024-03-08T20:31:44.598 INFO:tasks.workunit.client.1.smithi144.stderr:122600K .......... .......... .......... .......... .......... 90% 22.8M 0s 2024-03-08T20:31:44.598 INFO:tasks.workunit.client.1.smithi144.stderr:122650K .......... .......... .......... .......... .......... 90% 39.9M 0s 2024-03-08T20:31:44.600 INFO:tasks.workunit.client.1.smithi144.stderr:122700K .......... .......... .......... .......... .......... 90% 32.9M 0s 2024-03-08T20:31:44.603 INFO:tasks.workunit.client.1.smithi144.stderr:122750K .......... .......... .......... .......... .......... 90% 22.0M 0s 2024-03-08T20:31:44.604 INFO:tasks.workunit.client.1.smithi144.stderr:122800K .......... .......... .......... .......... .......... 90% 31.9M 0s 2024-03-08T20:31:44.606 INFO:tasks.workunit.client.1.smithi144.stderr:122850K .......... .......... .......... .......... .......... 90% 26.2M 0s 2024-03-08T20:31:44.608 INFO:tasks.workunit.client.1.smithi144.stderr:122900K .......... .......... .......... .......... .......... 90% 25.1M 0s 2024-03-08T20:31:44.608 INFO:tasks.workunit.client.1.smithi144.stderr:122950K .......... .......... .......... .......... .......... 90% 45.5M 0s 2024-03-08T20:31:44.610 INFO:tasks.workunit.client.1.smithi144.stderr:123000K .......... .......... .......... .......... .......... 90% 24.2M 0s 2024-03-08T20:31:44.612 INFO:tasks.workunit.client.1.smithi144.stderr:123050K .......... .......... .......... .......... .......... 90% 37.6M 0s 2024-03-08T20:31:44.614 INFO:tasks.workunit.client.1.smithi144.stderr:123100K .......... .......... .......... .......... .......... 90% 24.4M 0s 2024-03-08T20:31:44.616 INFO:tasks.workunit.client.1.smithi144.stderr:123150K .......... .......... .......... .......... .......... 90% 26.6M 0s 2024-03-08T20:31:44.617 INFO:tasks.workunit.client.1.smithi144.stderr:123200K .......... .......... .......... .......... .......... 90% 40.0M 0s 2024-03-08T20:31:44.619 INFO:tasks.workunit.client.1.smithi144.stderr:123250K .......... .......... .......... .......... .......... 90% 22.3M 0s 2024-03-08T20:31:44.620 INFO:tasks.workunit.client.1.smithi144.stderr:123300K .......... .......... .......... .......... .......... 90% 41.8M 0s 2024-03-08T20:31:44.622 INFO:tasks.workunit.client.1.smithi144.stderr:123350K .......... .......... .......... .......... .......... 90% 27.6M 0s 2024-03-08T20:31:44.626 INFO:tasks.workunit.client.1.smithi144.stderr:123400K .......... .......... .......... .......... .......... 90% 21.9M 0s 2024-03-08T20:31:44.626 INFO:tasks.workunit.client.1.smithi144.stderr:123450K .......... .......... .......... .......... .......... 90% 38.5M 0s 2024-03-08T20:31:44.627 INFO:tasks.workunit.client.1.smithi144.stderr:123500K .......... .......... .......... .......... .......... 91% 33.1M 0s 2024-03-08T20:31:44.630 INFO:tasks.workunit.client.1.smithi144.stderr:123550K .......... .......... .......... .......... .......... 91% 23.8M 0s 2024-03-08T20:31:44.638 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/stat.h... yes 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123600K .......... .......... .......... .......... .......... 91% 27.7M 0s 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123650K .......... .......... .......... .......... .......... 91% 53.8M 0s 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123700K .......... .......... .......... .......... .......... 91% 26.8M 0s 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123750K .......... .......... .......... .......... .......... 91% 22.6M 0s 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123800K .......... .......... .......... .......... .......... 91% 27.5M 0s 2024-03-08T20:31:44.645 INFO:tasks.workunit.client.1.smithi144.stderr:123850K .......... .......... .......... .......... .......... 91% 24.3M 0s 2024-03-08T20:31:44.646 INFO:tasks.workunit.client.1.smithi144.stderr:123900K .......... .......... .......... .......... .......... 91% 41.1M 0s 2024-03-08T20:31:44.646 INFO:tasks.workunit.client.1.smithi144.stderr:123950K .......... .......... .......... .......... .......... 91% 32.3M 0s 2024-03-08T20:31:44.646 INFO:tasks.workunit.client.1.smithi144.stderr:124000K .......... .......... .......... .......... .......... 91% 26.1M 0s 2024-03-08T20:31:44.648 INFO:tasks.workunit.client.1.smithi144.stderr:124050K .......... .......... .......... .......... .......... 91% 24.7M 0s 2024-03-08T20:31:44.649 INFO:tasks.workunit.client.1.smithi144.stderr:124100K .......... .......... .......... .......... .......... 91% 29.5M 0s 2024-03-08T20:31:44.651 INFO:tasks.workunit.client.1.smithi144.stderr:124150K .......... .......... .......... .......... .......... 91% 25.7M 0s 2024-03-08T20:31:44.651 INFO:tasks.workunit.client.1.smithi144.stderr:124200K .......... .......... .......... .......... .......... 91% 47.4M 0s 2024-03-08T20:31:44.653 INFO:tasks.workunit.client.1.smithi144.stderr:124250K .......... .......... .......... .......... .......... 91% 23.3M 0s 2024-03-08T20:31:44.656 INFO:tasks.workunit.client.1.smithi144.stderr:124300K .......... .......... .......... .......... .......... 91% 21.8M 0s 2024-03-08T20:31:44.658 INFO:tasks.workunit.client.1.smithi144.stderr:124350K .......... .......... .......... .......... .......... 91% 26.6M 0s 2024-03-08T20:31:44.660 INFO:tasks.workunit.client.1.smithi144.stderr:124400K .......... .......... .......... .......... .......... 91% 62.6M 0s 2024-03-08T20:31:44.660 INFO:tasks.workunit.client.1.smithi144.stderr:124450K .......... .......... .......... .......... .......... 91% 23.2M 0s 2024-03-08T20:31:44.662 INFO:tasks.workunit.client.1.smithi144.stderr:124500K .......... .......... .......... .......... .......... 91% 22.9M 0s 2024-03-08T20:31:44.664 INFO:tasks.workunit.client.1.smithi144.stderr:124550K .......... .......... .......... .......... .......... 91% 31.0M 0s 2024-03-08T20:31:44.666 INFO:tasks.workunit.client.1.smithi144.stderr:124600K .......... .......... .......... .......... .......... 91% 25.3M 0s 2024-03-08T20:31:44.667 INFO:tasks.workunit.client.1.smithi144.stderr:124650K .......... .......... .......... .......... .......... 91% 34.6M 0s 2024-03-08T20:31:44.669 INFO:tasks.workunit.client.1.smithi144.stderr:124700K .......... .......... .......... .......... .......... 91% 26.9M 0s 2024-03-08T20:31:44.672 INFO:tasks.workunit.client.1.smithi144.stderr:124750K .......... .......... .......... .......... .......... 91% 30.4M 0s 2024-03-08T20:31:44.672 INFO:tasks.workunit.client.1.smithi144.stderr:124800K .......... .......... .......... .......... .......... 91% 32.1M 0s 2024-03-08T20:31:44.675 INFO:tasks.workunit.client.1.smithi144.stderr:124850K .......... .......... .......... .......... .......... 92% 23.4M 0s 2024-03-08T20:31:44.675 INFO:tasks.workunit.client.1.smithi144.stderr:124900K .......... .......... .......... .......... .......... 92% 55.5M 0s 2024-03-08T20:31:44.677 INFO:tasks.workunit.client.1.smithi144.stderr:124950K .......... .......... .......... .......... .......... 92% 27.9M 0s 2024-03-08T20:31:44.679 INFO:tasks.workunit.client.1.smithi144.stderr:125000K .......... .......... .......... .......... .......... 92% 25.1M 0s 2024-03-08T20:31:44.681 INFO:tasks.workunit.client.1.smithi144.stderr:125050K .......... .......... .......... .......... .......... 92% 23.8M 0s 2024-03-08T20:31:44.684 INFO:tasks.workunit.client.1.smithi144.stderr:125100K .......... .......... .......... .......... .......... 92% 35.9M 0s 2024-03-08T20:31:44.684 INFO:tasks.workunit.client.1.smithi144.stderr:125150K .......... .......... .......... .......... .......... 92% 34.9M 0s 2024-03-08T20:31:44.686 INFO:tasks.workunit.client.1.smithi144.stderr:125200K .......... .......... .......... .......... .......... 92% 26.4M 0s 2024-03-08T20:31:44.687 INFO:tasks.workunit.client.1.smithi144.stderr:125250K .......... .......... .......... .......... .......... 92% 25.2M 0s 2024-03-08T20:31:44.689 INFO:tasks.workunit.client.1.smithi144.stderr:125300K .......... .......... .......... .......... .......... 92% 26.3M 0s 2024-03-08T20:31:44.691 INFO:tasks.workunit.client.1.smithi144.stderr:125350K .......... .......... .......... .......... .......... 92% 29.6M 0s 2024-03-08T20:31:44.692 INFO:tasks.workunit.client.1.smithi144.stderr:125400K .......... .......... .......... .......... .......... 92% 39.1M 0s 2024-03-08T20:31:44.694 INFO:tasks.workunit.client.1.smithi144.stderr:125450K .......... .......... .......... .......... .......... 92% 21.7M 0s 2024-03-08T20:31:44.696 INFO:tasks.workunit.client.1.smithi144.stderr:125500K .......... .......... .......... .......... .......... 92% 32.8M 0s 2024-03-08T20:31:44.697 INFO:tasks.workunit.client.1.smithi144.stderr:125550K .......... .......... .......... .......... .......... 92% 35.7M 0s 2024-03-08T20:31:44.699 INFO:tasks.workunit.client.1.smithi144.stderr:125600K .......... .......... .......... .......... .......... 92% 26.5M 0s 2024-03-08T20:31:44.700 INFO:tasks.workunit.client.1.smithi144.stderr:125650K .......... .......... .......... .......... .......... 92% 31.8M 0s 2024-03-08T20:31:44.703 INFO:tasks.workunit.client.1.smithi144.stderr:125700K .......... .......... .......... .......... .......... 92% 21.7M 0s 2024-03-08T20:31:44.704 INFO:tasks.workunit.client.1.smithi144.stderr:125750K .......... .......... .......... .......... .......... 92% 41.3M 0s 2024-03-08T20:31:44.706 INFO:tasks.workunit.client.1.smithi144.stderr:125800K .......... .......... .......... .......... .......... 92% 25.5M 0s 2024-03-08T20:31:44.708 INFO:tasks.workunit.client.1.smithi144.stderr:125850K .......... .......... .......... .......... .......... 92% 26.0M 0s 2024-03-08T20:31:44.711 INFO:tasks.workunit.client.1.smithi144.stderr:125900K .......... .......... .......... .......... .......... 92% 29.2M 0s 2024-03-08T20:31:44.711 INFO:tasks.workunit.client.1.smithi144.stderr:125950K .......... .......... .......... .......... .......... 92% 26.3M 0s 2024-03-08T20:31:44.713 INFO:tasks.workunit.client.1.smithi144.stderr:126000K .......... .......... .......... .......... .......... 92% 39.7M 0s 2024-03-08T20:31:44.714 INFO:tasks.workunit.client.1.smithi144.stderr:126050K .......... .......... .......... .......... .......... 92% 29.1M 0s 2024-03-08T20:31:44.715 INFO:tasks.workunit.client.1.smithi144.stderr:126100K .......... .......... .......... .......... .......... 92% 29.8M 0s 2024-03-08T20:31:44.717 INFO:tasks.workunit.client.1.smithi144.stderr:126150K .......... .......... .......... .......... .......... 92% 28.2M 0s 2024-03-08T20:31:44.719 INFO:tasks.workunit.client.1.smithi144.stderr:126200K .......... .......... .......... .......... .......... 92% 25.2M 0s 2024-03-08T20:31:44.720 INFO:tasks.workunit.client.1.smithi144.stderr:126250K .......... .......... .......... .......... .......... 93% 39.9M 0s 2024-03-08T20:31:44.722 INFO:tasks.workunit.client.1.smithi144.stderr:126300K .......... .......... .......... .......... .......... 93% 25.9M 0s 2024-03-08T20:31:44.724 INFO:tasks.workunit.client.1.smithi144.stderr:126350K .......... .......... .......... .......... .......... 93% 31.9M 0s 2024-03-08T20:31:44.729 INFO:tasks.workunit.client.1.smithi144.stderr:126400K .......... .......... .......... .......... .......... 93% 26.9M 0s 2024-03-08T20:31:44.729 INFO:tasks.workunit.client.1.smithi144.stderr:126450K .......... .......... .......... .......... .......... 93% 25.8M 0s 2024-03-08T20:31:44.729 INFO:tasks.workunit.client.1.smithi144.stderr:126500K .......... .......... .......... .......... .......... 93% 37.3M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126550K .......... .......... .......... .......... .......... 93% 25.1M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126600K .......... .......... .......... .......... .......... 93% 36.5M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126650K .......... .......... .......... .......... .......... 93% 28.6M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126700K .......... .......... .......... .......... .......... 93% 26.3M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126750K .......... .......... .......... .......... .......... 93% 34.0M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126800K .......... .......... .......... .......... .......... 93% 31.5M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126850K .......... .......... .......... .......... .......... 93% 22.5M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126900K .......... .......... .......... .......... .......... 93% 37.0M 0s 2024-03-08T20:31:44.758 INFO:tasks.workunit.client.1.smithi144.stderr:126950K .......... .......... .......... .......... .......... 93% 21.6M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127000K .......... .......... .......... .......... .......... 93% 46.3M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127050K .......... .......... .......... .......... .......... 93% 24.9M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127100K .......... .......... .......... .......... .......... 93% 23.3M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127150K .......... .......... .......... .......... .......... 93% 33.8M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127200K .......... .......... .......... .......... .......... 93% 27.7M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127250K .......... .......... .......... .......... .......... 93% 54.6M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127300K .......... .......... .......... .......... .......... 93% 27.4M 0s 2024-03-08T20:31:44.759 INFO:tasks.workunit.client.1.smithi144.stderr:127350K .......... .......... .......... .......... .......... 93% 25.2M 0s 2024-03-08T20:31:44.760 INFO:tasks.workunit.client.1.smithi144.stderr:127400K .......... .......... .......... .......... .......... 93% 26.0M 0s 2024-03-08T20:31:44.762 INFO:tasks.workunit.client.1.smithi144.stderr:127450K .......... .......... .......... .......... .......... 93% 23.5M 0s 2024-03-08T20:31:44.762 INFO:tasks.workunit.client.1.smithi144.stderr:127500K .......... .......... .......... .......... .......... 93% 70.6M 0s 2024-03-08T20:31:44.764 INFO:tasks.workunit.client.1.smithi144.stderr:127550K .......... .......... .......... .......... .......... 93% 22.1M 0s 2024-03-08T20:31:44.765 INFO:tasks.workunit.client.1.smithi144.stderr:127600K .......... .......... .......... .......... .......... 94% 35.3M 0s 2024-03-08T20:31:44.767 INFO:tasks.workunit.client.1.smithi144.stderr:127650K .......... .......... .......... .......... .......... 94% 25.1M 0s 2024-03-08T20:31:44.770 INFO:tasks.workunit.client.1.smithi144.stderr:127700K .......... .......... .......... .......... .......... 94% 25.2M 0s 2024-03-08T20:31:44.771 INFO:tasks.workunit.client.1.smithi144.stderr:127750K .......... .......... .......... .......... .......... 94% 39.2M 0s 2024-03-08T20:31:44.774 INFO:tasks.workunit.client.1.smithi144.stderr:127800K .......... .......... .......... .......... .......... 94% 23.5M 0s 2024-03-08T20:31:44.774 INFO:tasks.workunit.client.1.smithi144.stderr:127850K .......... .......... .......... .......... .......... 94% 42.3M 0s 2024-03-08T20:31:44.776 INFO:tasks.workunit.client.1.smithi144.stderr:127900K .......... .......... .......... .......... .......... 94% 22.6M 0s 2024-03-08T20:31:44.779 INFO:tasks.workunit.client.1.smithi144.stderr:127950K .......... .......... .......... .......... .......... 94% 18.8M 0s 2024-03-08T20:31:44.779 INFO:tasks.workunit.client.1.smithi144.stderr:128000K .......... .......... .......... .......... .......... 94% 58.8M 0s 2024-03-08T20:31:44.781 INFO:tasks.workunit.client.1.smithi144.stderr:128050K .......... .......... .......... .......... .......... 94% 30.6M 0s 2024-03-08T20:31:44.783 INFO:tasks.workunit.client.1.smithi144.stderr:128100K .......... .......... .......... .......... .......... 94% 35.0M 0s 2024-03-08T20:31:44.784 INFO:tasks.workunit.client.1.smithi144.stderr:128150K .......... .......... .......... .......... .......... 94% 24.7M 0s 2024-03-08T20:31:44.787 INFO:tasks.workunit.client.1.smithi144.stderr:128200K .......... .......... .......... .......... .......... 94% 26.3M 0s 2024-03-08T20:31:44.788 INFO:tasks.workunit.client.1.smithi144.stderr:128250K .......... .......... .......... .......... .......... 94% 50.3M 0s 2024-03-08T20:31:44.790 INFO:tasks.workunit.client.1.smithi144.stderr:128300K .......... .......... .......... .......... .......... 94% 19.4M 0s 2024-03-08T20:31:44.792 INFO:tasks.workunit.client.1.smithi144.stderr:128350K .......... .......... .......... .......... .......... 94% 32.2M 0s 2024-03-08T20:31:44.793 INFO:tasks.workunit.client.1.smithi144.stderr:128400K .......... .......... .......... .......... .......... 94% 27.9M 0s 2024-03-08T20:31:44.795 INFO:tasks.workunit.client.1.smithi144.stderr:128450K .......... .......... .......... .......... .......... 94% 28.1M 0s 2024-03-08T20:31:44.797 INFO:tasks.workunit.client.1.smithi144.stderr:128500K .......... .......... .......... .......... .......... 94% 35.4M 0s 2024-03-08T20:31:44.797 INFO:tasks.workunit.client.1.smithi144.stderr:128550K .......... .......... .......... .......... .......... 94% 31.9M 0s 2024-03-08T20:31:44.799 INFO:tasks.workunit.client.1.smithi144.stderr:128600K .......... .......... .......... .......... .......... 94% 26.5M 0s 2024-03-08T20:31:44.802 INFO:tasks.workunit.client.1.smithi144.stderr:128650K .......... .......... .......... .......... .......... 94% 27.2M 0s 2024-03-08T20:31:44.804 INFO:tasks.workunit.client.1.smithi144.stderr:128700K .......... .......... .......... .......... .......... 94% 28.5M 0s 2024-03-08T20:31:44.804 INFO:tasks.workunit.client.1.smithi144.stderr:128750K .......... .......... .......... .......... .......... 94% 32.5M 0s 2024-03-08T20:31:44.807 INFO:tasks.workunit.client.1.smithi144.stderr:128800K .......... .......... .......... .......... .......... 94% 24.9M 0s 2024-03-08T20:31:44.808 INFO:tasks.workunit.client.1.smithi144.stderr:128850K .......... .......... .......... .......... .......... 94% 35.8M 0s 2024-03-08T20:31:44.810 INFO:tasks.workunit.client.1.smithi144.stderr:128900K .......... .......... .......... .......... .......... 94% 29.4M 0s 2024-03-08T20:31:44.812 INFO:tasks.workunit.client.1.smithi144.stderr:128950K .......... .......... .......... .......... .......... 95% 24.2M 0s 2024-03-08T20:31:44.813 INFO:tasks.workunit.client.1.smithi144.stderr:129000K .......... .......... .......... .......... .......... 95% 34.4M 0s 2024-03-08T20:31:44.815 INFO:tasks.workunit.client.1.smithi144.stderr:129050K .......... .......... .......... .......... .......... 95% 24.5M 0s 2024-03-08T20:31:44.817 INFO:tasks.workunit.client.1.smithi144.stderr:129100K .......... .......... .......... .......... .......... 95% 26.6M 0s 2024-03-08T20:31:44.819 INFO:tasks.workunit.client.1.smithi144.stderr:129150K .......... .......... .......... .......... .......... 95% 28.6M 0s 2024-03-08T20:31:44.821 INFO:tasks.workunit.client.1.smithi144.stderr:129200K .......... .......... .......... .......... .......... 95% 20.8M 0s 2024-03-08T20:31:44.823 INFO:tasks.workunit.client.1.smithi144.stderr:129250K .......... .......... .......... .......... .......... 95% 20.8M 0s 2024-03-08T20:31:44.825 INFO:tasks.workunit.client.1.smithi144.stderr:129300K .......... .......... .......... .......... .......... 95% 34.2M 0s 2024-03-08T20:31:44.827 INFO:tasks.workunit.client.1.smithi144.stderr:129350K .......... .......... .......... .......... .......... 95% 28.6M 0s 2024-03-08T20:31:44.829 INFO:tasks.workunit.client.1.smithi144.stderr:129400K .......... .......... .......... .......... .......... 95% 34.0M 0s 2024-03-08T20:31:44.829 INFO:tasks.workunit.client.1.smithi144.stderr:129450K .......... .......... .......... .......... .......... 95% 34.6M 0s 2024-03-08T20:31:44.831 INFO:tasks.workunit.client.1.smithi144.stderr:129500K .......... .......... .......... .......... .......... 95% 35.2M 0s 2024-03-08T20:31:44.832 INFO:tasks.workunit.client.1.smithi144.stderr:129550K .......... .......... .......... .......... .......... 95% 50.1M 0s 2024-03-08T20:31:44.834 INFO:tasks.workunit.client.1.smithi144.stderr:129600K .......... .......... .......... .......... .......... 95% 31.2M 0s 2024-03-08T20:31:44.836 INFO:tasks.workunit.client.1.smithi144.stderr:129650K .......... .......... .......... .......... .......... 95% 21.8M 0s 2024-03-08T20:31:44.839 INFO:tasks.workunit.client.1.smithi144.stderr:129700K .......... .......... .......... .......... .......... 95% 23.4M 0s 2024-03-08T20:31:44.839 INFO:tasks.workunit.client.1.smithi144.stderr:129750K .......... .......... .......... .......... .......... 95% 44.3M 0s 2024-03-08T20:31:44.841 INFO:tasks.workunit.client.1.smithi144.stderr:129800K .......... .......... .......... .......... .......... 95% 24.5M 0s 2024-03-08T20:31:44.842 INFO:tasks.workunit.client.1.smithi144.stderr:129850K .......... .......... .......... .......... .......... 95% 29.0M 0s 2024-03-08T20:31:44.844 INFO:tasks.workunit.client.1.smithi144.stderr:129900K .......... .......... .......... .......... .......... 95% 26.1M 0s 2024-03-08T20:31:44.847 INFO:tasks.workunit.client.1.smithi144.stderr:129950K .......... .......... .......... .......... .......... 95% 26.6M 0s 2024-03-08T20:31:44.847 INFO:tasks.workunit.client.1.smithi144.stderr:130000K .......... .......... .......... .......... .......... 95% 47.0M 0s 2024-03-08T20:31:44.849 INFO:tasks.workunit.client.1.smithi144.stderr:130050K .......... .......... .......... .......... .......... 95% 22.4M 0s 2024-03-08T20:31:44.851 INFO:tasks.workunit.client.1.smithi144.stderr:130100K .......... .......... .......... .......... .......... 95% 28.7M 0s 2024-03-08T20:31:44.852 INFO:tasks.workunit.client.1.smithi144.stderr:130150K .......... .......... .......... .......... .......... 95% 33.2M 0s 2024-03-08T20:31:44.853 INFO:tasks.workunit.client.0.smithi118.stdout:checking for stdlib.h... yes 2024-03-08T20:31:44.855 INFO:tasks.workunit.client.1.smithi144.stderr:130200K .......... .......... .......... .......... .......... 95% 30.4M 0s 2024-03-08T20:31:44.856 INFO:tasks.workunit.client.1.smithi144.stderr:130250K .......... .......... .......... .......... .......... 95% 30.2M 0s 2024-03-08T20:31:44.857 INFO:tasks.workunit.client.1.smithi144.stderr:130300K .......... .......... .......... .......... .......... 96% 27.2M 0s 2024-03-08T20:31:44.860 INFO:tasks.workunit.client.1.smithi144.stderr:130350K .......... .......... .......... .......... .......... 96% 25.9M 0s 2024-03-08T20:31:44.861 INFO:tasks.workunit.client.1.smithi144.stderr:130400K .......... .......... .......... .......... .......... 96% 26.2M 0s 2024-03-08T20:31:44.863 INFO:tasks.workunit.client.1.smithi144.stderr:130450K .......... .......... .......... .......... .......... 96% 30.4M 0s 2024-03-08T20:31:44.866 INFO:tasks.workunit.client.1.smithi144.stderr:130500K .......... .......... .......... .......... .......... 96% 38.5M 0s 2024-03-08T20:31:44.866 INFO:tasks.workunit.client.1.smithi144.stderr:130550K .......... .......... .......... .......... .......... 96% 26.3M 0s 2024-03-08T20:31:44.868 INFO:tasks.workunit.client.1.smithi144.stderr:130600K .......... .......... .......... .......... .......... 96% 28.2M 0s 2024-03-08T20:31:44.869 INFO:tasks.workunit.client.1.smithi144.stderr:130650K .......... .......... .......... .......... .......... 96% 32.8M 0s 2024-03-08T20:31:44.872 INFO:tasks.workunit.client.1.smithi144.stderr:130700K .......... .......... .......... .......... .......... 96% 24.7M 0s 2024-03-08T20:31:44.876 INFO:tasks.workunit.client.1.smithi144.stderr:130750K .......... .......... .......... .......... .......... 96% 24.8M 0s 2024-03-08T20:31:44.876 INFO:tasks.workunit.client.1.smithi144.stderr:130800K .......... .......... .......... .......... .......... 96% 49.4M 0s 2024-03-08T20:31:44.877 INFO:tasks.workunit.client.1.smithi144.stderr:130850K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-03-08T20:31:44.878 INFO:tasks.workunit.client.1.smithi144.stderr:130900K .......... .......... .......... .......... .......... 96% 31.0M 0s 2024-03-08T20:31:44.880 INFO:tasks.workunit.client.1.smithi144.stderr:130950K .......... .......... .......... .......... .......... 96% 25.1M 0s 2024-03-08T20:31:44.883 INFO:tasks.workunit.client.1.smithi144.stderr:131000K .......... .......... .......... .......... .......... 96% 25.5M 0s 2024-03-08T20:31:44.883 INFO:tasks.workunit.client.1.smithi144.stderr:131050K .......... .......... .......... .......... .......... 96% 46.8M 0s 2024-03-08T20:31:44.884 INFO:tasks.workunit.client.1.smithi144.stderr:131100K .......... .......... .......... .......... .......... 96% 26.3M 0s 2024-03-08T20:31:44.886 INFO:tasks.workunit.client.1.smithi144.stderr:131150K .......... .......... .......... .......... .......... 96% 34.2M 0s 2024-03-08T20:31:44.888 INFO:tasks.workunit.client.1.smithi144.stderr:131200K .......... .......... .......... .......... .......... 96% 25.1M 0s 2024-03-08T20:31:44.891 INFO:tasks.workunit.client.1.smithi144.stderr:131250K .......... .......... .......... .......... .......... 96% 24.6M 0s 2024-03-08T20:31:44.891 INFO:tasks.workunit.client.1.smithi144.stderr:131300K .......... .......... .......... .......... .......... 96% 56.4M 0s 2024-03-08T20:31:44.893 INFO:tasks.workunit.client.1.smithi144.stderr:131350K .......... .......... .......... .......... .......... 96% 22.5M 0s 2024-03-08T20:31:44.895 INFO:tasks.workunit.client.1.smithi144.stderr:131400K .......... .......... .......... .......... .......... 96% 27.6M 0s 2024-03-08T20:31:44.896 INFO:tasks.workunit.client.1.smithi144.stderr:131450K .......... .......... .......... .......... .......... 96% 27.8M 0s 2024-03-08T20:31:44.899 INFO:tasks.workunit.client.1.smithi144.stderr:131500K .......... .......... .......... .......... .......... 96% 26.7M 0s 2024-03-08T20:31:44.900 INFO:tasks.workunit.client.1.smithi144.stderr:131550K .......... .......... .......... .......... .......... 96% 39.2M 0s 2024-03-08T20:31:44.901 INFO:tasks.workunit.client.1.smithi144.stderr:131600K .......... .......... .......... .......... .......... 96% 27.1M 0s 2024-03-08T20:31:44.903 INFO:tasks.workunit.client.1.smithi144.stderr:131650K .......... .......... .......... .......... .......... 97% 34.7M 0s 2024-03-08T20:31:44.904 INFO:tasks.workunit.client.1.smithi144.stderr:131700K .......... .......... .......... .......... .......... 97% 25.8M 0s 2024-03-08T20:31:44.908 INFO:tasks.workunit.client.1.smithi144.stderr:131750K .......... .......... .......... .......... .......... 97% 25.4M 0s 2024-03-08T20:31:44.908 INFO:tasks.workunit.client.1.smithi144.stderr:131800K .......... .......... .......... .......... .......... 97% 41.9M 0s 2024-03-08T20:31:44.909 INFO:tasks.workunit.client.1.smithi144.stderr:131850K .......... .......... .......... .......... .......... 97% 25.5M 0s 2024-03-08T20:31:44.911 INFO:tasks.workunit.client.1.smithi144.stderr:131900K .......... .......... .......... .......... .......... 97% 31.2M 0s 2024-03-08T20:31:44.913 INFO:tasks.workunit.client.1.smithi144.stderr:131950K .......... .......... .......... .......... .......... 97% 25.0M 0s 2024-03-08T20:31:44.915 INFO:tasks.workunit.client.1.smithi144.stderr:132000K .......... .......... .......... .......... .......... 97% 26.4M 0s 2024-03-08T20:31:44.916 INFO:tasks.workunit.client.1.smithi144.stderr:132050K .......... .......... .......... .......... .......... 97% 38.9M 0s 2024-03-08T20:31:44.919 INFO:tasks.workunit.client.1.smithi144.stderr:132100K .......... .......... .......... .......... .......... 97% 26.1M 0s 2024-03-08T20:31:44.920 INFO:tasks.workunit.client.1.smithi144.stderr:132150K .......... .......... .......... .......... .......... 97% 27.4M 0s 2024-03-08T20:31:44.921 INFO:tasks.workunit.client.1.smithi144.stderr:132200K .......... .......... .......... .......... .......... 97% 33.7M 0s 2024-03-08T20:31:44.923 INFO:tasks.workunit.client.1.smithi144.stderr:132250K .......... .......... .......... .......... .......... 97% 23.9M 0s 2024-03-08T20:31:44.924 INFO:tasks.workunit.client.1.smithi144.stderr:132300K .......... .......... .......... .......... .......... 97% 44.7M 0s 2024-03-08T20:31:44.926 INFO:tasks.workunit.client.1.smithi144.stderr:132350K .......... .......... .......... .......... .......... 97% 27.7M 0s 2024-03-08T20:31:44.929 INFO:tasks.workunit.client.1.smithi144.stderr:132400K .......... .......... .......... .......... .......... 97% 29.6M 0s 2024-03-08T20:31:44.930 INFO:tasks.workunit.client.1.smithi144.stderr:132450K .......... .......... .......... .......... .......... 97% 25.9M 0s 2024-03-08T20:31:44.932 INFO:tasks.workunit.client.1.smithi144.stderr:132500K .......... .......... .......... .......... .......... 97% 22.3M 0s 2024-03-08T20:31:44.933 INFO:tasks.workunit.client.1.smithi144.stderr:132550K .......... .......... .......... .......... .......... 97% 40.9M 0s 2024-03-08T20:31:44.935 INFO:tasks.workunit.client.1.smithi144.stderr:132600K .......... .......... .......... .......... .......... 97% 23.3M 0s 2024-03-08T20:31:44.937 INFO:tasks.workunit.client.1.smithi144.stderr:132650K .......... .......... .......... .......... .......... 97% 44.7M 0s 2024-03-08T20:31:44.938 INFO:tasks.workunit.client.1.smithi144.stderr:132700K .......... .......... .......... .......... .......... 97% 27.8M 0s 2024-03-08T20:31:44.940 INFO:tasks.workunit.client.1.smithi144.stderr:132750K .......... .......... .......... .......... .......... 97% 22.5M 0s 2024-03-08T20:31:44.941 INFO:tasks.workunit.client.1.smithi144.stderr:132800K .......... .......... .......... .......... .......... 97% 41.8M 0s 2024-03-08T20:31:44.944 INFO:tasks.workunit.client.1.smithi144.stderr:132850K .......... .......... .......... .......... .......... 97% 25.1M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:132900K .......... .......... .......... .......... .......... 97% 24.9M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:132950K .......... .......... .......... .......... .......... 97% 35.0M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133000K .......... .......... .......... .......... .......... 98% 24.8M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133050K .......... .......... .......... .......... .......... 98% 44.8M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133100K .......... .......... .......... .......... .......... 98% 28.8M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133150K .......... .......... .......... .......... .......... 98% 24.2M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133200K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-03-08T20:31:44.983 INFO:tasks.workunit.client.1.smithi144.stderr:133250K .......... .......... .......... .......... .......... 98% 54.2M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133300K .......... .......... .......... .......... .......... 98% 29.6M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133350K .......... .......... .......... .......... .......... 98% 19.3M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133400K .......... .......... .......... .......... .......... 98% 46.1M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133450K .......... .......... .......... .......... .......... 98% 23.2M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133500K .......... .......... .......... .......... .......... 98% 41.8M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133550K .......... .......... .......... .......... .......... 98% 30.8M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133600K .......... .......... .......... .......... .......... 98% 21.4M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133650K .......... .......... .......... .......... .......... 98% 40.0M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133700K .......... .......... .......... .......... .......... 98% 22.4M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133750K .......... .......... .......... .......... .......... 98% 38.6M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133800K .......... .......... .......... .......... .......... 98% 28.1M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133850K .......... .......... .......... .......... .......... 98% 27.3M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133900K .......... .......... .......... .......... .......... 98% 23.7M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:133950K .......... .......... .......... .......... .......... 98% 33.2M 0s 2024-03-08T20:31:44.984 INFO:tasks.workunit.client.1.smithi144.stderr:134000K .......... .......... .......... .......... .......... 98% 23.5M 0s 2024-03-08T20:31:44.988 INFO:tasks.workunit.client.1.smithi144.stderr:134050K .......... .......... .......... .......... .......... 98% 38.2M 0s 2024-03-08T20:31:44.988 INFO:tasks.workunit.client.1.smithi144.stderr:134100K .......... .......... .......... .......... .......... 98% 25.7M 0s 2024-03-08T20:31:44.988 INFO:tasks.workunit.client.1.smithi144.stderr:134150K .......... .......... .......... .......... .......... 98% 32.6M 0s 2024-03-08T20:31:44.990 INFO:tasks.workunit.client.1.smithi144.stderr:134200K .......... .......... .......... .......... .......... 98% 23.7M 0s 2024-03-08T20:31:44.990 INFO:tasks.workunit.client.1.smithi144.stderr:134250K .......... .......... .......... .......... .......... 98% 49.1M 0s 2024-03-08T20:31:44.993 INFO:tasks.workunit.client.1.smithi144.stderr:134300K .......... .......... .......... .......... .......... 98% 27.9M 0s 2024-03-08T20:31:44.994 INFO:tasks.workunit.client.1.smithi144.stderr:134350K .......... .......... .......... .......... .......... 99% 22.2M 0s 2024-03-08T20:31:44.996 INFO:tasks.workunit.client.1.smithi144.stderr:134400K .......... .......... .......... .......... .......... 99% 28.8M 0s 2024-03-08T20:31:44.998 INFO:tasks.workunit.client.1.smithi144.stderr:134450K .......... .......... .......... .......... .......... 99% 28.6M 0s 2024-03-08T20:31:44.999 INFO:tasks.workunit.client.1.smithi144.stderr:134500K .......... .......... .......... .......... .......... 99% 39.0M 0s 2024-03-08T20:31:45.005 INFO:tasks.workunit.client.1.smithi144.stderr:134550K .......... .......... .......... .......... .......... 99% 28.0M 0s 2024-03-08T20:31:45.006 INFO:tasks.workunit.client.1.smithi144.stderr:134600K .......... .......... .......... .......... .......... 99% 22.9M 0s 2024-03-08T20:31:45.006 INFO:tasks.workunit.client.1.smithi144.stderr:134650K .......... .......... .......... .......... .......... 99% 32.6M 0s 2024-03-08T20:31:45.015 INFO:tasks.workunit.client.1.smithi144.stderr:134700K .......... .......... .......... .......... .......... 99% 23.9M 0s 2024-03-08T20:31:45.015 INFO:tasks.workunit.client.1.smithi144.stderr:134750K .......... .......... .......... .......... .......... 99% 43.5M 0s 2024-03-08T20:31:45.016 INFO:tasks.workunit.client.1.smithi144.stderr:134800K .......... .......... .......... .......... .......... 99% 30.9M 0s 2024-03-08T20:31:45.016 INFO:tasks.workunit.client.1.smithi144.stderr:134850K .......... .......... .......... .......... .......... 99% 26.1M 0s 2024-03-08T20:31:45.016 INFO:tasks.workunit.client.1.smithi144.stderr:134900K .......... .......... .......... .......... .......... 99% 26.4M 0s 2024-03-08T20:31:45.016 INFO:tasks.workunit.client.1.smithi144.stderr:134950K .......... .......... .......... .......... .......... 99% 27.6M 0s 2024-03-08T20:31:45.016 INFO:tasks.workunit.client.1.smithi144.stderr:135000K .......... .......... .......... .......... .......... 99% 45.9M 0s 2024-03-08T20:31:45.017 INFO:tasks.workunit.client.1.smithi144.stderr:135050K .......... .......... .......... .......... .......... 99% 26.9M 0s 2024-03-08T20:31:45.019 INFO:tasks.workunit.client.1.smithi144.stderr:135100K .......... .......... .......... .......... .......... 99% 25.7M 0s 2024-03-08T20:31:45.022 INFO:tasks.workunit.client.1.smithi144.stderr:135150K .......... .......... .......... .......... .......... 99% 23.1M 0s 2024-03-08T20:31:45.023 INFO:tasks.workunit.client.1.smithi144.stderr:135200K .......... .......... .......... .......... .......... 99% 34.8M 0s 2024-03-08T20:31:45.024 INFO:tasks.workunit.client.1.smithi144.stderr:135250K .......... .......... .......... .......... .......... 99% 28.7M 0s 2024-03-08T20:31:45.026 INFO:tasks.workunit.client.1.smithi144.stderr:135300K .......... .......... .......... .......... .......... 99% 35.7M 0s 2024-03-08T20:31:45.027 INFO:tasks.workunit.client.1.smithi144.stderr:135350K .......... .......... .......... .......... .......... 99% 26.8M 0s 2024-03-08T20:31:45.030 INFO:tasks.workunit.client.1.smithi144.stderr:135400K .......... .......... .......... .......... .......... 99% 28.6M 0s 2024-03-08T20:31:45.031 INFO:tasks.workunit.client.1.smithi144.stderr:135450K .......... .......... .......... .......... .......... 99% 25.3M 0s 2024-03-08T20:31:45.034 INFO:tasks.workunit.client.1.smithi144.stderr:135500K .......... .......... .......... .......... .......... 99% 20.1M 0s 2024-03-08T20:31:45.036 INFO:tasks.workunit.client.1.smithi144.stderr:135550K .......... .......... .......... .......... .......... 99% 31.2M 0s 2024-03-08T20:31:45.037 INFO:tasks.workunit.client.1.smithi144.stderr:135600K .......... .......... .......... .......... .......... 99% 27.5M 0s 2024-03-08T20:31:45.039 INFO:tasks.workunit.client.1.smithi144.stderr:135650K .......... .......... .......... .......... .......... 99% 26.0M 0s 2024-03-08T20:31:45.044 INFO:tasks.workunit.client.1.smithi144.stderr:135700K .......... .......... .......... .......... .......... 99% 29.8M 0s 2024-03-08T20:31:45.044 INFO:tasks.workunit.client.1.smithi144.stderr:135750K .. 100% 5.30T=4.9s 2024-03-08T20:31:45.044 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:45.044 INFO:tasks.workunit.client.1.smithi144.stderr:2024-03-08 20:31:45 (27.2 MB/s) - ‘linux.tar.xz’ saved [139010916/139010916] 2024-03-08T20:31:45.045 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:31:45.045 INFO:tasks.workunit.client.1.smithi144.stderr:+ mkdir t 2024-03-08T20:31:45.050 INFO:tasks.workunit.client.1.smithi144.stderr:+ cd t 2024-03-08T20:31:45.050 INFO:tasks.workunit.client.1.smithi144.stderr:+ tar xJf ../linux.tar.xz 2024-03-08T20:31:45.078 INFO:tasks.workunit.client.0.smithi118.stdout:checking for string.h... yes 2024-03-08T20:31:45.406 INFO:tasks.workunit.client.0.smithi118.stdout:checking for memory.h... yes 2024-03-08T20:31:46.127 INFO:tasks.workunit.client.0.smithi118.stdout:checking for strings.h... yes 2024-03-08T20:31:47.953 INFO:tasks.workunit.client.0.smithi118.stdout:checking for inttypes.h... yes 2024-03-08T20:31:48.879 INFO:tasks.workunit.client.0.smithi118.stdout:checking for stdint.h... yes 2024-03-08T20:31:49.811 INFO:tasks.workunit.client.0.smithi118.stdout:checking for unistd.h... yes 2024-03-08T20:31:51.142 INFO:tasks.workunit.client.0.smithi118.stdout:checking for memory.h... (cached) yes 2024-03-08T20:31:51.190 INFO:tasks.workunit.client.0.smithi118.stdout:checking for strings.h... (cached) yes 2024-03-08T20:31:51.235 INFO:tasks.workunit.client.0.smithi118.stdout:checking for unistd.h... (cached) yes 2024-03-08T20:31:51.512 INFO:tasks.workunit.client.0.smithi118.stdout:checking locale.h usability... yes 2024-03-08T20:31:51.574 INFO:tasks.workunit.client.0.smithi118.stdout:checking locale.h presence... yes 2024-03-08T20:31:51.576 INFO:tasks.workunit.client.0.smithi118.stdout:checking for locale.h... yes 2024-03-08T20:31:51.828 INFO:tasks.workunit.client.0.smithi118.stdout:checking for stdlib.h... (cached) yes 2024-03-08T20:31:51.873 INFO:tasks.workunit.client.0.smithi118.stdout:checking for string.h... (cached) yes 2024-03-08T20:31:52.077 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/socket.h usability... yes 2024-03-08T20:31:52.172 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/socket.h presence... yes 2024-03-08T20:31:52.179 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/socket.h... yes 2024-03-08T20:31:52.679 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/time.h usability... yes 2024-03-08T20:31:52.763 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/time.h presence... yes 2024-03-08T20:31:52.770 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/time.h... yes 2024-03-08T20:31:52.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:31:52.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:31:53.510 INFO:tasks.workunit.client.0.smithi118.stdout:checking fcntl.h usability... yes 2024-03-08T20:31:53.589 INFO:tasks.workunit.client.0.smithi118.stdout:checking fcntl.h presence... yes 2024-03-08T20:31:53.593 INFO:tasks.workunit.client.0.smithi118.stdout:checking for fcntl.h... yes 2024-03-08T20:31:54.342 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/fcntl.h usability... yes 2024-03-08T20:31:54.407 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/fcntl.h presence... yes 2024-03-08T20:31:54.410 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/fcntl.h... yes 2024-03-08T20:31:55.775 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/param.h usability... yes 2024-03-08T20:31:55.890 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/param.h presence... yes 2024-03-08T20:31:55.897 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/param.h... yes 2024-03-08T20:31:57.567 INFO:tasks.workunit.client.0.smithi118.stdout:checking ioctl.h usability... no 2024-03-08T20:31:57.646 INFO:tasks.workunit.client.0.smithi118.stdout:checking ioctl.h presence... no 2024-03-08T20:31:57.650 INFO:tasks.workunit.client.0.smithi118.stdout:checking for ioctl.h... no 2024-03-08T20:31:57.852 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/ioctl.h usability... yes 2024-03-08T20:31:57.940 INFO:tasks.workunit.client.0.smithi118.stdout:checking sys/ioctl.h presence... yes 2024-03-08T20:31:57.945 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sys/ioctl.h... yes 2024-03-08T20:31:58.857 INFO:tasks.workunit.client.0.smithi118.stdout:checking return type of signal handlers... void 2024-03-08T20:31:59.064 INFO:tasks.workunit.client.0.smithi118.stdout:checking for size_t... yes 2024-03-08T20:31:59.259 INFO:tasks.workunit.client.0.smithi118.stdout:checking for dev_t... yes 2024-03-08T20:31:59.459 INFO:tasks.workunit.client.0.smithi118.stdout:checking for short... yes 2024-03-08T20:32:00.735 INFO:tasks.workunit.client.0.smithi118.stdout:checking size of short... 2 2024-03-08T20:32:01.984 INFO:tasks.workunit.client.0.smithi118.stdout:checking for int... yes 2024-03-08T20:32:03.123 INFO:tasks.workunit.client.0.smithi118.stdout:checking size of int... 4 2024-03-08T20:32:04.008 INFO:tasks.workunit.client.0.smithi118.stdout:checking for long... yes 2024-03-08T20:32:05.641 INFO:tasks.workunit.client.0.smithi118.stdout:checking size of long... 8 2024-03-08T20:32:07.256 INFO:tasks.workunit.client.0.smithi118.stdout:checking for long long... yes 2024-03-08T20:32:08.449 INFO:tasks.workunit.client.0.smithi118.stdout:checking size of long long... 8 2024-03-08T20:32:09.030 INFO:tasks.workunit.client.0.smithi118.stdout:checking for ssize_t... yes 2024-03-08T20:32:09.182 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sig_atomic_t... yes 2024-03-08T20:32:11.224 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether gcc needs -traditional... no 2024-03-08T20:32:11.386 INFO:tasks.workunit.client.0.smithi118.stdout:checking for an ANSI C-conforming const... yes 2024-03-08T20:32:11.522 INFO:tasks.workunit.client.0.smithi118.stdout:checking for inline... inline 2024-03-08T20:32:13.999 INFO:tasks.workunit.client.0.smithi118.stdout:checking for working alloca.h... yes 2024-03-08T20:32:14.738 INFO:tasks.workunit.client.0.smithi118.stdout:checking for alloca... yes 2024-03-08T20:32:16.104 INFO:tasks.workunit.client.0.smithi118.stdout:checking for working memcmp... yes 2024-03-08T20:32:17.554 INFO:tasks.workunit.client.0.smithi118.stdout:checking for strftime... yes 2024-03-08T20:32:18.736 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-03-08T20:32:22.522 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether stat accepts an empty string... no 2024-03-08T20:32:23.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:32:23.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:32:25.278 INFO:tasks.workunit.client.0.smithi118.stdout:checking for vprintf... yes 2024-03-08T20:32:27.889 INFO:tasks.workunit.client.0.smithi118.stdout:checking for _doprnt... no 2024-03-08T20:32:27.980 INFO:tasks.workunit.client.0.smithi118.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-08T20:32:28.027 INFO:tasks.workunit.client.0.smithi118.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-08T20:32:28.282 INFO:tasks.workunit.client.0.smithi118.stdout:checking for the pthreads library -lpthreads... no 2024-03-08T20:32:28.518 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether pthreads work without any flags... yes 2024-03-08T20:32:28.753 INFO:tasks.workunit.client.0.smithi118.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-03-08T20:32:28.755 INFO:tasks.workunit.client.0.smithi118.stdout:checking if more special flags are required for pthreads... no 2024-03-08T20:32:28.758 INFO:tasks.workunit.client.0.smithi118.stdout:checking for cc_r... gcc 2024-03-08T20:32:30.722 INFO:tasks.workunit.client.0.smithi118.stdout:checking for setrlimit... yes 2024-03-08T20:32:31.419 INFO:tasks.workunit.client.0.smithi118.stdout:checking for setproctitle... no 2024-03-08T20:32:32.049 INFO:tasks.workunit.client.0.smithi118.stdout:checking for getopt_long... yes 2024-03-08T20:32:32.807 INFO:tasks.workunit.client.0.smithi118.stdout:checking for strtoull... yes 2024-03-08T20:32:33.631 INFO:tasks.workunit.client.0.smithi118.stdout:checking for strtoq... yes 2024-03-08T20:32:34.623 INFO:tasks.workunit.client.0.smithi118.stdout:checking for snprintf... yes 2024-03-08T20:32:35.875 INFO:tasks.workunit.client.0.smithi118.stdout:checking for vsnprintf... yes 2024-03-08T20:32:37.165 INFO:tasks.workunit.client.0.smithi118.stdout:checking for vfprintf... yes 2024-03-08T20:32:38.564 INFO:tasks.workunit.client.0.smithi118.stdout:checking for gethostname... yes 2024-03-08T20:32:39.022 INFO:tasks.workunit.client.0.smithi118.stdout:checking for setlocale... yes 2024-03-08T20:32:40.280 INFO:tasks.workunit.client.0.smithi118.stdout:checking for sync... yes 2024-03-08T20:32:43.090 INFO:tasks.workunit.client.0.smithi118.stdout:checking whether snprintf is C99 conformant... done 2024-03-08T20:32:43.802 INFO:tasks.workunit.client.0.smithi118.stdout:configure: creating ./config.status 2024-03-08T20:32:47.827 INFO:tasks.workunit.client.0.smithi118.stdout:config.status: creating Makefile 2024-03-08T20:32:47.905 INFO:tasks.workunit.client.0.smithi118.stdout:config.status: creating src/Makefile 2024-03-08T20:32:48.047 INFO:tasks.workunit.client.0.smithi118.stdout:config.status: creating man/Makefile 2024-03-08T20:32:48.185 INFO:tasks.workunit.client.0.smithi118.stdout:config.status: creating config.h 2024-03-08T20:32:49.159 INFO:tasks.workunit.client.0.smithi118.stdout:config.status: executing depfiles commands 2024-03-08T20:32:51.813 INFO:tasks.workunit.client.0.smithi118.stderr:+ make 2024-03-08T20:32:52.916 INFO:tasks.workunit.client.0.smithi118.stdout:make all-recursive 2024-03-08T20:32:52.968 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-08T20:32:52.987 INFO:tasks.workunit.client.0.smithi118.stdout:Making all in src 2024-03-08T20:32:53.161 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-03-08T20:32:53.161 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-03-08T20:32:53.161 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-03-08T20:32:53.565 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-03-08T20:32:53.565 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-03-08T20:32:53.883 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-03-08T20:32:53.883 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-03-08T20:32:54.169 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-03-08T20:32:54.169 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-03-08T20:32:54.500 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-03-08T20:32:54.500 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-03-08T20:32:54.733 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-03-08T20:32:54.733 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-03-08T20:32:54.786 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:32:54.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:32:55.535 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-03-08T20:32:55.535 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-03-08T20:32:56.019 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-03-08T20:32:56.019 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-03-08T20:32:56.278 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-03-08T20:32:56.278 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-03-08T20:32:56.423 INFO:tasks.workunit.client.0.smithi118.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-03-08T20:32:56.423 INFO:tasks.workunit.client.0.smithi118.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-03-08T20:32:56.562 INFO:tasks.workunit.client.0.smithi118.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-03-08T20:33:00.507 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-03-08T20:33:00.510 INFO:tasks.workunit.client.0.smithi118.stdout:Making all in man 2024-03-08T20:33:00.586 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-03-08T20:33:00.586 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Nothing to be done for 'all'. 2024-03-08T20:33:00.586 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-03-08T20:33:00.639 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-08T20:33:00.653 INFO:tasks.workunit.client.0.smithi118.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-08T20:33:00.655 INFO:tasks.workunit.client.0.smithi118.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-08T20:33:00.659 INFO:tasks.workunit.client.0.smithi118.stderr:+ cd src 2024-03-08T20:33:00.671 INFO:tasks.workunit.client.0.smithi118.stderr:+ mkdir blogtest_in 2024-03-08T20:33:00.680 INFO:tasks.workunit.client.0.smithi118.stdout:running blogbench 2024-03-08T20:33:00.680 INFO:tasks.workunit.client.0.smithi118.stderr:+ echo 'running blogbench' 2024-03-08T20:33:00.680 INFO:tasks.workunit.client.0.smithi118.stderr:+ ./blogbench -d blogtest_in 2024-03-08T20:33:00.683 INFO:tasks.workunit.client.0.smithi118.stdout: 2024-03-08T20:33:00.683 INFO:tasks.workunit.client.0.smithi118.stdout:Frequency = 10 secs 2024-03-08T20:33:00.684 INFO:tasks.workunit.client.0.smithi118.stdout:Scratch dir = [blogtest_in] 2024-03-08T20:33:03.097 INFO:tasks.workunit.client.0.smithi118.stdout:Spawning 3 writers... 2024-03-08T20:33:03.097 INFO:tasks.workunit.client.0.smithi118.stdout:Spawning 1 rewriters... 2024-03-08T20:33:03.097 INFO:tasks.workunit.client.0.smithi118.stdout:Spawning 5 commenters... 2024-03-08T20:33:03.097 INFO:tasks.workunit.client.0.smithi118.stdout:Spawning 100 readers... 2024-03-08T20:33:03.103 INFO:tasks.workunit.client.0.smithi118.stdout:Benchmarking for 30 iterations. 2024-03-08T20:33:03.103 INFO:tasks.workunit.client.0.smithi118.stdout:The test will run during 5 minutes. 2024-03-08T20:33:03.103 INFO:tasks.workunit.client.0.smithi118.stdout: 2024-03-08T20:33:03.103 INFO:tasks.workunit.client.0.smithi118.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-03-08T20:33:13.103 INFO:tasks.workunit.client.0.smithi118.stdout: 1 8258 271 7728 97 1855 248 2024-03-08T20:33:23.103 INFO:tasks.workunit.client.0.smithi118.stdout: 2 7950 17 6430 112 2939 146 2024-03-08T20:33:25.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:33:25.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:33:33.103 INFO:tasks.workunit.client.0.smithi118.stdout: 4 8943 134 5701 149 2851 370 2024-03-08T20:33:43.104 INFO:tasks.workunit.client.0.smithi118.stdout: 6 8079 46 5554 120 2556 163 2024-03-08T20:33:53.104 INFO:tasks.workunit.client.0.smithi118.stdout: 8 9381 115 6905 45 2379 173 2024-03-08T20:33:55.516 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:33:55.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:34:03.104 INFO:tasks.workunit.client.0.smithi118.stdout: 8 8595 58 6201 41 2574 146 2024-03-08T20:34:13.105 INFO:tasks.workunit.client.0.smithi118.stdout: 9 4581 43 3082 11 1485 54 2024-03-08T20:34:23.104 INFO:tasks.workunit.client.0.smithi118.stdout: 9 6966 32 5718 12 2512 58 2024-03-08T20:34:26.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:34:26.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:34:33.104 INFO:tasks.workunit.client.0.smithi118.stdout: 9 5164 24 3787 23 2394 56 2024-03-08T20:34:43.104 INFO:tasks.workunit.client.0.smithi118.stdout: 11 6754 17 4541 22 2694 38 2024-03-08T20:34:53.104 INFO:tasks.workunit.client.0.smithi118.stdout: 11 4334 27 3325 13 2472 32 2024-03-08T20:34:56.854 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:34:56.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:35:03.104 INFO:tasks.workunit.client.0.smithi118.stdout: 12 4539 30 3060 7 2140 34 2024-03-08T20:35:13.104 INFO:tasks.workunit.client.0.smithi118.stdout: 13 3222 47 1227 18 804 53 2024-03-08T20:35:23.104 INFO:tasks.workunit.client.0.smithi118.stdout: 13 3421 26 2504 6 1080 26 2024-03-08T20:35:27.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:35:27.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:35:33.107 INFO:tasks.workunit.client.0.smithi118.stdout: 14 2754 27 1605 12 1036 31 2024-03-08T20:35:43.104 INFO:tasks.workunit.client.0.smithi118.stdout: 14 2359 18 1273 2 790 18 2024-03-08T20:35:53.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 2344 14 1578 0 1236 8 2024-03-08T20:36:01.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:36:01.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:36:03.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 2548 7 1794 1 838 7 2024-03-08T20:36:04.113 INFO:tasks.ceph.mds.b.smithi144.stderr:2024-03-08T20:36:04.110+0000 7fd690c00640 -1 Fail to open '/proc/41770/cmdline' error = (2) No such file or directory 2024-03-08T20:36:04.114 INFO:tasks.ceph.mds.b.smithi144.stderr:2024-03-08T20:36:04.110+0000 7fd690c00640 -1 received signal: Hangup from (PID: 41770) UID: 0 2024-03-08T20:36:04.114 INFO:tasks.ceph.mds.d.smithi144.stderr:2024-03-08T20:36:04.110+0000 7fe645a00640 -1 Fail to open '/proc/41770/cmdline' error = (2) No such file or directory 2024-03-08T20:36:04.114 INFO:tasks.ceph.mds.d.smithi144.stderr:2024-03-08T20:36:04.110+0000 7fe645a00640 -1 received signal: Hangup from (PID: 41770) UID: 0 2024-03-08T20:36:13.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 4628 15 2931 2 2167 13 2024-03-08T20:36:23.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 1308 6 904 2 303 7 2024-03-08T20:36:33.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 4237 3 3136 2 1571 4 2024-03-08T20:36:43.105 INFO:tasks.workunit.client.0.smithi118.stdout: 14 1332 11 733 1 606 13 2024-03-08T20:36:53.106 INFO:tasks.workunit.client.0.smithi118.stdout: 14 3427 3 2191 2 855 6 2024-03-08T20:37:03.106 INFO:tasks.workunit.client.0.smithi118.stdout: 14 2861 28 1439 8 1060 31 2024-03-08T20:37:05.236 INFO:tasks.workunit.client.1.smithi144.stderr:+ cd linux-6.5.11 2024-03-08T20:37:05.236 INFO:tasks.workunit.client.1.smithi144.stderr:+ make defconfig 2024-03-08T20:37:06.609 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/basic/fixdep 2024-03-08T20:37:07.087 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/conf.o 2024-03-08T20:37:13.106 INFO:tasks.workunit.client.0.smithi118.stdout: 14 5918 79 2991 44 1748 136 2024-03-08T20:37:14.038 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/confdata.o 2024-03-08T20:37:19.571 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/expr.o 2024-03-08T20:37:19.955 INFO:tasks.workunit.client.1.smithi144.stdout: LEX scripts/kconfig/lexer.lex.c 2024-03-08T20:37:19.986 INFO:tasks.workunit.client.1.smithi144.stdout: YACC scripts/kconfig/parser.tab.[ch] 2024-03-08T20:37:20.135 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/lexer.lex.o 2024-03-08T20:37:20.588 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/menu.o 2024-03-08T20:37:20.841 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/parser.tab.o 2024-03-08T20:37:21.123 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/preprocess.o 2024-03-08T20:37:21.282 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/symbol.o 2024-03-08T20:37:21.657 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kconfig/util.o 2024-03-08T20:37:21.763 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTLD scripts/kconfig/conf 2024-03-08T20:37:21.818 INFO:tasks.workunit.client.1.smithi144.stdout:*** Default configuration is based on 'x86_64_defconfig' 2024-03-08T20:37:23.106 INFO:tasks.workunit.client.0.smithi118.stdout: 14 4700 4 2943 23 1792 31 2024-03-08T20:37:33.106 INFO:tasks.workunit.client.0.smithi118.stdout: 14 8237 14 5059 61 2115 80 2024-03-08T20:37:36.859 INFO:tasks.workunit.client.1.smithi144.stdout:# 2024-03-08T20:37:36.859 INFO:tasks.workunit.client.1.smithi144.stdout:# configuration written to .config 2024-03-08T20:37:36.859 INFO:tasks.workunit.client.1.smithi144.stdout:# 2024-03-08T20:37:36.868 INFO:tasks.workunit.client.1.smithi144.stderr:++ grep -c processor /proc/cpuinfo 2024-03-08T20:37:36.873 INFO:tasks.workunit.client.1.smithi144.stderr:+ make -j8 2024-03-08T20:37:39.352 INFO:tasks.workunit.client.1.smithi144.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_32.h 2024-03-08T20:37:39.353 INFO:tasks.workunit.client.1.smithi144.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_64.h 2024-03-08T20:37:39.355 INFO:tasks.workunit.client.1.smithi144.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_x32.h 2024-03-08T20:37:39.356 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/bpf_perf_event.h 2024-03-08T20:37:39.360 INFO:tasks.workunit.client.1.smithi144.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_32.h 2024-03-08T20:37:39.360 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/errno.h 2024-03-08T20:37:39.365 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/fcntl.h 2024-03-08T20:37:39.365 INFO:tasks.workunit.client.1.smithi144.stdout: SYSHDR arch/x86/include/generated/asm/unistd_32_ia32.h 2024-03-08T20:37:39.371 INFO:tasks.workunit.client.1.smithi144.stdout: GEN arch/x86/include/generated/asm/orc_hash.h 2024-03-08T20:37:39.371 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctl.h 2024-03-08T20:37:39.378 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctls.h 2024-03-08T20:37:39.383 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/ipcbuf.h 2024-03-08T20:37:39.390 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/param.h 2024-03-08T20:37:39.396 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/poll.h 2024-03-08T20:37:39.415 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/resource.h 2024-03-08T20:37:39.431 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/socket.h 2024-03-08T20:37:39.446 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/sockios.h 2024-03-08T20:37:39.452 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/termbits.h 2024-03-08T20:37:39.457 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/termios.h 2024-03-08T20:37:39.468 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/uapi/asm/types.h 2024-03-08T20:37:39.474 INFO:tasks.workunit.client.1.smithi144.stdout: SYSHDR arch/x86/include/generated/asm/unistd_64_x32.h 2024-03-08T20:37:39.478 INFO:tasks.workunit.client.1.smithi144.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_64.h 2024-03-08T20:37:39.510 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC arch/x86/tools/relocs_32.o 2024-03-08T20:37:39.512 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC arch/x86/tools/relocs_64.o 2024-03-08T20:37:39.512 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC arch/x86/tools/relocs_common.o 2024-03-08T20:37:39.530 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/early_ioremap.h 2024-03-08T20:37:39.540 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/export.h 2024-03-08T20:37:39.544 INFO:tasks.workunit.client.1.smithi144.stdout: UPD include/generated/uapi/linux/version.h 2024-03-08T20:37:39.546 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/mcs_spinlock.h 2024-03-08T20:37:39.551 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/irq_regs.h 2024-03-08T20:37:39.554 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/kmap_size.h 2024-03-08T20:37:39.559 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/local64.h 2024-03-08T20:37:39.561 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/mmiowb.h 2024-03-08T20:37:39.563 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/module.lds.h 2024-03-08T20:37:39.566 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/rwonce.h 2024-03-08T20:37:39.570 INFO:tasks.workunit.client.1.smithi144.stdout: WRAP arch/x86/include/generated/asm/unaligned.h 2024-03-08T20:37:39.574 INFO:tasks.workunit.client.1.smithi144.stdout: UPD include/config/kernel.release 2024-03-08T20:37:39.605 INFO:tasks.workunit.client.1.smithi144.stdout: UPD include/generated/compile.h 2024-03-08T20:37:39.614 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/kallsyms 2024-03-08T20:37:39.621 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/sorttable 2024-03-08T20:37:39.650 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/selinux/genheaders/genheaders 2024-03-08T20:37:39.673 INFO:tasks.workunit.client.1.smithi144.stdout: DESCEND objtool 2024-03-08T20:37:39.819 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/selinux/mdp/mdp 2024-03-08T20:37:40.114 INFO:tasks.workunit.client.1.smithi144.stdout: UPD include/generated/utsrelease.h 2024-03-08T20:37:40.146 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC scripts/asn1_compiler 2024-03-08T20:37:40.434 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTLD arch/x86/tools/relocs 2024-03-08T20:37:40.691 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTCC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/fixdep.o 2024-03-08T20:37:40.892 INFO:tasks.workunit.client.1.smithi144.stdout: HOSTLD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/fixdep-in.o 2024-03-08T20:37:40.925 INFO:tasks.workunit.client.1.smithi144.stdout: LINK /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/fixdep 2024-03-08T20:37:41.161 INFO:tasks.workunit.client.1.smithi144.stdout: INSTALL /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/exec-cmd.h 2024-03-08T20:37:41.163 INFO:tasks.workunit.client.1.smithi144.stdout: INSTALL /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/pager.h 2024-03-08T20:37:41.163 INFO:tasks.workunit.client.1.smithi144.stdout: INSTALL /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/help.h 2024-03-08T20:37:41.166 INFO:tasks.workunit.client.1.smithi144.stdout: INSTALL /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/parse-options.h 2024-03-08T20:37:41.166 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/exec-cmd.o 2024-03-08T20:37:41.168 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/help.o 2024-03-08T20:37:41.170 INFO:tasks.workunit.client.1.smithi144.stdout: INSTALL /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/run-command.h 2024-03-08T20:37:41.188 INFO:tasks.workunit.client.1.smithi144.stderr:install: setting permissions for ‘/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/pager.h’: No data availableinstall: setting permissions for ‘/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/exec-cmd.h’: No data available 2024-03-08T20:37:41.189 INFO:tasks.workunit.client.1.smithi144.stderr: 2024-03-08T20:37:41.190 INFO:tasks.workunit.client.1.smithi144.stderr:install: setting permissions for ‘/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/parse-options.h’: No data available 2024-03-08T20:37:41.190 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** [Makefile:108: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/pager.h] Error 1 2024-03-08T20:37:41.190 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** Waiting for unfinished jobs.... 2024-03-08T20:37:41.190 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** [Makefile:108: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/parse-options.h] Error 1 2024-03-08T20:37:41.191 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** [Makefile:108: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/exec-cmd.h] Error 1 2024-03-08T20:37:41.196 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/pager.o 2024-03-08T20:37:41.198 INFO:tasks.workunit.client.1.smithi144.stderr:install: setting permissions for ‘/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/help.h’: No data available 2024-03-08T20:37:41.199 INFO:tasks.workunit.client.1.smithi144.stderr:install: setting permissions for ‘/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/run-command.h’: No data available 2024-03-08T20:37:41.199 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** [Makefile:108: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/help.h] Error 1 2024-03-08T20:37:41.201 INFO:tasks.workunit.client.1.smithi144.stderr:make[4]: *** [Makefile:108: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/run-command.h] Error 1 2024-03-08T20:37:41.202 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/parse-options.o 2024-03-08T20:37:41.205 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/run-command.o 2024-03-08T20:37:41.209 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/sigchain.o 2024-03-08T20:37:41.210 INFO:tasks.workunit.client.1.smithi144.stdout: CC /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/subcmd-config.o 2024-03-08T20:37:41.757 INFO:tasks.workunit.client.1.smithi144.stdout: LD /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/libsubcmd-in.o 2024-03-08T20:37:41.786 INFO:tasks.workunit.client.1.smithi144.stderr:make[3]: *** [Makefile:78: /home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/libsubcmd.a] Error 2 2024-03-08T20:37:41.787 INFO:tasks.workunit.client.1.smithi144.stderr:make[2]: *** [Makefile:73: objtool] Error 2 2024-03-08T20:37:41.791 INFO:tasks.workunit.client.1.smithi144.stderr:make[1]: *** [/home/ubuntu/cephtest/mnt.1/client.1/tmp/t/linux-6.5.11/Makefile:1440: tools/objtool] Error 2 2024-03-08T20:37:41.791 INFO:tasks.workunit.client.1.smithi144.stderr:make[1]: *** Waiting for unfinished jobs.... 2024-03-08T20:37:43.106 INFO:tasks.workunit.client.0.smithi118.stdout: 15 6420 11 4160 39 1921 72 2024-03-08T20:37:53.106 INFO:tasks.workunit.client.0.smithi118.stdout: 17 6610 69 4227 29 2273 79 2024-03-08T20:38:03.106 INFO:tasks.workunit.client.0.smithi118.stdout: 17 5923 43 4293 33 2222 70 2024-03-08T20:38:09.228 INFO:tasks.workunit.client.0.smithi118.stdout: 2024-03-08T20:38:09.228 INFO:tasks.workunit.client.0.smithi118.stdout:Final score for writes: 17 2024-03-08T20:38:09.228 INFO:tasks.workunit.client.0.smithi118.stdout:Final score for reads : 3423 2024-03-08T20:38:09.228 INFO:tasks.workunit.client.0.smithi118.stdout: 2024-03-08T20:38:09.234 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-08T20:38:09.235 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-08T20:38:26.871 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-03-08T20:38:26.872 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-08T20:38:28.497 DEBUG:teuthology.parallel:result is None 2024-03-08T20:38:28.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-08T20:38:28.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-08T20:38:28.598 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-08T20:38:28.598 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:38:28.598 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:28.634 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:38:28.634 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:28.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:38:28.953 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.953+0000 7fee73e00640 1 Processor -- start 2024-03-08T20:38:28.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.953+0000 7fee73e00640 1 -- start start 2024-03-08T20:38:28.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee7406c290 0x7fee740c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fee740c5540 0x7fee740c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee740c6830 con 0x7fee741526a0 2024-03-08T20:38:28.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740c87a0 con 0x7fee740c5540 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee740c9660 con 0x7fee7406c290 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee72a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fee741526a0 0x7fee74155940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:51068/0 (socket says 172.21.15.118:51068) 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee72a00640 1 -- 172.21.15.118:0/4014647586 learned_addr learned my addr 172.21.15.118:0/4014647586 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee72000640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee7406c290 0x7fee740c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.954+0000 7fee73400640 1 --2- 172.21.15.118:0/4014647586 >> v2:172.21.15.118:3300/0 conn(0x7fee740c5540 0x7fee740c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee71600640 1 -- 172.21.15.118:0/4014647586 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331429102 0 0) 0x7fee740c6830 con 0x7fee741526a0 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee71600640 1 -- 172.21.15.118:0/4014647586 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee54003520 con 0x7fee741526a0 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee73400640 1 -- 172.21.15.118:0/4014647586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee7406c290 msgr2=0x7fee740c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee73400640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee7406c290 0x7fee740c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee73400640 1 -- 172.21.15.118:0/4014647586 >> v1:172.21.15.118:6789/0 conn(0x7fee741526a0 legacy=0x7fee74155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:28.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.955+0000 7fee73400640 1 -- 172.21.15.118:0/4014647586 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740c89d0 con 0x7fee740c5540 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.956+0000 7fee73400640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee740c5540 0x7fee740c9af0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009d90 tx=0x7fee6c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53befac26f876039 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.956+0000 7fee71600640 1 -- 172.21.15.118:0/4014647586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c039070 con 0x7fee740c5540 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.956+0000 7fee71600640 1 -- 172.21.15.118:0/4014647586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c02cbc0 con 0x7fee740c5540 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.956+0000 7fee71600640 1 -- 172.21.15.118:0/4014647586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c034440 con 0x7fee740c5540 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 -- 172.21.15.118:0/4014647586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee740c5540 msgr2=0x7fee740c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee740c5540 0x7fee740c9af0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009d90 tx=0x7fee6c02be10 comp rx=0 tx=0).stop 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 -- 172.21.15.118:0/4014647586 shutdown_connections 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee740c5540 0x7fee740c9af0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 --2- 172.21.15.118:0/4014647586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee7406c290 0x7fee740c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 -- 172.21.15.118:0/4014647586 >> 172.21.15.118:0/4014647586 conn(0x7fee740ca680 msgr2=0x7fee740caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 -- 172.21.15.118:0/4014647586 shutdown_connections 2024-03-08T20:38:28.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.957+0000 7fee73e00640 1 -- 172.21.15.118:0/4014647586 wait complete. 2024-03-08T20:38:28.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.959+0000 7fee73e00640 1 Processor -- start 2024-03-08T20:38:28.959 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.959+0000 7fee73e00640 1 -- start start 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7406c290 0x7fee74149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee740c5540 0x7fee740c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740cb500 con 0x7fee741526a0 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740c92f0 con 0x7fee7406c290 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee740ca030 con 0x7fee740c5540 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42014/0 (socket says 172.21.15.118:42014) 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 -- 172.21.15.118:0/1399683680 learned_addr learned my addr 172.21.15.118:0/1399683680 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee72000640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee740c5540 0x7fee740c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 -- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee740c5540 msgr2=0x7fee740c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee740c5540 0x7fee740c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee72a00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7406c290 0x7fee74149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 -- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7406c290 msgr2=0x7fee74149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7406c290 0x7fee74149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.960+0000 7fee73400640 1 -- 172.21.15.118:0/1399683680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740c44e0 con 0x7fee741526a0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee73400640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009eb0 tx=0x7fee6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c039050 con 0x7fee741526a0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c045070 con 0x7fee741526a0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c009450 con 0x7fee741526a0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee74148cb0 con 0x7fee741526a0 2024-03-08T20:38:28.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.961+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee740c2cd0 con 0x7fee741526a0 2024-03-08T20:38:28.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.962+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74074a40 con 0x7fee741526a0 2024-03-08T20:38:28.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.963+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fee6c03e850 con 0x7fee741526a0 2024-03-08T20:38:28.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.964+0000 7fee6aa00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 0x7fee5006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:28.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.964+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fee6c0ad370 con 0x7fee741526a0 2024-03-08T20:38:28.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.965+0000 7fee72a00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 0x7fee5006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:28.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.965+0000 7fee72a00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 0x7fee5006e0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee741eb8b0 tx=0x7fee64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:28.969 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:28.969+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fee6c04e020 con 0x7fee741526a0 2024-03-08T20:38:29.160 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.160+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee740cb2e0 con 0x7fee741526a0 2024-03-08T20:38:29.163 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.163+0000 7fee6aa00640 1 -- 172.21.15.118:0/1399683680 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18950 (secure 0 0 0) 0x7fee6c07ba50 con 0x7fee741526a0 2024-03-08T20:38:29.164 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:29.164 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:30:10.610951+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:38:29.166 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 msgr2=0x7fee5006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 0x7fee5006e0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee741eb8b0 tx=0x7fee64009040 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 msgr2=0x7fee7414a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009eb0 tx=0x7fee6c004a40 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 shutdown_connections 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fee5006bc00 0x7fee5006e0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fee741526a0 0x7fee7414a340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee740c5540 0x7fee740c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 --2- 172.21.15.118:0/1399683680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7406c290 0x7fee74149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 >> 172.21.15.118:0/1399683680 conn(0x7fee740ca680 msgr2=0x7fee7414eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 shutdown_connections 2024-03-08T20:38:29.167 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.166+0000 7fee73e00640 1 -- 172.21.15.118:0/1399683680 wait complete. 2024-03-08T20:38:29.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:38:29.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:38:29.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.377+0000 7f2982000640 1 Processor -- start 2024-03-08T20:38:29.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.377+0000 7f2982000640 1 -- start start 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.378+0000 7f2982000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f297c0bde90 0x7f297c155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f2982000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c159080 con 0x7f297c152570 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f2982000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c0c52b0 con 0x7f297c0c8700 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f2982000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c158e30 con 0x7f297c0bde90 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297b400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f297c152570 0x7f297c0caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:51084/0 (socket says 172.21.15.118:51084) 2024-03-08T20:38:29.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297b400640 1 -- 172.21.15.118:0/884130406 learned_addr learned my addr 172.21.15.118:0/884130406 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:29.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297be00640 1 --2- 172.21.15.118:0/884130406 >> v2:172.21.15.118:3300/0 conn(0x7f297c0bde90 0x7f297c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297a000640 1 -- 172.21.15.118:0/884130406 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581762627 0 0) 0x7f297c159080 con 0x7f297c152570 2024-03-08T20:38:29.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297a000640 1 -- 172.21.15.118:0/884130406 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2960003520 con 0x7f297c152570 2024-03-08T20:38:29.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297be00640 1 -- 172.21.15.118:0/884130406 >> v1:172.21.15.144:6789/0 conn(0x7f297c0c8700 legacy=0x7f297c154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:29.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.379+0000 7f297be00640 1 -- 172.21.15.118:0/884130406 >> v1:172.21.15.118:6789/0 conn(0x7f297c152570 legacy=0x7f297c0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.380+0000 7f297be00640 1 -- 172.21.15.118:0/884130406 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0c5590 con 0x7f297c0bde90 2024-03-08T20:38:29.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.381+0000 7f297be00640 1 --2- 172.21.15.118:0/884130406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0bde90 0x7f297c155690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f297c158fb0 tx=0x7f297402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fd7e1294cb3429 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.381+0000 7f297a000640 1 -- 172.21.15.118:0/884130406 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974039070 con 0x7f297c0bde90 2024-03-08T20:38:29.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.381+0000 7f297a000640 1 -- 172.21.15.118:0/884130406 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297402cb40 con 0x7f297c0bde90 2024-03-08T20:38:29.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.381+0000 7f297a000640 1 -- 172.21.15.118:0/884130406 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974034440 con 0x7f297c0bde90 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 -- 172.21.15.118:0/884130406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0bde90 msgr2=0x7f297c155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 --2- 172.21.15.118:0/884130406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0bde90 0x7f297c155690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f297c158fb0 tx=0x7f297402bd90 comp rx=0 tx=0).stop 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 -- 172.21.15.118:0/884130406 shutdown_connections 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 --2- 172.21.15.118:0/884130406 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0bde90 0x7f297c155690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 -- 172.21.15.118:0/884130406 >> 172.21.15.118:0/884130406 conn(0x7f297c072620 msgr2=0x7f297c072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 -- 172.21.15.118:0/884130406 shutdown_connections 2024-03-08T20:38:29.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.382+0000 7f2982000640 1 -- 172.21.15.118:0/884130406 wait complete. 2024-03-08T20:38:29.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.384+0000 7f2982000640 1 Processor -- start 2024-03-08T20:38:29.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.384+0000 7f2982000640 1 -- start start 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f297c0bde90 0x7f297c0c0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f297c152570 0x7f297c0bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c06dcd0 con 0x7f297c0c8700 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c159360 con 0x7f297c0bde90 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f2982000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c0cb200 con 0x7f297c152570 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f297aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f297aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42024/0 (socket says 172.21.15.118:42024) 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f297aa00640 1 -- 172.21.15.118:0/1264969205 learned_addr learned my addr 172.21.15.118:0/1264969205 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:29.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.385+0000 7f297b400640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f297c0bde90 0x7f297c0c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 -- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f297c152570 msgr2=0x7f297c0bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f297c152570 0x7f297c0bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 -- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f297c0bde90 msgr2=0x7f297c0c0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f297c0bde90 0x7f297c0c0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 -- 172.21.15.118:0/1264969205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0be3a0 con 0x7f297c0c8700 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f297aa00640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f296800c400 tx=0x7f296800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968011790 con 0x7f297c0c8700 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2968017070 con 0x7f297c0c8700 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968011bb0 con 0x7f297c0c8700 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.386+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c1eb380 con 0x7f297c0c8700 2024-03-08T20:38:29.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.387+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c1eb660 con 0x7f297c0c8700 2024-03-08T20:38:29.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.388+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c074a40 con 0x7f297c0c8700 2024-03-08T20:38:29.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.389+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f296801c460 con 0x7f297c0c8700 2024-03-08T20:38:29.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.389+0000 7f2973400640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 0x7f295c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.389+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f296808ace0 con 0x7f297c0c8700 2024-03-08T20:38:29.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.390+0000 7f297b400640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 0x7f295c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.390+0000 7f297b400640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 0x7f295c06e0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f296c007fd0 tx=0x7f296c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.395+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f29680593c0 con 0x7f297c0c8700 2024-03-08T20:38:29.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.605+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f297c06d880 con 0x7f297c0c8700 2024-03-08T20:38:29.606 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.606+0000 7f2973400640 1 -- 172.21.15.118:0/1264969205 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2968058cc0 con 0x7f297c0c8700 2024-03-08T20:38:29.606 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 msgr2=0x7f295c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 0x7f295c06e0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f296c007fd0 tx=0x7f296c009040 comp rx=0 tx=0).stop 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 msgr2=0x7f297c0bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f296800c400 tx=0x7f296800c8c0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 shutdown_connections 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f295c06bc00 0x7f295c06e0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f297c152570 0x7f297c0bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f297c0c8700 0x7f297c0bee40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.610 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 --2- 172.21.15.118:0/1264969205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f297c0bde90 0x7f297c0c0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.608+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 >> 172.21.15.118:0/1264969205 conn(0x7f297c072620 msgr2=0x7f297c152950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:29.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.609+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 shutdown_connections 2024-03-08T20:38:29.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.609+0000 7f2982000640 1 -- 172.21.15.118:0/1264969205 wait complete. 2024-03-08T20:38:29.626 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:38:29.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.822+0000 7f8b56200640 1 Processor -- start 2024-03-08T20:38:29.823 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.822+0000 7f8b56200640 1 -- start start 2024-03-08T20:38:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.823+0000 7f8b56200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b5006dcd0 0x7f8b500c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.824 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.823+0000 7f8b56200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b500c2800 0x7f8b50156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.823+0000 7f8b56200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b50152b70 con 0x7f8b50150240 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.823+0000 7f8b56200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5006ed20 con 0x7f8b5006dcd0 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.823+0000 7f8b56200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50152e30 con 0x7f8b500c2800 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b5006dcd0 0x7f8b500c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8b5006dcd0 0x7f8b500c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42030/0 (socket says 172.21.15.118:42030) 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 -- 172.21.15.118:0/846104682 learned_addr learned my addr 172.21.15.118:0/846104682 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 -- 172.21.15.118:0/846104682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b500c2800 msgr2=0x7f8b50156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 --2- 172.21.15.118:0/846104682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b500c2800 0x7f8b50156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 -- 172.21.15.118:0/846104682 >> v1:172.21.15.144:6789/0 conn(0x7f8b50150240 legacy=0x7f8b5006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:29.825 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.824+0000 7f8b4fe00640 1 -- 172.21.15.118:0/846104682 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50153110 con 0x7f8b5006dcd0 2024-03-08T20:38:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.825+0000 7f8b4fe00640 1 --2- 172.21.15.118:0/846104682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b5006dcd0 0x7f8b500c22c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09c0a7d867c96d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.826 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.825+0000 7f8b4f400640 1 -- 172.21.15.118:0/846104682 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0317c0 con 0x7f8b5006dcd0 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.825+0000 7f8b4f400640 1 -- 172.21.15.118:0/846104682 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c037070 con 0x7f8b5006dcd0 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.825+0000 7f8b4f400640 1 -- 172.21.15.118:0/846104682 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c031b80 con 0x7f8b5006dcd0 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 -- 172.21.15.118:0/846104682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b5006dcd0 msgr2=0x7f8b500c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 --2- 172.21.15.118:0/846104682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b5006dcd0 0x7f8b500c22c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02b860 comp rx=0 tx=0).stop 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 -- 172.21.15.118:0/846104682 shutdown_connections 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 --2- 172.21.15.118:0/846104682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b500c2800 0x7f8b50156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 --2- 172.21.15.118:0/846104682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b5006dcd0 0x7f8b500c22c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 -- 172.21.15.118:0/846104682 >> 172.21.15.118:0/846104682 conn(0x7f8b500c6480 msgr2=0x7f8b500c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 -- 172.21.15.118:0/846104682 shutdown_connections 2024-03-08T20:38:29.827 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.826+0000 7f8b56200640 1 -- 172.21.15.118:0/846104682 wait complete. 2024-03-08T20:38:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.828+0000 7f8b56200640 1 Processor -- start 2024-03-08T20:38:29.828 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.828+0000 7f8b56200640 1 -- start start 2024-03-08T20:38:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5006dcd0 0x7f8b5014e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.830 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 0x7f8b50145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501566a0 con 0x7f8b500c2800 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501536d0 con 0x7f8b5006dcd0 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b56200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50156820 con 0x7f8b50150240 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42040/0 (socket says 172.21.15.118:42040) 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 -- 172.21.15.118:0/734708896 learned_addr learned my addr 172.21.15.118:0/734708896 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b54e00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5006dcd0 0x7f8b5014e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b55800640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 0x7f8b50145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 -- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 msgr2=0x7f8b50145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 0x7f8b50145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 -- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5006dcd0 msgr2=0x7f8b5014e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5006dcd0 0x7f8b5014e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:29.831 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b4fe00640 1 -- 172.21.15.118:0/734708896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50154090 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.829+0000 7f8b55800640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 0x7f8b50145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b4fe00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032860 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c032a00 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5014ef50 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032df0 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.830+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50146500 con 0x7f8b500c2800 2024-03-08T20:38:29.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.832+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50074a40 con 0x7f8b500c2800 2024-03-08T20:38:29.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.832+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8b3c04c060 con 0x7f8b500c2800 2024-03-08T20:38:29.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.833+0000 7f8b4cc00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 0x7f8b3006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:29.833 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.833+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8b3c0ac580 con 0x7f8b500c2800 2024-03-08T20:38:29.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.833+0000 7f8b54e00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 0x7f8b3006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:29.834 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.834+0000 7f8b54e00640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 0x7f8b3006e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c6450 tx=0x7f8b44009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:29.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:29.838+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f8b3c040070 con 0x7f8b500c2800 2024-03-08T20:38:30.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.049+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b5006e0e0 con 0x7f8b500c2800 2024-03-08T20:38:30.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.050+0000 7f8b4cc00640 1 -- 172.21.15.118:0/734708896 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b3c07ad00 con 0x7f8b500c2800 2024-03-08T20:38:30.050 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 msgr2=0x7f8b3006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 0x7f8b3006e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c6450 tx=0x7f8b44009060 comp rx=0 tx=0).stop 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 msgr2=0x7f8b50154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c0046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 shutdown_connections 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8b3006bbd0 0x7f8b3006e090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b50150240 0x7f8b50145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8b500c2800 0x7f8b50154370 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 --2- 172.21.15.118:0/734708896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5006dcd0 0x7f8b5014e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 >> 172.21.15.118:0/734708896 conn(0x7f8b500c6480 msgr2=0x7f8b500720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:30.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 shutdown_connections 2024-03-08T20:38:30.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.052+0000 7f8b56200640 1 -- 172.21.15.118:0/734708896 wait complete. 2024-03-08T20:38:30.071 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:38:30.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.278+0000 7f7f8ce00640 1 Processor -- start 2024-03-08T20:38:30.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.278+0000 7f7f8ce00640 1 -- start start 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f8ce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f880c8700 0x7f7f88154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f8ce00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f880bde90 0x7f7f881554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f8ce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f88159080 con 0x7f7f88152570 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f8ce00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f88158e30 con 0x7f7f880c8700 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f8ce00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88159360 con 0x7f7f880bde90 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f85400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f880c8700 0x7f7f88154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f85400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7f880c8700 0x7f7f88154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40640/0 (socket says 172.21.15.118:40640) 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.279+0000 7f7f85400640 1 -- 172.21.15.118:0/3014703919 learned_addr learned my addr 172.21.15.118:0/3014703919 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:30.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.280+0000 7f7f86800640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f880bde90 0x7f7f881554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.280+0000 7f7f85400640 1 -- 172.21.15.118:0/3014703919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f880bde90 msgr2=0x7f7f881554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:30.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.280+0000 7f7f85400640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f880bde90 0x7f7f881554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.280+0000 7f7f85400640 1 -- 172.21.15.118:0/3014703919 >> v1:172.21.15.144:6789/0 conn(0x7f7f88152570 legacy=0x7f7f880caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.280+0000 7f7f85400640 1 -- 172.21.15.118:0/3014703919 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880c52b0 con 0x7f7f880c8700 2024-03-08T20:38:30.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.281+0000 7f7f85400640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88154f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009870 tx=0x7f7f7402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82b1a07caca686a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.282+0000 7f7f84a00640 1 -- 172.21.15.118:0/3014703919 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740317c0 con 0x7f7f880c8700 2024-03-08T20:38:30.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.282+0000 7f7f84a00640 1 -- 172.21.15.118:0/3014703919 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74037070 con 0x7f7f880c8700 2024-03-08T20:38:30.282 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.282+0000 7f7f84a00640 1 -- 172.21.15.118:0/3014703919 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74031b80 con 0x7f7f880c8700 2024-03-08T20:38:30.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 -- 172.21.15.118:0/3014703919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 msgr2=0x7f7f88154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88154f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009870 tx=0x7f7f7402b860 comp rx=0 tx=0).stop 2024-03-08T20:38:30.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 -- 172.21.15.118:0/3014703919 shutdown_connections 2024-03-08T20:38:30.283 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f880bde90 0x7f7f881554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/3014703919 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88154f80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 -- 172.21.15.118:0/3014703919 >> 172.21.15.118:0/3014703919 conn(0x7f7f88072620 msgr2=0x7f7f88072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:30.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 -- 172.21.15.118:0/3014703919 shutdown_connections 2024-03-08T20:38:30.284 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.283+0000 7f7f8ce00640 1 -- 172.21.15.118:0/3014703919 wait complete. 2024-03-08T20:38:30.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.285+0000 7f7f8ce00640 1 Processor -- start 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.285+0000 7f7f8ce00640 1 -- start start 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880bde90 0x7f7f8814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f88152570 0x7f7f880bd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cb200 con 0x7f7f880c8700 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8806dcd0 con 0x7f7f880bde90 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f8ce00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cb380 con 0x7f7f88152570 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40650/0 (socket says 172.21.15.118:40650) 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 -- 172.21.15.118:0/4233464416 learned_addr learned my addr 172.21.15.118:0/4233464416 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85e00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880bde90 0x7f7f8814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.297 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 -- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f88152570 msgr2=0x7f7f880bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f88152570 0x7f7f880bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 -- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880bde90 msgr2=0x7f7f8814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880bde90 0x7f7f8814afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.286+0000 7f7f85400640 1 -- 172.21.15.118:0/4233464416 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880bda50 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f85400640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000c00 tx=0x7f7f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032650 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f740327f0 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f881f2a70 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032be0 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.287+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f881f3030 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.289+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880cacd0 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.289+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7f7404c060 con 0x7f7f880c8700 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.291+0000 7f7f7e000640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 0x7f7f680900a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.298 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.291+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7f740ac930 con 0x7f7f880c8700 2024-03-08T20:38:30.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.291+0000 7f7f85e00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 0x7f7f680900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.292+0000 7f7f85e00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 0x7f7f680900a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f78007fd0 tx=0x7f7f78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.299 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.296+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f7f880cacd0 con 0x7f7f880c8700 2024-03-08T20:38:30.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.503+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f88074a40 con 0x7f7f880c8700 2024-03-08T20:38:30.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.503+0000 7f7f7e000640 1 -- 172.21.15.118:0/4233464416 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f74040070 con 0x7f7f880c8700 2024-03-08T20:38:30.504 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:38:30.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 msgr2=0x7f7f680900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 0x7f7f680900a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f78007fd0 tx=0x7f7f78009040 comp rx=0 tx=0).stop 2024-03-08T20:38:30.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 msgr2=0x7f7f88147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000c00 tx=0x7f7f740046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 shutdown_connections 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f7f6808dbe0 0x7f7f680900a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f88152570 0x7f7f880bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7f880c8700 0x7f7f88147f10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 --2- 172.21.15.118:0/4233464416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880bde90 0x7f7f8814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 >> 172.21.15.118:0/4233464416 conn(0x7f7f88072620 msgr2=0x7f7f880c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 shutdown_connections 2024-03-08T20:38:30.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.507+0000 7f7f8ce00640 1 -- 172.21.15.118:0/4233464416 wait complete. 2024-03-08T20:38:30.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:38:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.744+0000 7f5e2ea00640 1 Processor -- start 2024-03-08T20:38:30.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.744+0000 7f5e2ea00640 1 -- start start 2024-03-08T20:38:30.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e2ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5e280c3040 0x7f5e280a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 0x7f5e280c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e2ea00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e28071c60 con 0x7f5e28152910 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e2ea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e28155000 con 0x7f5e280c3040 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280c0d40 con 0x7f5e28155ac0 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e27e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5e28152910 0x7f5e28071550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57742/0 (socket says 172.21.15.118:57742) 2024-03-08T20:38:30.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.746+0000 7f5e27e00640 1 -- 172.21.15.118:0/1651940253 learned_addr learned my addr 172.21.15.118:0/1651940253 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e2ca00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 0x7f5e280c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e27400640 1 --2- 172.21.15.118:0/1651940253 >> v2:172.21.15.144:3300/0 conn(0x7f5e280c3040 0x7f5e280a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381235129 0 0) 0x7f5e28071c60 con 0x7f5e28152910 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c003520 con 0x7f5e28152910 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1418847018 0 0) 0x7f5e0c003520 con 0x7f5e28152910 2024-03-08T20:38:30.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 msgr2=0x7f5e280c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 0x7f5e280c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 >> v2:172.21.15.144:3300/0 conn(0x7f5e280c3040 msgr2=0x7f5e280a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 --2- 172.21.15.118:0/1651940253 >> v2:172.21.15.144:3300/0 conn(0x7f5e280c3040 0x7f5e280a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280c1020 con 0x7f5e28152910 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f5e18001670 con 0x7f5e28152910 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 >> v1:172.21.15.118:6789/0 conn(0x7f5e28152910 legacy=0x7f5e28071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 0x7f5e0c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c003f30 0x7f5e0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e0c004d40 0x7f5e0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28155000 con 0x7f5e0c003f30 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280c0d40 con 0x7f5e0c004d40 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.747+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c00ba10 con 0x7f5e28155ac0 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c003f30 0x7f5e0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.750 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 -- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 msgr2=0x7f5e0c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:30.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e28155ac0 0x7f5e0c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 -- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e0c004d40 msgr2=0x7f5e0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:30.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e0c004d40 0x7f5e0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.748+0000 7f5e27400640 1 -- 172.21.15.118:0/1651940253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c003520 con 0x7f5e0c003f30 2024-03-08T20:38:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.749+0000 7f5e27400640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c003f30 0x7f5e0c004800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009ac0 tx=0x7f5e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14ef550685e81f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.749+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14039070 con 0x7f5e0c003f30 2024-03-08T20:38:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.749+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1402c6b0 con 0x7f5e0c003f30 2024-03-08T20:38:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.749+0000 7f5e26a00640 1 -- 172.21.15.118:0/1651940253 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14009690 con 0x7f5e0c003f30 2024-03-08T20:38:30.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1651940253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c003f30 msgr2=0x7f5e0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1651940253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e0c003f30 0x7f5e0c004800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009ac0 tx=0x7f5e0c005830 comp rx=0 tx=0).stop 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ca00640 1 -- 172.21.15.118:0/1651940253 reap_dead start 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1651940253 shutdown_connections 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1651940253 >> 172.21.15.118:0/1651940253 conn(0x7f5e280c3b80 msgr2=0x7f5e280c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1651940253 shutdown_connections 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.750+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1651940253 wait complete. 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.752+0000 7f5e2ea00640 1 Processor -- start 2024-03-08T20:38:30.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.752+0000 7f5e2ea00640 1 -- start start 2024-03-08T20:38:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0c003f30 0x7f5e280ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e281ee870 0x7f5e28150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.754 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280c1300 con 0x7f5e28151090 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281555a0 con 0x7f5e281ee870 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.753+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e280c0090 con 0x7f5e0c003f30 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40666/0 (socket says 172.21.15.118:40666) 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 -- 172.21.15.118:0/1725183483 learned_addr learned my addr 172.21.15.118:0/1725183483 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e27400640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e281ee870 0x7f5e28150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e27e00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0c003f30 0x7f5e280ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 -- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0c003f30 msgr2=0x7f5e280ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0c003f30 0x7f5e280ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 -- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e281ee870 msgr2=0x7f5e28150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e281ee870 0x7f5e28150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.755 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.754+0000 7f5e2ca00640 1 -- 172.21.15.118:0/1725183483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2814e5e0 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e2ca00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e28066bf0 tx=0x7f5e2000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20018020 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000bae0 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e281edd90 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20014400 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.755+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e281ee350 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.756+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e28074a40 con 0x7f5e28151090 2024-03-08T20:38:30.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.757+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5e20005d10 con 0x7f5e28151090 2024-03-08T20:38:30.758 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.758+0000 7f5e1fe00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 0x7f5e0806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:30.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.758+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5e2008b090 con 0x7f5e28151090 2024-03-08T20:38:30.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.758+0000 7f5e27e00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 0x7f5e0806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:30.759 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.759+0000 7f5e27e00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 0x7f5e0806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001a80 tx=0x7f5e18001cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:30.763 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.763+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5e20022070 con 0x7f5e28151090 2024-03-08T20:38:30.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.973+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5e280732f0 con 0x7f5e28151090 2024-03-08T20:38:30.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.974+0000 7f5e1fe00640 1 -- 172.21.15.118:0/1725183483 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5e20059770 con 0x7f5e28151090 2024-03-08T20:38:30.975 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 msgr2=0x7f5e0806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 0x7f5e0806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001a80 tx=0x7f5e18001cf0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 msgr2=0x7f5e281ea6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e28066bf0 tx=0x7f5e2000b480 comp rx=0 tx=0).stop 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 shutdown_connections 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f5e0806bbd0 0x7f5e0806e090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.978 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5e28151090 0x7f5e281ea6f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e281ee870 0x7f5e28150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 --2- 172.21.15.118:0/1725183483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e0c003f30 0x7f5e280ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:30.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 >> 172.21.15.118:0/1725183483 conn(0x7f5e280c3b80 msgr2=0x7f5e280c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:30.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 shutdown_connections 2024-03-08T20:38:30.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:30.977+0000 7f5e2ea00640 1 -- 172.21.15.118:0/1725183483 wait complete. 2024-03-08T20:38:30.998 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T20:38:31.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.212+0000 7fe53ea00640 1 Processor -- start 2024-03-08T20:38:31.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.212+0000 7fe53ea00640 1 -- start start 2024-03-08T20:38:31.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5380c2fc0 0x7fe538159090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe538155a40 0x7fe5380c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ea00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5380c6c50 con 0x7fe53814b9f0 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ea00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5380c2d00 con 0x7fe538155a40 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ea00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538155ef0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe538155a40 0x7fe5380c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ca00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe538155a40 0x7fe5380c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40672/0 (socket says 172.21.15.118:40672) 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe53ca00640 1 -- 172.21.15.118:0/1001782933 learned_addr learned my addr 172.21.15.118:0/1001782933 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.214+0000 7fe52f400640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5380c2fc0 0x7fe538159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.215+0000 7fe53ca00640 1 -- 172.21.15.118:0/1001782933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5380c2fc0 msgr2=0x7fe538159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.215+0000 7fe53ca00640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5380c2fc0 0x7fe538159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.215+0000 7fe53ca00640 1 -- 172.21.15.118:0/1001782933 >> v1:172.21.15.144:6789/0 conn(0x7fe53814b9f0 legacy=0x7fe5380c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.215+0000 7fe53ca00640 1 -- 172.21.15.118:0/1001782933 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380c34d0 con 0x7fe538155a40 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.216+0000 7fe53ca00640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe538155a40 0x7fe5380c8b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe530009870 tx=0x7fe53002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c7e0589398958 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.216+0000 7fe537400640 1 -- 172.21.15.118:0/1001782933 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530034070 con 0x7fe538155a40 2024-03-08T20:38:31.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.216+0000 7fe537400640 1 -- 172.21.15.118:0/1001782933 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530030840 con 0x7fe538155a40 2024-03-08T20:38:31.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.216+0000 7fe537400640 1 -- 172.21.15.118:0/1001782933 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530030c10 con 0x7fe538155a40 2024-03-08T20:38:31.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 -- 172.21.15.118:0/1001782933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe538155a40 msgr2=0x7fe5380c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.217 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe538155a40 0x7fe5380c8b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe530009870 tx=0x7fe53002b980 comp rx=0 tx=0).stop 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 -- 172.21.15.118:0/1001782933 shutdown_connections 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5380c2fc0 0x7fe538159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 --2- 172.21.15.118:0/1001782933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe538155a40 0x7fe5380c8b20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 -- 172.21.15.118:0/1001782933 >> 172.21.15.118:0/1001782933 conn(0x7fe538066e40 msgr2=0x7fe538067250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 -- 172.21.15.118:0/1001782933 shutdown_connections 2024-03-08T20:38:31.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.217+0000 7fe53ea00640 1 -- 172.21.15.118:0/1001782933 wait complete. 2024-03-08T20:38:31.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.219+0000 7fe53ea00640 1 Processor -- start 2024-03-08T20:38:31.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.219+0000 7fe53ea00640 1 -- start start 2024-03-08T20:38:31.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe53814b9f0 0x7fe5381540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe538155a40 0x7fe5381ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538158890 con 0x7fe5380c2fc0 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381585b0 con 0x7fe538155a40 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ea00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe538158b70 con 0x7fe53814b9f0 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40688/0 (socket says 172.21.15.118:40688) 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 -- 172.21.15.118:0/2454060804 learned_addr learned my addr 172.21.15.118:0/2454060804 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe52f400640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe53814b9f0 0x7fe5381540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe53ca00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe538155a40 0x7fe5381ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 -- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe53814b9f0 msgr2=0x7fe5381540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe53814b9f0 0x7fe5381540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 -- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe538155a40 msgr2=0x7fe5381ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe538155a40 0x7fe5381ea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.220+0000 7fe537e00640 1 -- 172.21.15.118:0/2454060804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5381487c0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe537e00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c790 tx=0x7fe52800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528016020 con 0x7fe5380c2fc0 2024-03-08T20:38:31.223 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528006d50 con 0x7fe5380c2fc0 2024-03-08T20:38:31.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528003bb0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5381ee0e0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.221+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5381ee6a0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.224 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.223+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5381eded0 con 0x7fe5380c2fc0 2024-03-08T20:38:31.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.224+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe52800a850 con 0x7fe5380c2fc0 2024-03-08T20:38:31.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.224+0000 7fe534c00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 0x7fe51406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.225+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe52808ab30 con 0x7fe5380c2fc0 2024-03-08T20:38:31.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.225+0000 7fe52f400640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 0x7fe51406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.225+0000 7fe52f400640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 0x7fe51406e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe520006fd0 tx=0x7fe520008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.229+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe528020020 con 0x7fe5380c2fc0 2024-03-08T20:38:31.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.456+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe5380c2950 con 0x7fe5380c2fc0 2024-03-08T20:38:31.457 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.456+0000 7fe534c00640 1 -- 172.21.15.118:0/2454060804 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe528019310 con 0x7fe5380c2fc0 2024-03-08T20:38:31.457 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 msgr2=0x7fe51406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 0x7fe51406e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe520006fd0 tx=0x7fe520008040 comp rx=0 tx=0).stop 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 msgr2=0x7fe538148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe52800c790 tx=0x7fe52800cc50 comp rx=0 tx=0).stop 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 shutdown_connections 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe51406bbd0 0x7fe51406e090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe538155a40 0x7fe5381ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe53814b9f0 0x7fe5381540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 --2- 172.21.15.118:0/2454060804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe5380c2fc0 0x7fe538148a80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 >> 172.21.15.118:0/2454060804 conn(0x7fe538066e40 msgr2=0x7fe538149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:31.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 shutdown_connections 2024-03-08T20:38:31.461 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.459+0000 7fe53ea00640 1 -- 172.21.15.118:0/2454060804 wait complete. 2024-03-08T20:38:31.478 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-08T20:38:31.478 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:31.527 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:38:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.787+0000 7f9823e00640 1 Processor -- start 2024-03-08T20:38:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.787+0000 7f9823e00640 1 -- start start 2024-03-08T20:38:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.788+0000 7f9823e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f98241526a0 0x7f9824155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.788+0000 7f9823e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240c6830 con 0x7f98240c9af0 2024-03-08T20:38:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.788+0000 7f9823e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9824155e80 con 0x7f982406c290 2024-03-08T20:38:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.788+0000 7f9823e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240c87a0 con 0x7f98241526a0 2024-03-08T20:38:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f98241526a0 0x7f9824155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f98241526a0 0x7f9824155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40700/0 (socket says 172.21.15.118:40700) 2024-03-08T20:38:31.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 -- 172.21.15.118:0/644986015 learned_addr learned my addr 172.21.15.118:0/644986015 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 -- 172.21.15.118:0/644986015 >> v1:172.21.15.144:6789/0 conn(0x7f982406c290 legacy=0x7f98240c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 -- 172.21.15.118:0/644986015 >> v1:172.21.15.118:6789/0 conn(0x7f98240c9af0 legacy=0x7f982415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.789+0000 7f9822a00640 1 -- 172.21.15.118:0/644986015 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240c89d0 con 0x7f98241526a0 2024-03-08T20:38:31.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.790+0000 7f9822a00640 1 --2- 172.21.15.118:0/644986015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98241526a0 0x7f9824155940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c431fb33ca01511f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9821600640 1 -- 172.21.15.118:0/644986015 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814034070 con 0x7f98241526a0 2024-03-08T20:38:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9821600640 1 -- 172.21.15.118:0/644986015 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814030860 con 0x7f98241526a0 2024-03-08T20:38:31.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9821600640 1 -- 172.21.15.118:0/644986015 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814030c30 con 0x7f98241526a0 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9823e00640 1 -- 172.21.15.118:0/644986015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98241526a0 msgr2=0x7f9824155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9823e00640 1 --2- 172.21.15.118:0/644986015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98241526a0 0x7f9824155940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9814009870 tx=0x7f981402b9a0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9823e00640 1 -- 172.21.15.118:0/644986015 shutdown_connections 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9823e00640 1 --2- 172.21.15.118:0/644986015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98241526a0 0x7f9824155940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.791+0000 7f9823e00640 1 -- 172.21.15.118:0/644986015 >> 172.21.15.118:0/644986015 conn(0x7f98240ca680 msgr2=0x7f98240caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.792+0000 7f9823e00640 1 -- 172.21.15.118:0/644986015 shutdown_connections 2024-03-08T20:38:31.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.792+0000 7f9823e00640 1 -- 172.21.15.118:0/644986015 wait complete. 2024-03-08T20:38:31.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.793+0000 7f9823e00640 1 Processor -- start 2024-03-08T20:38:31.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.793+0000 7f9823e00640 1 -- start start 2024-03-08T20:38:31.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 0x7f9824153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 0x7f98241ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240c92f0 con 0x7f982406c290 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98240c9660 con 0x7f98240c9af0 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9823e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240cb500 con 0x7f98241526a0 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9822a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9822a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40716/0 (socket says 172.21.15.118:40716) 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.794+0000 7f9822a00640 1 -- 172.21.15.118:0/304370603 learned_addr learned my addr 172.21.15.118:0/304370603 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822000640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 0x7f9824153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9823400640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 0x7f98241ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 -- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 msgr2=0x7f98241ead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 0x7f98241ead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 -- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 msgr2=0x7f9824153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 0x7f9824153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 -- 172.21.15.118:0/304370603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240c2160 con 0x7f982406c290 2024-03-08T20:38:31.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822000640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 0x7f9824153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:31.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9823400640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 0x7f98241ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:31.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f9822a00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f98140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.795+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814034040 con 0x7f982406c290 2024-03-08T20:38:31.797 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.796+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98140433f0 con 0x7f982406c290 2024-03-08T20:38:31.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.796+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140437e0 con 0x7f982406c290 2024-03-08T20:38:31.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.796+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240c2440 con 0x7f982406c290 2024-03-08T20:38:31.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.796+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98241ee720 con 0x7f982406c290 2024-03-08T20:38:31.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.797+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98241ee230 con 0x7f982406c290 2024-03-08T20:38:31.798 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.798+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f981404a060 con 0x7f982406c290 2024-03-08T20:38:31.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.799+0000 7f981aa00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 0x7f980406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:31.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.799+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f98140ad0a0 con 0x7f982406c290 2024-03-08T20:38:31.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.800+0000 7f9822000640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 0x7f980406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:31.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.800+0000 7f9822000640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 0x7f980406e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98240abdb0 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:31.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:31.804+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f981403e070 con 0x7f982406c290 2024-03-08T20:38:32.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.021+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9824074a40 con 0x7f982406c290 2024-03-08T20:38:32.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.024+0000 7f981aa00640 1 -- 172.21.15.118:0/304370603 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18950 (secure 0 0 0) 0x7f981404be90 con 0x7f982406c290 2024-03-08T20:38:32.025 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:32.025 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:30:10.610951+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:38:32.027 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 msgr2=0x7f980406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 0x7f980406e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f98240abdb0 tx=0x7f9810009040 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 msgr2=0x7f982414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9814000c00 tx=0x7f98140046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 shutdown_connections 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f980406bbd0 0x7f980406e090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98241526a0 0x7f98241ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98240c9af0 0x7f9824153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 --2- 172.21.15.118:0/304370603 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f982406c290 0x7f982414f830 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 >> 172.21.15.118:0/304370603 conn(0x7f98240ca680 msgr2=0x7f98240c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 shutdown_connections 2024-03-08T20:38:32.028 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.027+0000 7f9823e00640 1 -- 172.21.15.118:0/304370603 wait complete. 2024-03-08T20:38:32.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:38:32.048 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:38:32.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.268+0000 7ff5ed400640 1 Processor -- start 2024-03-08T20:38:32.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.269+0000 7ff5ed400640 1 -- start start 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5ed400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5e8152540 0x7ff5e8155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5ed400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5e8158440 0x7ff5e81588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5ed400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e8154ed0 con 0x7ff5e8152920 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5ed400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80c8dc0 con 0x7ff5e8152540 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5ed400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e8158e90 con 0x7ff5e8158440 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5e7e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5e8152540 0x7ff5e8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5e7e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5e8152540 0x7ff5e8155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40720/0 (socket says 172.21.15.118:40720) 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5dfe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff5e8152920 0x7ff5e80c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57770/0 (socket says 172.21.15.118:57770) 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.270+0000 7ff5e7e00640 1 -- 172.21.15.118:0/521197711 learned_addr learned my addr 172.21.15.118:0/521197711 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:32.271 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.271+0000 7ff5eca00640 1 --2- 172.21.15.118:0/521197711 >> v2:172.21.15.144:3300/0 conn(0x7ff5e8158440 0x7ff5e81588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.271+0000 7ff5e7e00640 1 -- 172.21.15.118:0/521197711 >> v2:172.21.15.144:3300/0 conn(0x7ff5e8158440 msgr2=0x7ff5e81588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:32.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.271+0000 7ff5e7e00640 1 --2- 172.21.15.118:0/521197711 >> v2:172.21.15.144:3300/0 conn(0x7ff5e8158440 0x7ff5e81588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.271+0000 7ff5e7e00640 1 -- 172.21.15.118:0/521197711 >> v1:172.21.15.118:6789/0 conn(0x7ff5e8152920 legacy=0x7ff5e80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.271+0000 7ff5e7e00640 1 -- 172.21.15.118:0/521197711 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8159170 con 0x7ff5e8152540 2024-03-08T20:38:32.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.272+0000 7ff5e7e00640 1 --2- 172.21.15.118:0/521197711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8152540 0x7ff5e8155990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80c7de0 tx=0x7ff5d802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12caf1db48a0daa server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.272+0000 7ff5e7400640 1 -- 172.21.15.118:0/521197711 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80317f0 con 0x7ff5e8152540 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.272+0000 7ff5e7400640 1 -- 172.21.15.118:0/521197711 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8037070 con 0x7ff5e8152540 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.272+0000 7ff5e7400640 1 -- 172.21.15.118:0/521197711 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8031bb0 con 0x7ff5e8152540 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 -- 172.21.15.118:0/521197711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8152540 msgr2=0x7ff5e8155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 --2- 172.21.15.118:0/521197711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8152540 0x7ff5e8155990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80c7de0 tx=0x7ff5d802b890 comp rx=0 tx=0).stop 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 -- 172.21.15.118:0/521197711 shutdown_connections 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 --2- 172.21.15.118:0/521197711 >> v2:172.21.15.144:3300/0 conn(0x7ff5e8158440 0x7ff5e81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 --2- 172.21.15.118:0/521197711 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8152540 0x7ff5e8155990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 -- 172.21.15.118:0/521197711 >> 172.21.15.118:0/521197711 conn(0x7ff5e80ac290 msgr2=0x7ff5e80ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 -- 172.21.15.118:0/521197711 shutdown_connections 2024-03-08T20:38:32.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.273+0000 7ff5ed400640 1 -- 172.21.15.118:0/521197711 wait complete. 2024-03-08T20:38:32.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.275+0000 7ff5ed400640 1 Processor -- start 2024-03-08T20:38:32.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.275+0000 7ff5ed400640 1 -- start start 2024-03-08T20:38:32.277 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e8152540 0x7ff5e80c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 0x7ff5e81de1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806d900 con 0x7ff5e8158440 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8155470 con 0x7ff5e8152540 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5ed400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e806da80 con 0x7ff5e8152920 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5eca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5eca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40730/0 (socket says 172.21.15.118:40730) 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5eca00640 1 -- 172.21.15.118:0/3847035703 learned_addr learned my addr 172.21.15.118:0/3847035703 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5e7e00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e8152540 0x7ff5e80c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.276+0000 7ff5dfe00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 0x7ff5e81de1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 -- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 msgr2=0x7ff5e81de1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 0x7ff5e81de1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 -- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e8152540 msgr2=0x7ff5e80c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e8152540 0x7ff5e80c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 -- 172.21.15.118:0/3847035703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e81ee5c0 con 0x7ff5e8158440 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5dfe00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 0x7ff5e81de1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5eca00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0007e70 tx=0x7ff5e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0014620 con 0x7ff5e8158440 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0019070 con 0x7ff5e8158440 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e81dec70 con 0x7ff5e8158440 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0014a20 con 0x7ff5e8158440 2024-03-08T20:38:32.279 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.277+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e81ee860 con 0x7ff5e8158440 2024-03-08T20:38:32.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.279+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e8074a40 con 0x7ff5e8158440 2024-03-08T20:38:32.280 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.280+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff5e0014bc0 con 0x7ff5e8158440 2024-03-08T20:38:32.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.280+0000 7ff5e4c00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 0x7ff5c406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.281+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff5e008b790 con 0x7ff5e8158440 2024-03-08T20:38:32.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.281+0000 7ff5e7e00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 0x7ff5c406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.281 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.281+0000 7ff5e7e00640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 0x7ff5c406e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8036000 tx=0x7ff5d803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:32.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.285+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7ff5e0059e70 con 0x7ff5e8158440 2024-03-08T20:38:32.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.646+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5e80aefc0 con 0x7ff5e8158440 2024-03-08T20:38:32.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.647+0000 7ff5e4c00640 1 -- 172.21.15.118:0/3847035703 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5e0059770 con 0x7ff5e8158440 2024-03-08T20:38:32.648 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:38:32.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 msgr2=0x7ff5c406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 0x7ff5c406e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8036000 tx=0x7ff5d803d040 comp rx=0 tx=0).stop 2024-03-08T20:38:32.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 msgr2=0x7ff5e81de730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0007e70 tx=0x7ff5e000e4b0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 shutdown_connections 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7ff5c406bbd0 0x7ff5c406e090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5e8158440 0x7ff5e81de730 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5e8152920 0x7ff5e81de1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 --2- 172.21.15.118:0/3847035703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5e8152540 0x7ff5e80c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.651+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 >> 172.21.15.118:0/3847035703 conn(0x7ff5e80ac290 msgr2=0x7ff5e81546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:32.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.652+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 shutdown_connections 2024-03-08T20:38:32.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.665+0000 7ff5ed400640 1 -- 172.21.15.118:0/3847035703 wait complete. 2024-03-08T20:38:32.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:38:32.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.987+0000 7f1a78a00640 1 Processor -- start 2024-03-08T20:38:32.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.987+0000 7f1a78a00640 1 -- start start 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a78a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a74152920 0x7f1a74155990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a78a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a74154ed0 con 0x7f1a74152540 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a78a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a74158e90 con 0x7f1a74158440 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a78a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740c8dc0 con 0x7f1a74152920 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a72800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1a74152540 0x7f1a740c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57772/0 (socket says 172.21.15.118:57772) 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.989+0000 7f1a72800640 1 -- 172.21.15.118:0/4128612638 learned_addr learned my addr 172.21.15.118:0/4128612638 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:32.990 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71e00640 1 --2- 172.21.15.118:0/4128612638 >> v2:172.21.15.118:3300/0 conn(0x7f1a74152920 0x7f1a74155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71400640 1 -- 172.21.15.118:0/4128612638 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573201617 0 0) 0x7f1a74154ed0 con 0x7f1a74152540 2024-03-08T20:38:32.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71400640 1 -- 172.21.15.118:0/4128612638 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a58003520 con 0x7f1a74152540 2024-03-08T20:38:32.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71e00640 1 -- 172.21.15.118:0/4128612638 >> v1:172.21.15.144:6789/0 conn(0x7f1a74158440 legacy=0x7f1a740c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:32.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71e00640 1 -- 172.21.15.118:0/4128612638 >> v1:172.21.15.118:6789/0 conn(0x7f1a74152540 legacy=0x7f1a740c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.991 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.990+0000 7f1a71e00640 1 -- 172.21.15.118:0/4128612638 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74159170 con 0x7f1a74152920 2024-03-08T20:38:32.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.991+0000 7f1a71e00640 1 --2- 172.21.15.118:0/4128612638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152920 0x7f1a74155990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48551087f00db01b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:32.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.991+0000 7f1a71400640 1 -- 172.21.15.118:0/4128612638 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60038070 con 0x7f1a74152920 2024-03-08T20:38:32.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a71400640 1 -- 172.21.15.118:0/4128612638 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60031700 con 0x7f1a74152920 2024-03-08T20:38:32.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a71400640 1 -- 172.21.15.118:0/4128612638 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60031ad0 con 0x7f1a74152920 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 -- 172.21.15.118:0/4128612638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152920 msgr2=0x7f1a74155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 --2- 172.21.15.118:0/4128612638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152920 0x7f1a74155990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b7a0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 -- 172.21.15.118:0/4128612638 shutdown_connections 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 --2- 172.21.15.118:0/4128612638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152920 0x7f1a74155990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 -- 172.21.15.118:0/4128612638 >> 172.21.15.118:0/4128612638 conn(0x7f1a740ac290 msgr2=0x7f1a740ac670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 -- 172.21.15.118:0/4128612638 shutdown_connections 2024-03-08T20:38:32.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.992+0000 7f1a78a00640 1 -- 172.21.15.118:0/4128612638 wait complete. 2024-03-08T20:38:32.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.994+0000 7f1a78a00640 1 Processor -- start 2024-03-08T20:38:32.994 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.994+0000 7f1a78a00640 1 -- start start 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a74152920 0x7f1a74156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a74158440 0x7f1a741eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c5790 con 0x7f1a74152540 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74155470 con 0x7f1a74158440 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a78a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c5910 con 0x7f1a74152920 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a72800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a72800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40742/0 (socket says 172.21.15.118:40742) 2024-03-08T20:38:32.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a72800640 1 -- 172.21.15.118:0/1919692647 learned_addr learned my addr 172.21.15.118:0/1919692647 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a71e00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a74152920 0x7f1a74156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.995+0000 7f1a73200640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a74158440 0x7f1a741eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 -- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a74152920 msgr2=0x7f1a74156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a74152920 0x7f1a74156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 -- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a74158440 msgr2=0x7f1a741eb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a74158440 0x7f1a741eb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 -- 172.21.15.118:0/1919692647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a741ee850 con 0x7f1a74152540 2024-03-08T20:38:32.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a72800640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c430 tx=0x7f1a6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64017070 con 0x7f1a74152540 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64005ce0 con 0x7f1a74152540 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640072f0 con 0x7f1a74152540 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a74151e50 con 0x7f1a74152540 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.996+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a741ee570 con 0x7f1a74152540 2024-03-08T20:38:32.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.998+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a741ee360 con 0x7f1a74152540 2024-03-08T20:38:32.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.998+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1a6401a070 con 0x7f1a74152540 2024-03-08T20:38:33.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.999+0000 7f1a6aa00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 0x7f1a5406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:32.999+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1a6408a300 con 0x7f1a74152540 2024-03-08T20:38:33.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.000+0000 7f1a71e00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 0x7f1a5406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.000+0000 7f1a71e00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 0x7f1a5406e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a60035000 tx=0x7f1a60008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.004+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1a640589e0 con 0x7f1a74152540 2024-03-08T20:38:33.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.201+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a74074a40 con 0x7f1a74152540 2024-03-08T20:38:33.202 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.202+0000 7f1a6aa00640 1 -- 172.21.15.118:0/1919692647 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a640582e0 con 0x7f1a74152540 2024-03-08T20:38:33.202 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 msgr2=0x7f1a5406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 0x7f1a5406e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a60035000 tx=0x7f1a60008030 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 msgr2=0x7f1a7414b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400c430 tx=0x7f1a6400c8f0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 shutdown_connections 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1a5406bc00 0x7f1a5406e0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a74158440 0x7f1a741eb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a74152920 0x7f1a74156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 --2- 172.21.15.118:0/1919692647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a74152540 0x7f1a7414b9c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 >> 172.21.15.118:0/1919692647 conn(0x7f1a740ac290 msgr2=0x7f1a7406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 shutdown_connections 2024-03-08T20:38:33.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.204+0000 7f1a78a00640 1 -- 172.21.15.118:0/1919692647 wait complete. 2024-03-08T20:38:33.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:38:33.376 INFO:tasks.workunit.client.1.smithi144.stderr:make: *** [Makefile:234: __sub-make] Error 2 2024-03-08T20:38:33.388 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-08T20:38:33.388 INFO:tasks.workunit:Stopping ['kernel_untar_build.sh'] on client.1... 2024-03-08T20:38:33.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-08T20:38:33.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.427+0000 7efe06000640 1 Processor -- start 2024-03-08T20:38:33.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.428+0000 7efe06000640 1 -- start start 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.429+0000 7efe06000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 0x7efe000c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.430+0000 7efe06000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c2530 0x7efe00071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.430+0000 7efe06000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe000c1aa0 0x7efe00071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.430+0000 7efe06000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000720a0 con 0x7efe000728b0 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.430+0000 7efe06000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe00155140 con 0x7efe000c1aa0 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.430+0000 7efe06000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c1560 con 0x7efe000c2530 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.431+0000 7efe04c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 0x7efe000c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.431+0000 7efe04c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 0x7efe000c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40750/0 (socket says 172.21.15.118:40750) 2024-03-08T20:38:33.432 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.431+0000 7efe04c00640 1 -- 172.21.15.118:0/595629111 learned_addr learned my addr 172.21.15.118:0/595629111 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:33.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.431+0000 7efdffe00640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c2530 0x7efe00071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.433 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.432+0000 7efe05600640 1 --2- 172.21.15.118:0/595629111 >> v2:172.21.15.144:3300/0 conn(0x7efe000c1aa0 0x7efe00071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.436+0000 7efe05600640 1 -- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c2530 msgr2=0x7efe00071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:33.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.436+0000 7efe05600640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c2530 0x7efe00071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.436+0000 7efe05600640 1 -- 172.21.15.118:0/595629111 >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 msgr2=0x7efe000c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:33.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.436+0000 7efe05600640 1 --2- 172.21.15.118:0/595629111 >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 0x7efe000c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.442 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.436+0000 7efe05600640 1 -- 172.21.15.118:0/595629111 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000c1840 con 0x7efe000c1aa0 2024-03-08T20:38:33.453 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.451+0000 7efe05600640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000c1aa0 0x7efe00071b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe00073490 tx=0x7efdf802ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62481f4a50dd9672 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.458+0000 7efdff400640 1 -- 172.21.15.118:0/595629111 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf803a070 con 0x7efe000c1aa0 2024-03-08T20:38:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.458+0000 7efdff400640 1 -- 172.21.15.118:0/595629111 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf802dc40 con 0x7efe000c1aa0 2024-03-08T20:38:33.458 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.458+0000 7efdff400640 1 -- 172.21.15.118:0/595629111 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8035440 con 0x7efe000c1aa0 2024-03-08T20:38:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 -- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000c1aa0 msgr2=0x7efe00071b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000c1aa0 0x7efe00071b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe00073490 tx=0x7efdf802ce90 comp rx=0 tx=0).stop 2024-03-08T20:38:33.459 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 -- 172.21.15.118:0/595629111 shutdown_connections 2024-03-08T20:38:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000c1aa0 0x7efe00071b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 --2- 172.21.15.118:0/595629111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c2530 0x7efe00071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 --2- 172.21.15.118:0/595629111 >> v2:172.21.15.118:3300/0 conn(0x7efe000728b0 0x7efe000c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.460 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.459+0000 7efe06000640 1 -- 172.21.15.118:0/595629111 >> 172.21.15.118:0/595629111 conn(0x7efe0006ad10 msgr2=0x7efe0006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:33.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.463+0000 7efe06000640 1 -- 172.21.15.118:0/595629111 shutdown_connections 2024-03-08T20:38:33.469 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.464+0000 7efe06000640 1 -- 172.21.15.118:0/595629111 wait complete. 2024-03-08T20:38:33.470 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.466+0000 7efe06000640 1 Processor -- start 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.472+0000 7efe06000640 1 -- start start 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.473+0000 7efe06000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000728b0 0x7efe001f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.473+0000 7efe06000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efe06000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 0x7efe00153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efe06000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00155620 con 0x7efe000c2530 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efe06000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c2d80 con 0x7efe000728b0 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efe06000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c6800 con 0x7efe000c1aa0 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efdffe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efdffe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:52194/0 (socket says 172.21.15.118:52194) 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efdffe00640 1 -- 172.21.15.118:0/3372174014 learned_addr learned my addr 172.21.15.118:0/3372174014 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:33.475 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.474+0000 7efe05600640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 0x7efe00153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efdffe00640 1 -- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000728b0 msgr2=0x7efe001f1d80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efdffe00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000728b0 0x7efe001f1d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efdffe00640 1 -- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 msgr2=0x7efe00153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efdffe00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 0x7efe00153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efdffe00640 1 -- 172.21.15.118:0/3372174014 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00151f30 con 0x7efe000c1aa0 2024-03-08T20:38:33.476 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.475+0000 7efe05600640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 0x7efe00153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:33.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.496+0000 7efdffe00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdec00d830 tx=0x7efdec00dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.497+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00b6c0 con 0x7efe000c1aa0 2024-03-08T20:38:33.498 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.497+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec019070 con 0x7efe000c1aa0 2024-03-08T20:38:33.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.497+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00ba80 con 0x7efe000c1aa0 2024-03-08T20:38:33.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.498+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe00151ab0 con 0x7efe000c1aa0 2024-03-08T20:38:33.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.499+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe001ef3d0 con 0x7efe000c1aa0 2024-03-08T20:38:33.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.501+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe000acbd0 con 0x7efe000c1aa0 2024-03-08T20:38:33.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.505+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efdec01e460 con 0x7efe000c1aa0 2024-03-08T20:38:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.507+0000 7efdfcc00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 0x7efde006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.507+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efdec08bb00 con 0x7efe000c1aa0 2024-03-08T20:38:33.508 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.507+0000 7efe04c00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 0x7efde006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.510+0000 7efe04c00640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 0x7efde006e110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe001ec3e0 tx=0x7efdf0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.515+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7efdec05a360 con 0x7efe000c1aa0 2024-03-08T20:38:33.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.751+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe000ac780 con 0x7efe000c1aa0 2024-03-08T20:38:33.753 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.753+0000 7efdfcc00640 1 -- 172.21.15.118:0/3372174014 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdec059c60 con 0x7efe000c1aa0 2024-03-08T20:38:33.753 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 msgr2=0x7efde006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 0x7efde006e110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe001ec3e0 tx=0x7efdf0008040 comp rx=0 tx=0).stop 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 msgr2=0x7efe000a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efdec00d830 tx=0x7efdec00dcf0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 shutdown_connections 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efde006bc50 0x7efde006e110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.756 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efe000c2530 0x7efe00153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe000c1aa0 0x7efe000a57a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 --2- 172.21.15.118:0/3372174014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe000728b0 0x7efe001f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 >> 172.21.15.118:0/3372174014 conn(0x7efe0006ad10 msgr2=0x7efe000a65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:33.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.755+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 shutdown_connections 2024-03-08T20:38:33.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.756+0000 7efe06000640 1 -- 172.21.15.118:0/3372174014 wait complete. 2024-03-08T20:38:33.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:38:33.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.970+0000 7f92a5400640 1 Processor -- start 2024-03-08T20:38:33.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.970+0000 7f92a5400640 1 -- start start 2024-03-08T20:38:33.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92a0150240 0x7f92a006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.972 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a00c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92a00c2800 0x7f92a0156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a0152b70 con 0x7f92a00c2800 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a0152e30 con 0x7f92a0150240 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a5400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0153110 con 0x7f92a006dcd0 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a4a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92a00c2800 0x7f92a0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a4a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f92a00c2800 0x7f92a0156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40756/0 (socket says 172.21.15.118:40756) 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f92a4a00640 1 -- 172.21.15.118:0/3726207581 learned_addr learned my addr 172.21.15.118:0/3726207581 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f929fe00640 1 --2- 172.21.15.118:0/3726207581 >> v2:172.21.15.144:3300/0 conn(0x7f92a0150240 0x7f92a006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.973 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.972+0000 7f9297e00640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a00c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f92a4a00640 1 -- 172.21.15.118:0/3726207581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 msgr2=0x7f92a00c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a00c22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f92a4a00640 1 -- 172.21.15.118:0/3726207581 >> v2:172.21.15.144:3300/0 conn(0x7f92a0150240 msgr2=0x7f92a006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3726207581 >> v2:172.21.15.144:3300/0 conn(0x7f92a0150240 0x7f92a006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f92a4a00640 1 -- 172.21.15.118:0/3726207581 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a01533f0 con 0x7f92a00c2800 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.973+0000 7f9297e00640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a00c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:33.974 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a00c2800 0x7f92a0156160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f92a00c7470 tx=0x7f929802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ea7a9012a60de server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f929f400640 1 -- 172.21.15.118:0/3726207581 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929802c9e0 con 0x7f92a00c2800 2024-03-08T20:38:33.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f929f400640 1 -- 172.21.15.118:0/3726207581 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929802cb80 con 0x7f92a00c2800 2024-03-08T20:38:33.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f929f400640 1 -- 172.21.15.118:0/3726207581 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980343f0 con 0x7f92a00c2800 2024-03-08T20:38:33.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f92a5400640 1 -- 172.21.15.118:0/3726207581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a00c2800 msgr2=0x7f92a0156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.974+0000 7f92a5400640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a00c2800 0x7f92a0156160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f92a00c7470 tx=0x7f929802be40 comp rx=0 tx=0).stop 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 -- 172.21.15.118:0/3726207581 shutdown_connections 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a00c2800 0x7f92a0156160 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 --2- 172.21.15.118:0/3726207581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a00c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 --2- 172.21.15.118:0/3726207581 >> v2:172.21.15.144:3300/0 conn(0x7f92a0150240 0x7f92a006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 -- 172.21.15.118:0/3726207581 >> 172.21.15.118:0/3726207581 conn(0x7f92a00c6480 msgr2=0x7f92a00c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 -- 172.21.15.118:0/3726207581 shutdown_connections 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.975+0000 7f92a5400640 1 -- 172.21.15.118:0/3726207581 wait complete. 2024-03-08T20:38:33.976 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.976+0000 7f92a5400640 1 Processor -- start 2024-03-08T20:38:33.977 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.976+0000 7f92a5400640 1 -- start start 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 0x7f92a0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a006ecd0 con 0x7f92a0150240 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a006eb50 con 0x7f92a00c2800 2024-03-08T20:38:33.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.977+0000 7f92a5400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a01566a0 con 0x7f92a006dcd0 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40770/0 (socket says 172.21.15.118:40770) 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 -- 172.21.15.118:0/3307692632 learned_addr learned my addr 172.21.15.118:0/3307692632 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f9297e00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 0x7f92a0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 -- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 msgr2=0x7f92a013e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 -- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 msgr2=0x7f92a0151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 0x7f92a0151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 -- 172.21.15.118:0/3307692632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0155df0 con 0x7f92a0150240 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f9297e00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 0x7f92a0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.978+0000 7f92a4a00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9298009f40 tx=0x7f9298004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.979+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298043020 con 0x7f92a0150240 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.979+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929803e450 con 0x7f92a0150240 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.979+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298009510 con 0x7f92a0150240 2024-03-08T20:38:33.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.979+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a014f080 con 0x7f92a0150240 2024-03-08T20:38:33.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.979+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a014f640 con 0x7f92a0150240 2024-03-08T20:38:33.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.980+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0074a40 con 0x7f92a0150240 2024-03-08T20:38:33.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.981+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9298046020 con 0x7f92a0150240 2024-03-08T20:38:33.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.981+0000 7f929cc00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 0x7f927c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:33.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.981+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f92980ad7f0 con 0x7f92a0150240 2024-03-08T20:38:33.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.982+0000 7f929fe00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 0x7f927c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:33.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.982+0000 7f929fe00640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 0x7f927c06e0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9290006a90 tx=0x7f9290006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:33.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:33.986+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f929804d020 con 0x7f92a0150240 2024-03-08T20:38:34.181 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.180+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f92a0148330 con 0x7f92a0150240 2024-03-08T20:38:34.182 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.181+0000 7f929cc00640 1 -- 172.21.15.118:0/3307692632 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f929807bff0 con 0x7f92a0150240 2024-03-08T20:38:34.182 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 msgr2=0x7f927c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 0x7f927c06e0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9290006a90 tx=0x7f9290006a20 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 msgr2=0x7f92a01eac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9298009f40 tx=0x7f9298004a40 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 shutdown_connections 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f927c06bc00 0x7f927c06e0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f92a0150240 0x7f92a01eac00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a00c2800 0x7f92a0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 --2- 172.21.15.118:0/3307692632 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92a006dcd0 0x7f92a013e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 >> 172.21.15.118:0/3307692632 conn(0x7f92a00c6480 msgr2=0x7f92a00c3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 shutdown_connections 2024-03-08T20:38:34.185 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.184+0000 7f92a5400640 1 -- 172.21.15.118:0/3307692632 wait complete. 2024-03-08T20:38:34.203 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T20:38:34.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.387+0000 7f1179e00640 1 Processor -- start 2024-03-08T20:38:34.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.387+0000 7f1179e00640 1 -- start start 2024-03-08T20:38:34.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f117414c9d0 0x7f11741534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11741539f0 con 0x7f117406dba0 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740ab600 con 0x7f117406ee40 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740ab8e0 con 0x7f117414c9d0 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1178a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f117414c9d0 0x7f11741534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f117406dba0 0x7f117406e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57780/0 (socket says 172.21.15.118:57780) 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1179400640 1 -- 172.21.15.118:0/3719586914 learned_addr learned my addr 172.21.15.118:0/3719586914 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1178a00640 1 -- 172.21.15.118:0/3719586914 >> v1:172.21.15.144:6789/0 conn(0x7f117406ee40 legacy=0x7f11740a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1178a00640 1 -- 172.21.15.118:0/3719586914 >> v1:172.21.15.118:6789/0 conn(0x7f117406dba0 legacy=0x7f117406e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.389+0000 7f1178a00640 1 -- 172.21.15.118:0/3719586914 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740abbc0 con 0x7f117414c9d0 2024-03-08T20:38:34.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.390+0000 7f1178a00640 1 --2- 172.21.15.118:0/3719586914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117414c9d0 0x7f11741534b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f11680097a0 tx=0x7f116802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf551f1f1db55fe server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1173400640 1 -- 172.21.15.118:0/3719586914 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680315a0 con 0x7f117414c9d0 2024-03-08T20:38:34.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1173400640 1 -- 172.21.15.118:0/3719586914 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1168037070 con 0x7f117414c9d0 2024-03-08T20:38:34.391 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1173400640 1 -- 172.21.15.118:0/3719586914 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168031960 con 0x7f117414c9d0 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1179e00640 1 -- 172.21.15.118:0/3719586914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117414c9d0 msgr2=0x7f11741534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1179e00640 1 --2- 172.21.15.118:0/3719586914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117414c9d0 0x7f11741534b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f11680097a0 tx=0x7f116802b840 comp rx=0 tx=0).stop 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.391+0000 7f1179e00640 1 -- 172.21.15.118:0/3719586914 shutdown_connections 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.392+0000 7f1179e00640 1 --2- 172.21.15.118:0/3719586914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117414c9d0 0x7f11741534b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.392+0000 7f1179e00640 1 -- 172.21.15.118:0/3719586914 >> 172.21.15.118:0/3719586914 conn(0x7f117406ad10 msgr2=0x7f117406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:34.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.392+0000 7f1179e00640 1 -- 172.21.15.118:0/3719586914 shutdown_connections 2024-03-08T20:38:34.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.392+0000 7f1179e00640 1 -- 172.21.15.118:0/3719586914 wait complete. 2024-03-08T20:38:34.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.393+0000 7f1179e00640 1 Processor -- start 2024-03-08T20:38:34.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.393+0000 7f1179e00640 1 -- start start 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 0x7f1174156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f117414c9d0 0x7f1174146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117406e740 con 0x7f117406ee40 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740ac180 con 0x7f117414c9d0 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1179e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740a9b60 con 0x7f117406dba0 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1173e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1173e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40786/0 (socket says 172.21.15.118:40786) 2024-03-08T20:38:34.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.394+0000 7f1173e00640 1 -- 172.21.15.118:0/3308320475 learned_addr learned my addr 172.21.15.118:0/3308320475 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1179400640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f117414c9d0 0x7f1174146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1178a00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 0x7f1174156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 -- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 msgr2=0x7f1174156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 0x7f1174156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 -- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f117414c9d0 msgr2=0x7f1174146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f117414c9d0 0x7f1174146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 -- 172.21.15.118:0/3308320475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11741dea70 con 0x7f117406ee40 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1178a00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 0x7f1174156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1173e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f116000c430 tx=0x7f116000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160017070 con 0x7f117406ee40 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600052d0 con 0x7f117406ee40 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160003830 con 0x7f117406ee40 2024-03-08T20:38:34.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11741ded50 con 0x7f117406ee40 2024-03-08T20:38:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.395+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11741dd2a0 con 0x7f117406ee40 2024-03-08T20:38:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.396+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740c0da0 con 0x7f117406ee40 2024-03-08T20:38:34.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.397+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f116001a070 con 0x7f117406ee40 2024-03-08T20:38:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.399+0000 7f1170c00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 0x7f115406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.399+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f116008a220 con 0x7f117406ee40 2024-03-08T20:38:34.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.399+0000 7f1178a00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 0x7f115406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.400 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.400+0000 7f1178a00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 0x7f115406e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1168036000 tx=0x7f1168008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.404+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1160058900 con 0x7f117406ee40 2024-03-08T20:38:34.455 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-08T20:38:34.456 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:38:34.456 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:34.504 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:38:34.504 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:34.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:38:34.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.600+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f117414a0b0 con 0x7f117406ee40 2024-03-08T20:38:34.603 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.601+0000 7f1170c00640 1 -- 172.21.15.118:0/3308320475 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1160058200 con 0x7f117406ee40 2024-03-08T20:38:34.603 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-03-08T20:38:34.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.603+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 msgr2=0x7f115406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.603+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 0x7f115406e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1168036000 tx=0x7f1168008030 comp rx=0 tx=0).stop 2024-03-08T20:38:34.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.603+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 msgr2=0x7f1174145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.604 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.603+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f116000c430 tx=0x7f116000c8f0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 shutdown_connections 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f115406bbd0 0x7f115406e090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f117414c9d0 0x7f1174146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f117406ee40 0x7f1174145c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 --2- 172.21.15.118:0/3308320475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f117406dba0 0x7f1174156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 >> 172.21.15.118:0/3308320475 conn(0x7f117406ad10 msgr2=0x7f11741508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 shutdown_connections 2024-03-08T20:38:34.605 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.604+0000 7f1179e00640 1 -- 172.21.15.118:0/3308320475 wait complete. 2024-03-08T20:38:34.621 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2024-03-08T20:38:34.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:34.622 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-08T20:38:34.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi118.stderr:ceph-fuse[45695]: fuse finished with error 0 and tester_r 0 2024-03-08T20:38:34.736 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:38:34.884 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.807+0000 7f1bac000640 1 Processor -- start 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.807+0000 7f1bac000640 1 -- start start 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1bac000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ba415f370 0x7f1ba40c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1bac000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ba40c6b20 0x7f1ba41623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1bac000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba40c3fe0 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1bac000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba41628f0 con 0x7f1ba40c6b20 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1bac000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba406e090 con 0x7f1ba415f370 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.808+0000 7f1baa000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ba40c6b20 0x7f1ba41623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.809+0000 7f1baa000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1ba40c6b20 0x7f1ba41623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40802/0 (socket says 172.21.15.118:40802) 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.809+0000 7f1baa000640 1 -- 172.21.15.118:0/1490558688 learned_addr learned my addr 172.21.15.118:0/1490558688 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.810+0000 7f1ba3e00640 1 -- 172.21.15.118:0/1490558688 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657782687 0 0) 0x7f1ba40c3fe0 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.884+0000 7f1ba3e00640 1 -- 172.21.15.118:0/1490558688 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b8c005730 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.809+0000 7f1ba9600640 1 --2- 172.21.15.118:0/1490558688 >> v2:172.21.15.144:3300/0 conn(0x7f1ba415f370 0x7f1ba40c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.884+0000 7f1baa000640 1 -- 172.21.15.118:0/1490558688 >> v2:172.21.15.144:3300/0 conn(0x7f1ba415f370 msgr2=0x7f1ba40c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:34.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.884+0000 7f1baa000640 1 --2- 172.21.15.118:0/1490558688 >> v2:172.21.15.144:3300/0 conn(0x7f1ba415f370 0x7f1ba40c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.884+0000 7f1baa000640 1 -- 172.21.15.118:0/1490558688 >> v1:172.21.15.144:6789/0 conn(0x7f1ba40c3ae0 legacy=0x7f1ba4161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.884+0000 7f1baa000640 1 -- 172.21.15.118:0/1490558688 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba406e370 con 0x7f1ba40c6b20 2024-03-08T20:38:34.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.885+0000 7f1baa000640 1 --2- 172.21.15.118:0/1490558688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c6b20 0x7f1ba41623b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406bdb0 tx=0x7f1b9c0347c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860203a6c47596a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.892+0000 7f1ba3e00640 1 -- 172.21.15.118:0/1490558688 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c041070 con 0x7f1ba40c6b20 2024-03-08T20:38:34.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.892+0000 7f1ba3e00640 1 -- 172.21.15.118:0/1490558688 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c03a520 con 0x7f1ba40c6b20 2024-03-08T20:38:34.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.892+0000 7f1ba3e00640 1 -- 172.21.15.118:0/1490558688 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c03a8f0 con 0x7f1ba40c6b20 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.895+0000 7f1bac000640 1 -- 172.21.15.118:0/1490558688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c6b20 msgr2=0x7f1ba41623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.895+0000 7f1bac000640 1 --2- 172.21.15.118:0/1490558688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c6b20 0x7f1ba41623b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ba406bdb0 tx=0x7f1b9c0347c0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.896+0000 7f1bac000640 1 -- 172.21.15.118:0/1490558688 shutdown_connections 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.896+0000 7f1bac000640 1 --2- 172.21.15.118:0/1490558688 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c6b20 0x7f1ba41623b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.896+0000 7f1bac000640 1 --2- 172.21.15.118:0/1490558688 >> v2:172.21.15.144:3300/0 conn(0x7f1ba415f370 0x7f1ba40c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.896+0000 7f1bac000640 1 -- 172.21.15.118:0/1490558688 >> 172.21.15.118:0/1490558688 conn(0x7f1ba406d750 msgr2=0x7f1ba40a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:34.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.900+0000 7f1bac000640 1 -- 172.21.15.118:0/1490558688 shutdown_connections 2024-03-08T20:38:34.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.900+0000 7f1bac000640 1 -- 172.21.15.118:0/1490558688 wait complete. 2024-03-08T20:38:34.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.903+0000 7f1bac000640 1 Processor -- start 2024-03-08T20:38:34.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.903+0000 7f1bac000640 1 -- start start 2024-03-08T20:38:34.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ba40c6b20 0x7f1ba415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ba415f370 0x7f1ba415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c2ce0 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba415f750 con 0x7f1ba40c6b20 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.905+0000 7f1bac000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c2e60 con 0x7f1ba415f370 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ba40c6b20 0x7f1ba415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40818/0 (socket says 172.21.15.118:40818) 2024-03-08T20:38:34.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 -- 172.21.15.118:0/4072483927 learned_addr learned my addr 172.21.15.118:0/4072483927 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:34.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 -- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ba415f370 msgr2=0x7f1ba415bce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T20:38:34.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ba415f370 0x7f1ba415bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 -- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ba40c6b20 msgr2=0x7f1ba415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ba40c6b20 0x7f1ba415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.906+0000 7f1ba9600640 1 -- 172.21.15.118:0/4072483927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4165ba0 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.907+0000 7f1ba9600640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800e9b0 tx=0x7f1b9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.907+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98017070 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.907+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800c9a0 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.907+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800cd90 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.907+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba4165920 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.908+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba4164e40 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.909+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba4074a40 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.911+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1b9801a070 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.912+0000 7f1ba1600640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 0x7f1b8406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:34.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.913+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1b9808ad50 con 0x7f1ba40c3ae0 2024-03-08T20:38:34.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.914+0000 7f1ba8c00640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 0x7f1b8406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:34.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.915+0000 7f1ba8c00640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 0x7f1b8406e0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b90007fd0 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:34.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:34.918+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1ba4165920 con 0x7f1ba40c3ae0 2024-03-08T20:38:35.120 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.120+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ba415c220 con 0x7f1ba40c3ae0 2024-03-08T20:38:35.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.121+0000 7f1ba1600640 1 -- 172.21.15.118:0/4072483927 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18950 (secure 0 0 0) 0x7f1b98058de0 con 0x7f1ba40c3ae0 2024-03-08T20:38:35.122 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:35.122 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:30:10.610951+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:38:35.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 msgr2=0x7f1b8406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 0x7f1b8406e0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b90007fd0 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 msgr2=0x7f1ba40c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800e9b0 tx=0x7f1b9800ee70 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 shutdown_connections 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f1b8406bc00 0x7f1b8406e0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ba415f370 0x7f1ba415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ba40c6b20 0x7f1ba415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 --2- 172.21.15.118:0/4072483927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1ba40c3ae0 0x7f1ba40c5540 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 >> 172.21.15.118:0/4072483927 conn(0x7f1ba406d750 msgr2=0x7f1ba40a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 shutdown_connections 2024-03-08T20:38:35.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.124+0000 7f1bac000640 1 -- 172.21.15.118:0/4072483927 wait complete. 2024-03-08T20:38:35.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T20:29:17.585224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T20:29:21.753369+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T20:29:22.731464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-08T20:29:26.295918+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-08T20:38:35.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T20:38:35.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.353+0000 7fd207e00640 1 Processor -- start 2024-03-08T20:38:35.353 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.354+0000 7fd207e00640 1 -- start start 2024-03-08T20:38:35.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd207e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd200159e20 0x7fd2000c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd207e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20015a270 con 0x7fd200156760 2024-03-08T20:38:35.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd207e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20006d230 con 0x7fd2000c0890 2024-03-08T20:38:35.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd207e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20015d060 con 0x7fd200159e20 2024-03-08T20:38:35.354 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd200156760 0x7fd20015c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:57792/0 (socket says 172.21.15.118:57792) 2024-03-08T20:38:35.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205400640 1 -- 172.21.15.118:0/195722771 learned_addr learned my addr 172.21.15.118:0/195722771 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:35.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205e00640 1 --2- 172.21.15.118:0/195722771 >> v2:172.21.15.118:3300/0 conn(0x7fd200159e20 0x7fd2000c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205e00640 1 -- 172.21.15.118:0/195722771 >> v1:172.21.15.144:6789/0 conn(0x7fd2000c0890 legacy=0x7fd20006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:35.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205e00640 1 -- 172.21.15.118:0/195722771 >> v1:172.21.15.118:6789/0 conn(0x7fd200156760 legacy=0x7fd20015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.355 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd205e00640 1 -- 172.21.15.118:0/195722771 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd200159360 con 0x7fd200159e20 2024-03-08T20:38:35.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.355+0000 7fd1ffe00640 1 -- 172.21.15.118:0/195722771 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167863903 0 0) 0x7fd20015a270 con 0x7fd200156760 2024-03-08T20:38:35.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.356+0000 7fd205e00640 1 --2- 172.21.15.118:0/195722771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200159e20 0x7fd2000c5540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b83bdd39e3a2239 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd1ffe00640 1 -- 172.21.15.118:0/195722771 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8039070 con 0x7fd200159e20 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd1ffe00640 1 -- 172.21.15.118:0/195722771 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f802cc60 con 0x7fd200159e20 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd1ffe00640 1 -- 172.21.15.118:0/195722771 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8034660 con 0x7fd200159e20 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd207e00640 1 -- 172.21.15.118:0/195722771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200159e20 msgr2=0x7fd2000c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd207e00640 1 --2- 172.21.15.118:0/195722771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200159e20 0x7fd2000c5540 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d90 tx=0x7fd1f802beb0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd207e00640 1 -- 172.21.15.118:0/195722771 shutdown_connections 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd207e00640 1 --2- 172.21.15.118:0/195722771 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200159e20 0x7fd2000c5540 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.357+0000 7fd207e00640 1 -- 172.21.15.118:0/195722771 >> 172.21.15.118:0/195722771 conn(0x7fd20006b720 msgr2=0x7fd2000c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.358+0000 7fd207e00640 1 -- 172.21.15.118:0/195722771 shutdown_connections 2024-03-08T20:38:35.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.358+0000 7fd207e00640 1 -- 172.21.15.118:0/195722771 wait complete. 2024-03-08T20:38:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.359+0000 7fd207e00640 1 Processor -- start 2024-03-08T20:38:35.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.359+0000 7fd207e00640 1 -- start start 2024-03-08T20:38:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2000c0890 0x7fd200071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd200159e20 0x7fd20014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.360 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c5f90 con 0x7fd200156760 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd200159620 con 0x7fd2000c0890 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd207e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd200159900 con 0x7fd200159e20 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd204a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd204a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40836/0 (socket says 172.21.15.118:40836) 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.360+0000 7fd204a00640 1 -- 172.21.15.118:0/1951478046 learned_addr learned my addr 172.21.15.118:0/1951478046 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd205e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd200159e20 0x7fd20014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd205400640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2000c0890 0x7fd200071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 -- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd200159e20 msgr2=0x7fd20014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd200159e20 0x7fd20014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 -- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2000c0890 msgr2=0x7fd200071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2000c0890 0x7fd200071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 -- 172.21.15.118:0/1951478046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2001ef9c0 con 0x7fd200156760 2024-03-08T20:38:35.361 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd204a00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c460 tx=0x7fd1f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4016020 con 0x7fd200156760 2024-03-08T20:38:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4012870 con 0x7fd200156760 2024-03-08T20:38:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.361+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4012c60 con 0x7fd200156760 2024-03-08T20:38:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.362+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2001efca0 con 0x7fd200156760 2024-03-08T20:38:35.362 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.362+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20015c5d0 con 0x7fd200156760 2024-03-08T20:38:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.363+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd200074a40 con 0x7fd200156760 2024-03-08T20:38:35.363 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.364+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd1f4019020 con 0x7fd200156760 2024-03-08T20:38:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.366+0000 7fd1fd600640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 0x7fd1e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.366+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd1f408adf0 con 0x7fd200156760 2024-03-08T20:38:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.366+0000 7fd205400640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 0x7fd1e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.365 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.366+0000 7fd205400640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 0x7fd1e406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0007fd0 tx=0x7fd1f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.369 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.370+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd1f4020020 con 0x7fd200156760 2024-03-08T20:38:35.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.551+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd20015c7d0 con 0x7fd200156760 2024-03-08T20:38:35.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.552+0000 7fd1fd600640 1 -- 172.21.15.118:0/1951478046 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1f40182c0 con 0x7fd200156760 2024-03-08T20:38:35.552 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 1 2024-03-08T20:38:35.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 msgr2=0x7fd1e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 0x7fd1e406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0007fd0 tx=0x7fd1f0009040 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 msgr2=0x7fd20014f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c460 tx=0x7fd1f400c920 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 shutdown_connections 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd1e406bbd0 0x7fd1e406e090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd200159e20 0x7fd20014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd200156760 0x7fd20014f370 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 --2- 172.21.15.118:0/1951478046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2000c0890 0x7fd200071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 >> 172.21.15.118:0/1951478046 conn(0x7fd20006b720 msgr2=0x7fd20015d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:35.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 shutdown_connections 2024-03-08T20:38:35.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.555+0000 7fd207e00640 1 -- 172.21.15.118:0/1951478046 wait complete. 2024-03-08T20:38:35.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T20:38:35.779 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.780+0000 7f70caa00640 1 Processor -- start 2024-03-08T20:38:35.780 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.780+0000 7f70caa00640 1 -- start start 2024-03-08T20:38:35.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c406dcd0 0x7f70c40c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70c40c2800 0x7f70c4156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c4152b70 con 0x7f70c406dcd0 2024-03-08T20:38:35.782 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c4152e30 con 0x7f70c40c2800 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.781+0000 7f70caa00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c4153110 con 0x7f70c4150240 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c406dcd0 0x7f70c40c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70c406dcd0 0x7f70c40c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40844/0 (socket says 172.21.15.118:40844) 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 -- 172.21.15.118:0/3297350788 learned_addr learned my addr 172.21.15.118:0/3297350788 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c9600640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 -- 172.21.15.118:0/3297350788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 msgr2=0x7f70c406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 -- 172.21.15.118:0/3297350788 >> v2:172.21.15.144:3300/0 conn(0x7f70c40c2800 msgr2=0x7f70c4156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70ca000640 1 --2- 172.21.15.118:0/3297350788 >> v2:172.21.15.144:3300/0 conn(0x7f70c40c2800 0x7f70c4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 --2- 172.21.15.118:0/3297350788 >> v2:172.21.15.144:3300/0 conn(0x7f70c40c2800 0x7f70c4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.783 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.782+0000 7f70c8c00640 1 -- 172.21.15.118:0/3297350788 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c41533f0 con 0x7f70c406dcd0 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.783+0000 7f70c8c00640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c40c22c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70c40c3dd0 tx=0x7f70b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c5d02842b4fb66 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70c3e00640 1 -- 172.21.15.118:0/3297350788 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b002e070 con 0x7f70c406dcd0 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70c3e00640 1 -- 172.21.15.118:0/3297350788 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0037070 con 0x7f70c406dcd0 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70c3e00640 1 -- 172.21.15.118:0/3297350788 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0031a00 con 0x7f70c406dcd0 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 -- 172.21.15.118:0/3297350788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 msgr2=0x7f70c40c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c40c22c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f70c40c3dd0 tx=0x7f70b002b880 comp rx=0 tx=0).stop 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 -- 172.21.15.118:0/3297350788 shutdown_connections 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 --2- 172.21.15.118:0/3297350788 >> v2:172.21.15.144:3300/0 conn(0x7f70c40c2800 0x7f70c4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c40c22c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 --2- 172.21.15.118:0/3297350788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.784+0000 7f70caa00640 1 -- 172.21.15.118:0/3297350788 >> 172.21.15.118:0/3297350788 conn(0x7f70c40c6480 msgr2=0x7f70c40c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.785+0000 7f70caa00640 1 -- 172.21.15.118:0/3297350788 shutdown_connections 2024-03-08T20:38:35.785 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.785+0000 7f70caa00640 1 -- 172.21.15.118:0/3297350788 wait complete. 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.786+0000 7f70caa00640 1 Processor -- start 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.786+0000 7f70caa00640 1 -- start start 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c40c2800 0x7f70c41ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c41ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c406ecd0 con 0x7f70c406dcd0 2024-03-08T20:38:35.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c406eb50 con 0x7f70c40c2800 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70caa00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41566a0 con 0x7f70c4150240 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70c9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70c9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40852/0 (socket says 172.21.15.118:40852) 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.787+0000 7f70c9600640 1 -- 172.21.15.118:0/2722041723 learned_addr learned my addr 172.21.15.118:0/2722041723 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70ca000640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c41ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c8c00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c40c2800 0x7f70c41ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 -- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 msgr2=0x7f70c41ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c41ee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 -- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c40c2800 msgr2=0x7f70c41ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c40c2800 0x7f70c41ee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.788 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 -- 172.21.15.118:0/2722041723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c40c5b40 con 0x7f70c406dcd0 2024-03-08T20:38:35.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c9600640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c7f0 tx=0x7f70b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.788+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8015070 con 0x7f70c406dcd0 2024-03-08T20:38:35.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.789+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8004220 con 0x7f70c406dcd0 2024-03-08T20:38:35.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.789+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c40c5e20 con 0x7f70c406dcd0 2024-03-08T20:38:35.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.789+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8007620 con 0x7f70c406dcd0 2024-03-08T20:38:35.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.789+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c4154f10 con 0x7f70c406dcd0 2024-03-08T20:38:35.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.790+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c4074a40 con 0x7f70c406dcd0 2024-03-08T20:38:35.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.791+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f70b80079d0 con 0x7f70c406dcd0 2024-03-08T20:38:35.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.791+0000 7f70c1600640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 0x7f70a406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:35.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.791+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f70b808b260 con 0x7f70c406dcd0 2024-03-08T20:38:35.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.792+0000 7f70c8c00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 0x7f70a406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:35.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.792+0000 7f70c8c00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 0x7f70a406e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70b0036000 tx=0x7f70b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:35.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.796+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f70b8059940 con 0x7f70c406dcd0 2024-03-08T20:38:35.979 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.980+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70c4155150 con 0x7f70c406dcd0 2024-03-08T20:38:35.980 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.981+0000 7f70c1600640 1 -- 172.21.15.118:0/2722041723 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70c4155150 con 0x7f70c406dcd0 2024-03-08T20:38:35.980 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 msgr2=0x7f70a406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 0x7f70a406e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70b0036000 tx=0x7f70b0008030 comp rx=0 tx=0).stop 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 msgr2=0x7f70c4072310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c7f0 tx=0x7f70b800ccb0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 shutdown_connections 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f70a406bbd0 0x7f70a406e090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70c4150240 0x7f70c41ee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70c40c2800 0x7f70c41ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 --2- 172.21.15.118:0/2722041723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70c406dcd0 0x7f70c4072310 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:35.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.983+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 >> 172.21.15.118:0/2722041723 conn(0x7f70c40c6480 msgr2=0x7f70c415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:35.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.984+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 shutdown_connections 2024-03-08T20:38:35.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:35.984+0000 7f70caa00640 1 -- 172.21.15.118:0/2722041723 wait complete. 2024-03-08T20:38:36.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T20:38:36.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.210+0000 7fd199600640 1 Processor -- start 2024-03-08T20:38:36.210 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.211+0000 7fd199600640 1 -- start start 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd199600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19406e4b0 0x7fd194152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd199600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1940c5a20 0x7fd19406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd199600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1940c4980 con 0x7fd1940c4480 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd199600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1940c5590 con 0x7fd1940c5a20 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd199600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940c4c60 con 0x7fd19406e4b0 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd193400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1940c5a20 0x7fd19406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd193400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1940c5a20 0x7fd19406e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40858/0 (socket says 172.21.15.118:40858) 2024-03-08T20:38:36.212 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd193400640 1 -- 172.21.15.118:0/2417938043 learned_addr learned my addr 172.21.15.118:0/2417938043 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.212+0000 7fd192a00640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19406e4b0 0x7fd194152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.213+0000 7fd193400640 1 -- 172.21.15.118:0/2417938043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19406e4b0 msgr2=0x7fd194152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.213+0000 7fd193400640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19406e4b0 0x7fd194152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.213+0000 7fd193400640 1 -- 172.21.15.118:0/2417938043 >> v1:172.21.15.144:6789/0 conn(0x7fd1940c4480 legacy=0x7fd1941541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.213+0000 7fd193400640 1 -- 172.21.15.118:0/2417938043 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940c4f40 con 0x7fd1940c5a20 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.214+0000 7fd193400640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1940c5a20 0x7fd19406e890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009e50 tx=0x7fd18c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547bba923c3e431b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.213 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.214+0000 7fd192000640 1 -- 172.21.15.118:0/2417938043 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c02c9e0 con 0x7fd1940c5a20 2024-03-08T20:38:36.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.214+0000 7fd192000640 1 -- 172.21.15.118:0/2417938043 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c02cb80 con 0x7fd1940c5a20 2024-03-08T20:38:36.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.214+0000 7fd192000640 1 -- 172.21.15.118:0/2417938043 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0343f0 con 0x7fd1940c5a20 2024-03-08T20:38:36.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 -- 172.21.15.118:0/2417938043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1940c5a20 msgr2=0x7fd19406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.214 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1940c5a20 0x7fd19406e890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009e50 tx=0x7fd18c02be40 comp rx=0 tx=0).stop 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 -- 172.21.15.118:0/2417938043 shutdown_connections 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd1940c5a20 0x7fd19406e890 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 --2- 172.21.15.118:0/2417938043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd19406e4b0 0x7fd194152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 -- 172.21.15.118:0/2417938043 >> 172.21.15.118:0/2417938043 conn(0x7fd19406b720 msgr2=0x7fd1940c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 -- 172.21.15.118:0/2417938043 shutdown_connections 2024-03-08T20:38:36.215 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.215+0000 7fd199600640 1 -- 172.21.15.118:0/2417938043 wait complete. 2024-03-08T20:38:36.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.216+0000 7fd199600640 1 Processor -- start 2024-03-08T20:38:36.216 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 -- start start 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 0x7fd19414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1940c5a20 0x7fd19414cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1941505f0 con 0x7fd19406e4b0 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1940c5e70 con 0x7fd1940c5a20 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.217+0000 7fd199600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd194150770 con 0x7fd1940c4480 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40864/0 (socket says 172.21.15.118:40864) 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 -- 172.21.15.118:0/3735345622 learned_addr learned my addr 172.21.15.118:0/3735345622 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd193400640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1940c5a20 0x7fd19414cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd18a000640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 0x7fd19414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.218 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 -- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 msgr2=0x7fd19414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 0x7fd19414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 -- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1940c5a20 msgr2=0x7fd19414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1940c5a20 0x7fd19414cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 -- 172.21.15.118:0/3735345622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19414cff0 con 0x7fd19406e4b0 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd18a000640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 0x7fd19414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:36.219 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.218+0000 7fd192a00640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d800 tx=0x7fd18400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.219+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400b6c0 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.219+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184019070 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.219+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400ba80 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.219+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1941eb090 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.219+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1941eb650 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.220+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd194074a40 con 0x7fd19406e4b0 2024-03-08T20:38:36.220 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.221+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd18400bc20 con 0x7fd19406e4b0 2024-03-08T20:38:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.222+0000 7fd18b400640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 0x7fd17006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.222+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd18408b400 con 0x7fd19406e4b0 2024-03-08T20:38:36.221 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.222+0000 7fd18a000640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 0x7fd17006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.222 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.223+0000 7fd18a000640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 0x7fd17006e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1940c0450 tx=0x7fd17c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.225 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.226+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd184059a50 con 0x7fd19406e4b0 2024-03-08T20:38:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.424+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1940abb10 con 0x7fd19406e4b0 2024-03-08T20:38:36.424 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.425+0000 7fd18b400640 1 -- 172.21.15.118:0/3735345622 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd184059350 con 0x7fd19406e4b0 2024-03-08T20:38:36.425 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 64 2024-03-08T20:38:36.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.427+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 msgr2=0x7fd17006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.427+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 0x7fd17006e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1940c0450 tx=0x7fd17c009040 comp rx=0 tx=0).stop 2024-03-08T20:38:36.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.427+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 msgr2=0x7fd1940bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.427 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.427+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd18400d800 tx=0x7fd18400dcc0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 shutdown_connections 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd17006bbd0 0x7fd17006e090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1940c5a20 0x7fd19414cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1940c4480 0x7fd19414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 --2- 172.21.15.118:0/3735345622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd19406e4b0 0x7fd1940bfc20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 >> 172.21.15.118:0/3735345622 conn(0x7fd19406b720 msgr2=0x7fd1940c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 shutdown_connections 2024-03-08T20:38:36.428 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.428+0000 7fd199600640 1 -- 172.21.15.118:0/3735345622 wait complete. 2024-03-08T20:38:36.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-08T20:38:36.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.648+0000 7f3a1f000640 1 Processor -- start 2024-03-08T20:38:36.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.648+0000 7f3a1f000640 1 -- start start 2024-03-08T20:38:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.649+0000 7f3a1f000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.649+0000 7f3a1f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a180c4480 0x7f3a181541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a1f000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a18154710 con 0x7f3a180c5a20 2024-03-08T20:38:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a1f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180c5590 con 0x7f3a180c4480 2024-03-08T20:38:36.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a1f000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c4980 con 0x7f3a1806e4b0 2024-03-08T20:38:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a17e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a17e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:52274/0 (socket says 172.21.15.118:52274) 2024-03-08T20:38:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a17e00640 1 -- 172.21.15.118:0/4257891783 learned_addr learned my addr 172.21.15.118:0/4257891783 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:36.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.650+0000 7f3a17400640 1 --2- 172.21.15.118:0/4257891783 >> v2:172.21.15.144:3300/0 conn(0x7f3a180c4480 0x7f3a181541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.651+0000 7f3a17e00640 1 -- 172.21.15.118:0/4257891783 >> v2:172.21.15.144:3300/0 conn(0x7f3a180c4480 msgr2=0x7f3a181541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.651+0000 7f3a17e00640 1 --2- 172.21.15.118:0/4257891783 >> v2:172.21.15.144:3300/0 conn(0x7f3a180c4480 0x7f3a181541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.651+0000 7f3a17e00640 1 -- 172.21.15.118:0/4257891783 >> v1:172.21.15.144:6789/0 conn(0x7f3a180c5a20 legacy=0x7f3a1806e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.651+0000 7f3a17e00640 1 -- 172.21.15.118:0/4257891783 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180c4c60 con 0x7f3a1806e4b0 2024-03-08T20:38:36.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.652+0000 7f3a17e00640 1 --2- 172.21.15.118:0/4257891783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009870 tx=0x7f3a0802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6810f58ec2c56d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.652+0000 7f3a16a00640 1 -- 172.21.15.118:0/4257891783 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08035020 con 0x7f3a1806e4b0 2024-03-08T20:38:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a16a00640 1 -- 172.21.15.118:0/4257891783 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08031640 con 0x7f3a1806e4b0 2024-03-08T20:38:36.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a16a00640 1 -- 172.21.15.118:0/4257891783 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0802d040 con 0x7f3a1806e4b0 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 -- 172.21.15.118:0/4257891783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 msgr2=0x7f3a18152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 --2- 172.21.15.118:0/4257891783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009870 tx=0x7f3a0802b8f0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 -- 172.21.15.118:0/4257891783 shutdown_connections 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 --2- 172.21.15.118:0/4257891783 >> v2:172.21.15.144:3300/0 conn(0x7f3a180c4480 0x7f3a181541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 --2- 172.21.15.118:0/4257891783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a1806e4b0 0x7f3a18152ce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 -- 172.21.15.118:0/4257891783 >> 172.21.15.118:0/4257891783 conn(0x7f3a1806b720 msgr2=0x7f3a180c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 -- 172.21.15.118:0/4257891783 shutdown_connections 2024-03-08T20:38:36.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.653+0000 7f3a1f000640 1 -- 172.21.15.118:0/4257891783 wait complete. 2024-03-08T20:38:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.655+0000 7f3a1f000640 1 Processor -- start 2024-03-08T20:38:36.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.656+0000 7f3a1f000640 1 -- start start 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1806e4b0 0x7f3a180bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a180c5a20 0x7f3a181ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1806efa0 con 0x7f3a180c4480 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c5220 con 0x7f3a1806e4b0 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1f000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180c5e70 con 0x7f3a180c5a20 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a17400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40872/0 (socket says 172.21.15.118:40872) 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a17400640 1 -- 172.21.15.118:0/2788472168 learned_addr learned my addr 172.21.15.118:0/2788472168 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a17e00640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1806e4b0 0x7f3a180bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.657+0000 7f3a1d000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a180c5a20 0x7f3a181ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 -- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a180c5a20 msgr2=0x7f3a181ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a180c5a20 0x7f3a181ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 -- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1806e4b0 msgr2=0x7f3a180bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1806e4b0 0x7f3a180bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 -- 172.21.15.118:0/2788472168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180c29e0 con 0x7f3a180c4480 2024-03-08T20:38:36.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a17400640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400e9e0 tx=0x7f3a0400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04017070 con 0x7f3a180c4480 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400c970 con 0x7f3a180c4480 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400cd60 con 0x7f3a180c4480 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a180c2cc0 con 0x7f3a180c4480 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.658+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a180a6320 con 0x7f3a180c4480 2024-03-08T20:38:36.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.659+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a18074a40 con 0x7f3a180c4480 2024-03-08T20:38:36.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.660+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3a0401a070 con 0x7f3a180c4480 2024-03-08T20:38:36.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.661+0000 7f3a0fe00640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 0x7f39f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.661+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3a0408b140 con 0x7f3a180c4480 2024-03-08T20:38:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.662+0000 7f3a17e00640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 0x7f39f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:36.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.662+0000 7f3a17e00640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 0x7f39f806e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a0803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:36.666 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.667+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f3a040591d0 con 0x7f3a180c4480 2024-03-08T20:38:36.885 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.885+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a180c05f0 con 0x7f3a180c4480 2024-03-08T20:38:36.886 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.886+0000 7f3a0fe00640 1 -- 172.21.15.118:0/2788472168 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a0405d270 con 0x7f3a180c4480 2024-03-08T20:38:36.886 INFO:teuthology.orchestra.run.smithi118.stdout:pg_num: 32 2024-03-08T20:38:36.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 msgr2=0x7f39f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.888 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 0x7f39f806e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a08036000 tx=0x7f3a0803c040 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 msgr2=0x7f3a18145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400e9e0 tx=0x7f3a0400eea0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 shutdown_connections 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f39f806bbd0 0x7f39f806e090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a180c5a20 0x7f3a181ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a180c4480 0x7f3a18145a70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 --2- 172.21.15.118:0/2788472168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1806e4b0 0x7f3a180bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 >> 172.21.15.118:0/2788472168 conn(0x7f3a1806b720 msgr2=0x7f3a180c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 shutdown_connections 2024-03-08T20:38:36.889 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:36.889+0000 7f3a1f000640 1 -- 172.21.15.118:0/2788472168 wait complete. 2024-03-08T20:38:36.908 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T20:38:37.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.113+0000 7fc4a4a00640 1 Processor -- start 2024-03-08T20:38:37.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.114+0000 7fc4a4a00640 1 -- start start 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc4a4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4a013d970 0x7fc4a0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc4a4a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4a0158cc0 0x7fc4a00c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc4a4a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a0154e80 con 0x7fc4a013e070 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc4a4a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a0155d20 con 0x7fc4a0158cc0 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc4a4a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a006e570 con 0x7fc4a013d970 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc49f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4a0158cc0 0x7fc4a00c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc49f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4a0158cc0 0x7fc4a00c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40884/0 (socket says 172.21.15.118:40884) 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.115+0000 7fc49f200640 1 -- 172.21.15.118:0/2893845080 learned_addr learned my addr 172.21.15.118:0/2893845080 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.116+0000 7fc49e800640 1 --2- 172.21.15.118:0/2893845080 >> v2:172.21.15.144:3300/0 conn(0x7fc4a013d970 0x7fc4a0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.116+0000 7fc49f200640 1 -- 172.21.15.118:0/2893845080 >> v2:172.21.15.144:3300/0 conn(0x7fc4a013d970 msgr2=0x7fc4a0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.116+0000 7fc49f200640 1 --2- 172.21.15.118:0/2893845080 >> v2:172.21.15.144:3300/0 conn(0x7fc4a013d970 0x7fc4a0071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.116+0000 7fc49f200640 1 -- 172.21.15.118:0/2893845080 >> v1:172.21.15.144:6789/0 conn(0x7fc4a013e070 legacy=0x7fc4a0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.116+0000 7fc49f200640 1 -- 172.21.15.118:0/2893845080 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a01550f0 con 0x7fc4a0158cc0 2024-03-08T20:38:37.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.117+0000 7fc49f200640 1 --2- 172.21.15.118:0/2893845080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a00c2a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc4a006ba10 tx=0x7fc49802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916ac7752cf0e786 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:37.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.117+0000 7fc49de00640 1 -- 172.21.15.118:0/2893845080 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49802ca80 con 0x7fc4a0158cc0 2024-03-08T20:38:37.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.117+0000 7fc49de00640 1 -- 172.21.15.118:0/2893845080 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49802cc20 con 0x7fc4a0158cc0 2024-03-08T20:38:37.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.117+0000 7fc49de00640 1 -- 172.21.15.118:0/2893845080 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4980343f0 con 0x7fc4a0158cc0 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 -- 172.21.15.118:0/2893845080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 msgr2=0x7fc4a00c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/2893845080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a00c2a80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc4a006ba10 tx=0x7fc49802bee0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 -- 172.21.15.118:0/2893845080 shutdown_connections 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/2893845080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a00c2a80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/2893845080 >> v2:172.21.15.144:3300/0 conn(0x7fc4a013d970 0x7fc4a0071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 -- 172.21.15.118:0/2893845080 >> 172.21.15.118:0/2893845080 conn(0x7fc4a006ad10 msgr2=0x7fc4a006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 -- 172.21.15.118:0/2893845080 shutdown_connections 2024-03-08T20:38:37.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.118+0000 7fc4a4a00640 1 -- 172.21.15.118:0/2893845080 wait complete. 2024-03-08T20:38:37.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.120+0000 7fc4a4a00640 1 Processor -- start 2024-03-08T20:38:37.119 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.120+0000 7fc4a4a00640 1 -- start start 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc4a013d970 0x7fc4a01eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4a013e070 0x7fc4a0138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a013dd50 con 0x7fc4a0158cc0 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00c3800 con 0x7fc4a013e070 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc4a4a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a013ded0 con 0x7fc4a013d970 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc49f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc49f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:40888/0 (socket says 172.21.15.118:40888) 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc49f200640 1 -- 172.21.15.118:0/1025288581 learned_addr learned my addr 172.21.15.118:0/1025288581 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:37.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.121+0000 7fc495e00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4a013e070 0x7fc4a0138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49e800640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc4a013d970 0x7fc4a01eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 -- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc4a013d970 msgr2=0x7fc4a01eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc4a013d970 0x7fc4a01eb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 -- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4a013e070 msgr2=0x7fc4a0138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4a013e070 0x7fc4a0138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.122 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 -- 172.21.15.118:0/1025288581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a01eee40 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc49f200640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc498036040 tx=0x7fc498004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498043020 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49803e450 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a0152e00 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498009510 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.122+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a01eab30 con 0x7fc4a0158cc0 2024-03-08T20:38:37.123 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.124+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0074a40 con 0x7fc4a0158cc0 2024-03-08T20:38:37.124 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.125+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc498046020 con 0x7fc4a0158cc0 2024-03-08T20:38:37.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.126+0000 7fc497400640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 0x7fc47c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:37.125 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.126+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc4980ad670 con 0x7fc4a0158cc0 2024-03-08T20:38:37.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.126+0000 7fc49e800640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 0x7fc47c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:37.126 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.127+0000 7fc49e800640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 0x7fc47c06e090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc490006fd0 tx=0x7fc490008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:37.130 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.131+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc49804d030 con 0x7fc4a0158cc0 2024-03-08T20:38:37.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.342+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4a006dcc0 con 0x7fc4a0158cc0 2024-03-08T20:38:37.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.342+0000 7fc497400640 1 -- 172.21.15.118:0/1025288581 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc49807bdf0 con 0x7fc4a0158cc0 2024-03-08T20:38:37.342 INFO:teuthology.orchestra.run.smithi118.stderr:listed 0 entries 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 msgr2=0x7fc47c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 0x7fc47c06e090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc490006fd0 tx=0x7fc490008040 comp rx=0 tx=0).stop 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 msgr2=0x7fc4a0153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc498036040 tx=0x7fc498004a40 comp rx=0 tx=0).stop 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 shutdown_connections 2024-03-08T20:38:37.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc47c06bbd0 0x7fc47c06e090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc4a0158cc0 0x7fc4a0153b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4a013e070 0x7fc4a0138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 --2- 172.21.15.118:0/1025288581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc4a013d970 0x7fc4a01eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.345+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 >> 172.21.15.118:0/1025288581 conn(0x7fc4a006ad10 msgr2=0x7fc4a00c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.346+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 shutdown_connections 2024-03-08T20:38:37.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:37.346+0000 7fc4a4a00640 1 -- 172.21.15.118:0/1025288581 wait complete. 2024-03-08T20:38:37.363 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-08T20:38:37.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:37.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-08T20:38:40.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:38:40.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:40.838 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-08T20:38:40.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:40.895 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-08T20:38:40.941 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T20:38:40.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:40.943 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T20:38:41.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:41.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-03-08T20:38:41.132 DEBUG:teuthology.parallel:result is None 2024-03-08T20:38:41.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:38:41.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:41.336 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-08T20:38:41.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:41.373 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-03-08T20:38:41.581 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-08T20:38:41.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:41.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T20:38:41.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:41.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-03-08T20:38:42.074 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-08T20:38:42.074 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-03-08T20:38:42.074 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T20:38:42.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 2024-03-08T20:38:42.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:42.206 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-03-08T20:38:42.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T20:38:42.310 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-03-08T20:38:47.880 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-03-08T20:38:47.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:38:47.884 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi144 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d63482aa89628d733e298984a762389b625c761 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2024-03-08T20:38:48.147 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a5480e7648134d839c4038f4ee4c3290 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi144 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d63482aa89628d733e298984a762389b625c761 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh' 2024-03-08T20:38:48.150 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-08T20:38:48.159 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T20:38:48.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:38:48.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.383+0000 7fad10000640 1 Processor -- start 2024-03-08T20:38:48.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.383+0000 7fad10000640 1 -- start start 2024-03-08T20:38:48.384 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad10000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fad0806af80 0x7fad0806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad10000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad081505e0 0x7fad08152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad10000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080aa980 con 0x7fad0806ebd0 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad10000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080aac60 con 0x7fad0806af80 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad10000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080aaf40 con 0x7fad081505e0 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad0cc00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fad0806ebd0 0x7fad0814fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:32830/0 (socket says 172.21.15.118:32830) 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad0cc00640 1 -- 172.21.15.118:0/1256837166 learned_addr learned my addr 172.21.15.118:0/1256837166 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad0d600640 1 --2- 172.21.15.118:0/1256837166 >> v2:172.21.15.118:3300/0 conn(0x7fad0806af80 0x7fad0806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.385+0000 7fad0e000640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad081505e0 0x7fad08152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad07e00640 1 -- 172.21.15.118:0/1256837166 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624457816 0 0) 0x7fad080aa980 con 0x7fad0806ebd0 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad07e00640 1 -- 172.21.15.118:0/1256837166 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf0003520 con 0x7fad0806ebd0 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad0d600640 1 -- 172.21.15.118:0/1256837166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad081505e0 msgr2=0x7fad08152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad0d600640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad081505e0 0x7fad08152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad0d600640 1 -- 172.21.15.118:0/1256837166 >> v1:172.21.15.118:6789/0 conn(0x7fad0806ebd0 legacy=0x7fad0814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.386+0000 7fad0d600640 1 -- 172.21.15.118:0/1256837166 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080ab220 con 0x7fad0806af80 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.387+0000 7fad0d600640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad0806e690 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7facfc0097a0 tx=0x7facfc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc8ef0eee6b2e22 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.387 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.387+0000 7fad07e00640 1 -- 172.21.15.118:0/1256837166 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0315a0 con 0x7fad0806af80 2024-03-08T20:38:48.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.387+0000 7fad07e00640 1 -- 172.21.15.118:0/1256837166 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc037070 con 0x7fad0806af80 2024-03-08T20:38:48.388 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.387+0000 7fad07e00640 1 -- 172.21.15.118:0/1256837166 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc031940 con 0x7fad0806af80 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 -- 172.21.15.118:0/1256837166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 msgr2=0x7fad0806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad0806e690 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7facfc0097a0 tx=0x7facfc02b840 comp rx=0 tx=0).stop 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 -- 172.21.15.118:0/1256837166 shutdown_connections 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad081505e0 0x7fad08152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 --2- 172.21.15.118:0/1256837166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad0806e690 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 -- 172.21.15.118:0/1256837166 >> 172.21.15.118:0/1256837166 conn(0x7fad080a84c0 msgr2=0x7fad080a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:48.389 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 -- 172.21.15.118:0/1256837166 shutdown_connections 2024-03-08T20:38:48.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.388+0000 7fad10000640 1 -- 172.21.15.118:0/1256837166 wait complete. 2024-03-08T20:38:48.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.390+0000 7fad10000640 1 Processor -- start 2024-03-08T20:38:48.390 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.390+0000 7fad10000640 1 -- start start 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad0806ebd0 0x7fad08145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad081505e0 0x7fad081463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0806b4e0 con 0x7fad0806af80 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0806b360 con 0x7fad081505e0 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad10000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08153350 con 0x7fad0806ebd0 2024-03-08T20:38:48.392 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56220/0 (socket says 172.21.15.118:56220) 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 -- 172.21.15.118:0/4164514700 learned_addr learned my addr 172.21.15.118:0/4164514700 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0cc00640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad0806ebd0 0x7fad08145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 -- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad0806ebd0 msgr2=0x7fad08145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad0806ebd0 0x7fad08145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0e000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad081505e0 0x7fad081463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 -- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad081505e0 msgr2=0x7fad081463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad081505e0 0x7fad081463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.391+0000 7fad0d600640 1 -- 172.21.15.118:0/4164514700 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08146920 con 0x7fad0806af80 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad0d600640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facfc02b880 tx=0x7facfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc032630 con 0x7fad0806af80 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0327f0 con 0x7fad0806af80 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad081e91b0 con 0x7fad0806af80 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc032be0 con 0x7fad0806af80 2024-03-08T20:38:48.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.392+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080bc400 con 0x7fad0806af80 2024-03-08T20:38:48.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.393+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08074a40 con 0x7fad0806af80 2024-03-08T20:38:48.395 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.394+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7facfc03b3f0 con 0x7fad0806af80 2024-03-08T20:38:48.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.395+0000 7fad05600640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 0x7face806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.395+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7facfc02f030 con 0x7fad0806af80 2024-03-08T20:38:48.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.395+0000 7fad0cc00640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 0x7face806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.396 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.396+0000 7fad0cc00640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 0x7face806e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad080a9a40 tx=0x7facf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.400+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7facfc040070 con 0x7fad0806af80 2024-03-08T20:38:48.593 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.593+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad0814eb80 con 0x7face806bc00 2024-03-08T20:38:48.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.625+0000 7fad05600640 1 -- 172.21.15.118:0/4164514700 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337587 (secure 0 0 0) 0x7fad0814eb80 con 0x7face806bc00 2024-03-08T20:38:48.629 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:48.631 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:38:48.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 msgr2=0x7face806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 0x7face806e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad080a9a40 tx=0x7facf4009040 comp rx=0 tx=0).stop 2024-03-08T20:38:48.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 msgr2=0x7fad080c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facfc02b880 tx=0x7facfc0046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 shutdown_connections 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7face806bc00 0x7face806e0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad081505e0 0x7fad081463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad0806ebd0 0x7fad08145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 --2- 172.21.15.118:0/4164514700 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fad0806af80 0x7fad080c6c10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.631+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 >> 172.21.15.118:0/4164514700 conn(0x7fad080a84c0 msgr2=0x7fad0806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.632+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 shutdown_connections 2024-03-08T20:38:48.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.632+0000 7fad10000640 1 -- 172.21.15.118:0/4164514700 wait complete. 2024-03-08T20:38:48.649 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-03-08T20:38:47.721925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1675067347,"num_objects":158923,"num_object_clones":0,"num_object_copies":480310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158923,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":353368,"num_write_kb":2319575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272332,"ondisk_log_size":272332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5319016,"kb_used_data":2799976,"kb_used_omap":12,"kb_used_meta":2518963,"kb_avail":749655704,"statfs":{"total":773094113280,"available":767647440896,"internally_reserved":0,"allocated":2867175424,"data_stored":4217762438,"data_compressed":624579107,"data_compressed_allocated":765898752,"data_compressed_original":2117931008,"omap_allocated":12751,"internal_metadata":2579418673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,4,1,47,59,167,212,195,397,419,305,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":254,"apply_latency_ms":254,"commit_latency_ns":254000000,"apply_latency_ns":254000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5552270,"num_objects":2500,"num_object_clones":0,"num_object_copies":5002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7476,"num_write_kb":19613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":193,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005593"},"pg_stats":[{"pgid":"2.1f","version":"27'261","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.196852+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:38:42.196852+0000","last_peered":"2024-03-08T20:38:42.196852+0000","last_clean":"2024-03-08T20:38:42.196852+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:42.196852+0000","last_undegraded":"2024-03-08T20:38:42.196852+0000","last_fullsized":"2024-03-08T20:38:42.196852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1257","reported_seq":1285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.329247+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:38:43.329247+0000","last_peered":"2024-03-08T20:38:43.329247+0000","last_clean":"2024-03-08T20:38:43.329247+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:38:43.329247+0000","last_undegraded":"2024-03-08T20:38:43.329247+0000","last_fullsized":"2024-03-08T20:38:43.329247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.820874+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:38:43.820874+0000","last_peered":"2024-03-08T20:38:43.820874+0000","last_clean":"2024-03-08T20:38:43.820874+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:38:43.820874+0000","last_undegraded":"2024-03-08T20:38:43.820874+0000","last_fullsized":"2024-03-08T20:38:43.820874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'561","reported_seq":591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.856665+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:38:42.856665+0000","last_peered":"2024-03-08T20:38:42.856665+0000","last_clean":"2024-03-08T20:38:42.856665+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:38:42.856665+0000","last_undegraded":"2024-03-08T20:38:42.856665+0000","last_fullsized":"2024-03-08T20:38:42.856665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1255","reported_seq":1283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.630169+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:38:43.630169+0000","last_peered":"2024-03-08T20:38:43.630169+0000","last_clean":"2024-03-08T20:38:43.630169+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:43.630169+0000","last_undegraded":"2024-03-08T20:38:43.630169+0000","last_fullsized":"2024-03-08T20:38:43.630169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5185","reported_seq":5200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.227513+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:38:44.227513+0000","last_peered":"2024-03-08T20:38:44.227513+0000","last_clean":"2024-03-08T20:38:44.227513+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:38:44.227513+0000","last_undegraded":"2024-03-08T20:38:44.227513+0000","last_fullsized":"2024-03-08T20:38:44.227513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5185,"log_dups_size":0,"ondisk_log_size":5185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7531,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.451423+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:38:43.451423+0000","last_peered":"2024-03-08T20:38:43.451423+0000","last_clean":"2024-03-08T20:38:43.451423+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:38:43.451423+0000","last_undegraded":"2024-03-08T20:38:43.451423+0000","last_fullsized":"2024-03-08T20:38:43.451423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1292","reported_seq":1319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.058874+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:38:43.058874+0000","last_peered":"2024-03-08T20:38:43.058874+0000","last_clean":"2024-03-08T20:38:43.058874+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:38:43.058874+0000","last_undegraded":"2024-03-08T20:38:43.058874+0000","last_fullsized":"2024-03-08T20:38:43.058874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5224","reported_seq":5240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229638+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:38:44.229638+0000","last_peered":"2024-03-08T20:38:44.229638+0000","last_clean":"2024-03-08T20:38:44.229638+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:38:44.229638+0000","last_undegraded":"2024-03-08T20:38:44.229638+0000","last_fullsized":"2024-03-08T20:38:44.229638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7563,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'311","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.761608+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:38:41.761608+0000","last_peered":"2024-03-08T20:38:41.761608+0000","last_clean":"2024-03-08T20:38:41.761608+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:38:41.761608+0000","last_undegraded":"2024-03-08T20:38:41.761608+0000","last_fullsized":"2024-03-08T20:38:41.761608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1260","reported_seq":1287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489526+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:38:43.489526+0000","last_peered":"2024-03-08T20:38:43.489526+0000","last_clean":"2024-03-08T20:38:43.489526+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:38:43.489526+0000","last_undegraded":"2024-03-08T20:38:43.489526+0000","last_fullsized":"2024-03-08T20:38:43.489526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5128","reported_seq":5147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.237389+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:38:44.237389+0000","last_peered":"2024-03-08T20:38:44.237389+0000","last_clean":"2024-03-08T20:38:44.237389+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:38:44.237389+0000","last_undegraded":"2024-03-08T20:38:44.237389+0000","last_fullsized":"2024-03-08T20:38:44.237389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5128,"log_dups_size":0,"ondisk_log_size":5128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7468,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1274","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152552+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:38:44.152552+0000","last_peered":"2024-03-08T20:38:44.152552+0000","last_clean":"2024-03-08T20:38:44.152552+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:38:44.152552+0000","last_undegraded":"2024-03-08T20:38:44.152552+0000","last_fullsized":"2024-03-08T20:38:44.152552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1127,"num_object_clones":0,"num_object_copies":2254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'403","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.607882+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:38:43.607882+0000","last_peered":"2024-03-08T20:38:43.607882+0000","last_clean":"2024-03-08T20:38:43.607882+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:38:43.607882+0000","last_undegraded":"2024-03-08T20:38:43.607882+0000","last_fullsized":"2024-03-08T20:38:43.607882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.877774+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:38:41.877774+0000","last_peered":"2024-03-08T20:38:41.877774+0000","last_clean":"2024-03-08T20:38:41.877774+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:38:41.877774+0000","last_undegraded":"2024-03-08T20:38:41.877774+0000","last_fullsized":"2024-03-08T20:38:41.877774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7560,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1326","reported_seq":1354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.757829+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:38:43.757829+0000","last_peered":"2024-03-08T20:38:43.757829+0000","last_clean":"2024-03-08T20:38:43.757829+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:38:43.757829+0000","last_undegraded":"2024-03-08T20:38:43.757829+0000","last_fullsized":"2024-03-08T20:38:43.757829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1510","reported_seq":1540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.049211+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:38:42.049211+0000","last_peered":"2024-03-08T20:38:42.049211+0000","last_clean":"2024-03-08T20:38:42.049211+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:38:42.049211+0000","last_undegraded":"2024-03-08T20:38:42.049211+0000","last_fullsized":"2024-03-08T20:38:42.049211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5253","reported_seq":5262,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.212333+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:38:44.212333+0000","last_peered":"2024-03-08T20:38:44.212333+0000","last_clean":"2024-03-08T20:38:44.212333+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:38:44.212333+0000","last_undegraded":"2024-03-08T20:38:44.212333+0000","last_fullsized":"2024-03-08T20:38:44.212333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7647,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.680909+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:38:43.680909+0000","last_peered":"2024-03-08T20:38:43.680909+0000","last_clean":"2024-03-08T20:38:43.680909+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:38:43.680909+0000","last_undegraded":"2024-03-08T20:38:43.680909+0000","last_fullsized":"2024-03-08T20:38:43.680909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1180,"num_object_clones":0,"num_object_copies":2360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.788109+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:38:41.788109+0000","last_peered":"2024-03-08T20:38:41.788109+0000","last_clean":"2024-03-08T20:38:41.788109+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:38:41.788109+0000","last_undegraded":"2024-03-08T20:38:41.788109+0000","last_fullsized":"2024-03-08T20:38:41.788109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.991706+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:38:43.991706+0000","last_peered":"2024-03-08T20:38:43.991706+0000","last_clean":"2024-03-08T20:38:43.991706+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:38:43.991706+0000","last_undegraded":"2024-03-08T20:38:43.991706+0000","last_fullsized":"2024-03-08T20:38:43.991706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.270605+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:38:44.270605+0000","last_peered":"2024-03-08T20:38:44.270605+0000","last_clean":"2024-03-08T20:38:44.270605+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:44.270605+0000","last_undegraded":"2024-03-08T20:38:44.270605+0000","last_fullsized":"2024-03-08T20:38:44.270605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'966","reported_seq":996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.817632+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:38:41.817632+0000","last_peered":"2024-03-08T20:38:41.817632+0000","last_clean":"2024-03-08T20:38:41.817632+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:38:41.817632+0000","last_undegraded":"2024-03-08T20:38:41.817632+0000","last_fullsized":"2024-03-08T20:38:41.817632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5268","reported_seq":5289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.323598+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:38:44.323598+0000","last_peered":"2024-03-08T20:38:44.323598+0000","last_clean":"2024-03-08T20:38:44.323598+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:38:44.323598+0000","last_undegraded":"2024-03-08T20:38:44.323598+0000","last_fullsized":"2024-03-08T20:38:44.323598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7657,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.375044+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:38:43.375044+0000","last_peered":"2024-03-08T20:38:43.375044+0000","last_clean":"2024-03-08T20:38:43.375044+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:38:43.375044+0000","last_undegraded":"2024-03-08T20:38:43.375044+0000","last_fullsized":"2024-03-08T20:38:43.375044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'313","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.028871+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:38:44.028871+0000","last_peered":"2024-03-08T20:38:44.028871+0000","last_clean":"2024-03-08T20:38:44.028871+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:38:44.028871+0000","last_undegraded":"2024-03-08T20:38:44.028871+0000","last_fullsized":"2024-03-08T20:38:44.028871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5191","reported_seq":5205,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.106192+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:38:44.106192+0000","last_peered":"2024-03-08T20:38:44.106192+0000","last_clean":"2024-03-08T20:38:44.106192+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:38:44.106192+0000","last_undegraded":"2024-03-08T20:38:44.106192+0000","last_fullsized":"2024-03-08T20:38:44.106192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5191,"log_dups_size":0,"ondisk_log_size":5191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7529,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1253","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.708868+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:38:43.708868+0000","last_peered":"2024-03-08T20:38:43.708868+0000","last_clean":"2024-03-08T20:38:43.708868+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:38:43.708868+0000","last_undegraded":"2024-03-08T20:38:43.708868+0000","last_fullsized":"2024-03-08T20:38:43.708868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1093,"num_object_clones":0,"num_object_copies":2186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'789","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.688930+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:38:42.688930+0000","last_peered":"2024-03-08T20:38:42.688930+0000","last_clean":"2024-03-08T20:38:42.688930+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:42.688930+0000","last_undegraded":"2024-03-08T20:38:42.688930+0000","last_fullsized":"2024-03-08T20:38:42.688930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5223","reported_seq":5238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.745388+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.745388+0000","last_peered":"2024-03-08T20:38:43.745388+0000","last_clean":"2024-03-08T20:38:43.745388+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:38:43.745388+0000","last_undegraded":"2024-03-08T20:38:43.745388+0000","last_fullsized":"2024-03-08T20:38:43.745388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5223,"log_dups_size":0,"ondisk_log_size":5223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7614,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1299","reported_seq":1327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.182639+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:38:43.182639+0000","last_peered":"2024-03-08T20:38:43.182639+0000","last_clean":"2024-03-08T20:38:43.182639+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:38:43.182639+0000","last_undegraded":"2024-03-08T20:38:43.182639+0000","last_fullsized":"2024-03-08T20:38:43.182639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.194981+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:38:43.194981+0000","last_peered":"2024-03-08T20:38:43.194981+0000","last_clean":"2024-03-08T20:38:43.194981+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:38:43.194981+0000","last_undegraded":"2024-03-08T20:38:43.194981+0000","last_fullsized":"2024-03-08T20:38:43.194981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.647089+0000","last_change":"2024-03-08T20:30:10.906802+0000","last_active":"2024-03-08T20:38:43.647089+0000","last_peered":"2024-03-08T20:38:43.647089+0000","last_clean":"2024-03-08T20:38:43.647089+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:38:43.647089+0000","last_undegraded":"2024-03-08T20:38:43.647089+0000","last_fullsized":"2024-03-08T20:38:43.647089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:04:20.777976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1255","reported_seq":1269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.161190+0000","last_change":"2024-03-08T20:30:10.908515+0000","last_active":"2024-03-08T20:38:42.161190+0000","last_peered":"2024-03-08T20:38:42.161190+0000","last_clean":"2024-03-08T20:38:42.161190+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:38:42.161190+0000","last_undegraded":"2024-03-08T20:38:42.161190+0000","last_fullsized":"2024-03-08T20:38:42.161190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2005","reported_seq":2035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.785945+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:38:42.785945+0000","last_peered":"2024-03-08T20:38:42.785945+0000","last_clean":"2024-03-08T20:38:42.785945+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:42.785945+0000","last_undegraded":"2024-03-08T20:38:42.785945+0000","last_fullsized":"2024-03-08T20:38:42.785945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2005,"log_dups_size":0,"ondisk_log_size":2005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.411242+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:38:43.411242+0000","last_peered":"2024-03-08T20:38:43.411242+0000","last_clean":"2024-03-08T20:38:43.411242+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:38:43.411242+0000","last_undegraded":"2024-03-08T20:38:43.411242+0000","last_fullsized":"2024-03-08T20:38:43.411242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1230","reported_seq":1258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.319124+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:38:44.319124+0000","last_peered":"2024-03-08T20:38:44.319124+0000","last_clean":"2024-03-08T20:38:44.319124+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:38:44.319124+0000","last_undegraded":"2024-03-08T20:38:44.319124+0000","last_fullsized":"2024-03-08T20:38:44.319124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'878","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489620+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:38:43.489620+0000","last_peered":"2024-03-08T20:38:43.489620+0000","last_clean":"2024-03-08T20:38:43.489620+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:43.489620+0000","last_undegraded":"2024-03-08T20:38:43.489620+0000","last_fullsized":"2024-03-08T20:38:43.489620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.798526+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:38:43.798526+0000","last_peered":"2024-03-08T20:38:43.798526+0000","last_clean":"2024-03-08T20:38:43.798526+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:38:43.798526+0000","last_undegraded":"2024-03-08T20:38:43.798526+0000","last_fullsized":"2024-03-08T20:38:43.798526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1293","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.986790+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:38:42.986790+0000","last_peered":"2024-03-08T20:38:42.986790+0000","last_clean":"2024-03-08T20:38:42.986790+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:38:42.986790+0000","last_undegraded":"2024-03-08T20:38:42.986790+0000","last_fullsized":"2024-03-08T20:38:42.986790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1408","reported_seq":1976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.857583+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:38:41.857583+0000","last_peered":"2024-03-08T20:38:41.857583+0000","last_clean":"2024-03-08T20:38:41.857583+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:41.857583+0000","last_undegraded":"2024-03-08T20:38:41.857583+0000","last_fullsized":"2024-03-08T20:38:41.857583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849604+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:38:43.849604+0000","last_peered":"2024-03-08T20:38:43.849604+0000","last_clean":"2024-03-08T20:38:43.849604+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:38:43.849604+0000","last_undegraded":"2024-03-08T20:38:43.849604+0000","last_fullsized":"2024-03-08T20:38:43.849604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1231","reported_seq":1259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.159968+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:38:43.159968+0000","last_peered":"2024-03-08T20:38:43.159968+0000","last_clean":"2024-03-08T20:38:43.159968+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:38:43.159968+0000","last_undegraded":"2024-03-08T20:38:43.159968+0000","last_fullsized":"2024-03-08T20:38:43.159968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'603","reported_seq":633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.085281+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:38:42.085281+0000","last_peered":"2024-03-08T20:38:42.085281+0000","last_clean":"2024-03-08T20:38:42.085281+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:38:42.085281+0000","last_undegraded":"2024-03-08T20:38:42.085281+0000","last_fullsized":"2024-03-08T20:38:42.085281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.671108+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:38:43.671108+0000","last_peered":"2024-03-08T20:38:43.671108+0000","last_clean":"2024-03-08T20:38:43.671108+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:38:43.671108+0000","last_undegraded":"2024-03-08T20:38:43.671108+0000","last_fullsized":"2024-03-08T20:38:43.671108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1306","reported_seq":1320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.368577+0000","last_change":"2024-03-08T20:30:10.640948+0000","last_active":"2024-03-08T20:38:43.368577+0000","last_peered":"2024-03-08T20:38:43.368577+0000","last_clean":"2024-03-08T20:38:43.368577+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:43.368577+0000","last_undegraded":"2024-03-08T20:38:43.368577+0000","last_fullsized":"2024-03-08T20:38:43.368577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:39.603548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'496","reported_seq":526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.543155+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:38:42.543155+0000","last_peered":"2024-03-08T20:38:42.543155+0000","last_clean":"2024-03-08T20:38:42.543155+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:42.543155+0000","last_undegraded":"2024-03-08T20:38:42.543155+0000","last_fullsized":"2024-03-08T20:38:42.543155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:35:22.321573+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:35:22.321573+0000","last_peered":"2024-03-08T20:35:22.321573+0000","last_clean":"2024-03-08T20:35:22.321573+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:35:22.321573+0000","last_undegraded":"2024-03-08T20:35:22.321573+0000","last_fullsized":"2024-03-08T20:35:22.321573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.117250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:38:44.117250+0000","last_peered":"2024-03-08T20:38:44.117250+0000","last_clean":"2024-03-08T20:38:44.117250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:38:44.117250+0000","last_undegraded":"2024-03-08T20:38:44.117250+0000","last_fullsized":"2024-03-08T20:38:44.117250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.341788+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:38:43.341788+0000","last_peered":"2024-03-08T20:38:43.341788+0000","last_clean":"2024-03-08T20:38:43.341788+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:38:43.341788+0000","last_undegraded":"2024-03-08T20:38:43.341788+0000","last_fullsized":"2024-03-08T20:38:43.341788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1395","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.749782+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:38:41.749782+0000","last_peered":"2024-03-08T20:38:41.749782+0000","last_clean":"2024-03-08T20:38:41.749782+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:41.749782+0000","last_undegraded":"2024-03-08T20:38:41.749782+0000","last_fullsized":"2024-03-08T20:38:41.749782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1649,"num_write_kb":30949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5294","reported_seq":5314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.139406+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:38:44.139406+0000","last_peered":"2024-03-08T20:38:44.139406+0000","last_clean":"2024-03-08T20:38:44.139406+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:38:44.139406+0000","last_undegraded":"2024-03-08T20:38:44.139406+0000","last_fullsized":"2024-03-08T20:38:44.139406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7633,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1281","reported_seq":1309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422930+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:38:43.422930+0000","last_peered":"2024-03-08T20:38:43.422930+0000","last_clean":"2024-03-08T20:38:43.422930+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:38:43.422930+0000","last_undegraded":"2024-03-08T20:38:43.422930+0000","last_fullsized":"2024-03-08T20:38:43.422930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1508","reported_seq":1538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.588098+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:38:42.588098+0000","last_peered":"2024-03-08T20:38:42.588098+0000","last_clean":"2024-03-08T20:38:42.588098+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:42.588098+0000","last_undegraded":"2024-03-08T20:38:42.588098+0000","last_fullsized":"2024-03-08T20:38:42.588098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.428601+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:38:43.428601+0000","last_peered":"2024-03-08T20:38:43.428601+0000","last_clean":"2024-03-08T20:38:43.428601+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:38:43.428601+0000","last_undegraded":"2024-03-08T20:38:43.428601+0000","last_fullsized":"2024-03-08T20:38:43.428601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1192","reported_seq":1220,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.845267+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:38:42.845267+0000","last_peered":"2024-03-08T20:38:42.845267+0000","last_clean":"2024-03-08T20:38:42.845267+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:38:42.845267+0000","last_undegraded":"2024-03-08T20:38:42.845267+0000","last_fullsized":"2024-03-08T20:38:42.845267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1072,"num_object_clones":0,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1370","reported_seq":1400,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.084592+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:38:42.084592+0000","last_peered":"2024-03-08T20:38:42.084592+0000","last_clean":"2024-03-08T20:38:42.084592+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:42.084592+0000","last_undegraded":"2024-03-08T20:38:42.084592+0000","last_fullsized":"2024-03-08T20:38:42.084592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.731509+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.731509+0000","last_peered":"2024-03-08T20:38:43.731509+0000","last_clean":"2024-03-08T20:38:43.731509+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:38:43.731509+0000","last_undegraded":"2024-03-08T20:38:43.731509+0000","last_fullsized":"2024-03-08T20:38:43.731509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1317","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.836024+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:38:43.836024+0000","last_peered":"2024-03-08T20:38:43.836024+0000","last_clean":"2024-03-08T20:38:43.836024+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:38:43.836024+0000","last_undegraded":"2024-03-08T20:38:43.836024+0000","last_fullsized":"2024-03-08T20:38:43.836024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'346","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.138038+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:38:44.138038+0000","last_peered":"2024-03-08T20:38:44.138038+0000","last_clean":"2024-03-08T20:38:44.138038+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:44.138038+0000","last_undegraded":"2024-03-08T20:38:44.138038+0000","last_fullsized":"2024-03-08T20:38:44.138038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.134901+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:38:44.134901+0000","last_peered":"2024-03-08T20:38:44.134901+0000","last_clean":"2024-03-08T20:38:44.134901+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:38:44.134901+0000","last_undegraded":"2024-03-08T20:38:44.134901+0000","last_fullsized":"2024-03-08T20:38:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7657,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1326","reported_seq":1353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422535+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:38:43.422535+0000","last_peered":"2024-03-08T20:38:43.422535+0000","last_clean":"2024-03-08T20:38:43.422535+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:38:43.422535+0000","last_undegraded":"2024-03-08T20:38:43.422535+0000","last_fullsized":"2024-03-08T20:38:43.422535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'491","reported_seq":520,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.868890+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:38:41.868890+0000","last_peered":"2024-03-08T20:38:41.868890+0000","last_clean":"2024-03-08T20:38:41.868890+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:41.868890+0000","last_undegraded":"2024-03-08T20:38:41.868890+0000","last_fullsized":"2024-03-08T20:38:41.868890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849964+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:38:43.849964+0000","last_peered":"2024-03-08T20:38:43.849964+0000","last_clean":"2024-03-08T20:38:43.849964+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:38:43.849964+0000","last_undegraded":"2024-03-08T20:38:43.849964+0000","last_fullsized":"2024-03-08T20:38:43.849964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1219","reported_seq":1244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.073298+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:38:44.073298+0000","last_peered":"2024-03-08T20:38:44.073298+0000","last_clean":"2024-03-08T20:38:44.073298+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:38:44.073298+0000","last_undegraded":"2024-03-08T20:38:44.073298+0000","last_fullsized":"2024-03-08T20:38:44.073298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'444","reported_seq":474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.337438+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:38:42.337438+0000","last_peered":"2024-03-08T20:38:42.337438+0000","last_clean":"2024-03-08T20:38:42.337438+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:38:42.337438+0000","last_undegraded":"2024-03-08T20:38:42.337438+0000","last_fullsized":"2024-03-08T20:38:42.337438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":710,"num_write_kb":9818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.582075+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:38:43.582075+0000","last_peered":"2024-03-08T20:38:43.582075+0000","last_clean":"2024-03-08T20:38:43.582075+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:38:43.582075+0000","last_undegraded":"2024-03-08T20:38:43.582075+0000","last_fullsized":"2024-03-08T20:38:43.582075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7651,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1283","reported_seq":1310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.590898+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:38:43.590898+0000","last_peered":"2024-03-08T20:38:43.590898+0000","last_clean":"2024-03-08T20:38:43.590898+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:38:43.590898+0000","last_undegraded":"2024-03-08T20:38:43.590898+0000","last_fullsized":"2024-03-08T20:38:43.590898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'774","reported_seq":803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.490411+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:38:43.490411+0000","last_peered":"2024-03-08T20:38:43.490411+0000","last_clean":"2024-03-08T20:38:43.490411+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:38:43.490411+0000","last_undegraded":"2024-03-08T20:38:43.490411+0000","last_fullsized":"2024-03-08T20:38:43.490411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.823900+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:38:43.823900+0000","last_peered":"2024-03-08T20:38:43.823900+0000","last_clean":"2024-03-08T20:38:43.823900+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:38:43.823900+0000","last_undegraded":"2024-03-08T20:38:43.823900+0000","last_fullsized":"2024-03-08T20:38:43.823900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1275","reported_seq":1302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.255300+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.255300+0000","last_peered":"2024-03-08T20:38:43.255300+0000","last_clean":"2024-03-08T20:38:43.255300+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:38:43.255300+0000","last_undegraded":"2024-03-08T20:38:43.255300+0000","last_fullsized":"2024-03-08T20:38:43.255300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'522","reported_seq":551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.253157+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:38:43.253157+0000","last_peered":"2024-03-08T20:38:43.253157+0000","last_clean":"2024-03-08T20:38:43.253157+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:43.253157+0000","last_undegraded":"2024-03-08T20:38:43.253157+0000","last_fullsized":"2024-03-08T20:38:43.253157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.247340+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:38:43.247340+0000","last_peered":"2024-03-08T20:38:43.247340+0000","last_clean":"2024-03-08T20:38:43.247340+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:38:43.247340+0000","last_undegraded":"2024-03-08T20:38:43.247340+0000","last_fullsized":"2024-03-08T20:38:43.247340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1234","reported_seq":1261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.436795+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:38:43.436795+0000","last_peered":"2024-03-08T20:38:43.436795+0000","last_clean":"2024-03-08T20:38:43.436795+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:38:43.436795+0000","last_undegraded":"2024-03-08T20:38:43.436795+0000","last_fullsized":"2024-03-08T20:38:43.436795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1234,"log_dups_size":0,"ondisk_log_size":1234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'648","reported_seq":677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.932498+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:38:43.932498+0000","last_peered":"2024-03-08T20:38:43.932498+0000","last_clean":"2024-03-08T20:38:43.932498+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:38:43.932498+0000","last_undegraded":"2024-03-08T20:38:43.932498+0000","last_fullsized":"2024-03-08T20:38:43.932498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":921,"num_write_kb":30369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743799+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:38:43.743799+0000","last_peered":"2024-03-08T20:38:43.743799+0000","last_clean":"2024-03-08T20:38:43.743799+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:38:43.743799+0000","last_undegraded":"2024-03-08T20:38:43.743799+0000","last_fullsized":"2024-03-08T20:38:43.743799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.298955+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:38:44.298955+0000","last_peered":"2024-03-08T20:38:44.298955+0000","last_clean":"2024-03-08T20:38:44.298955+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:38:44.298955+0000","last_undegraded":"2024-03-08T20:38:44.298955+0000","last_fullsized":"2024-03-08T20:38:44.298955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1149,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'629","reported_seq":658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.734087+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:38:41.734087+0000","last_peered":"2024-03-08T20:38:41.734087+0000","last_clean":"2024-03-08T20:38:41.734087+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:41.734087+0000","last_undegraded":"2024-03-08T20:38:41.734087+0000","last_fullsized":"2024-03-08T20:38:41.734087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5155","reported_seq":5177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229489+0000","last_change":"2024-03-08T20:30:10.640415+0000","last_active":"2024-03-08T20:38:44.229489+0000","last_peered":"2024-03-08T20:38:44.229489+0000","last_clean":"2024-03-08T20:38:44.229489+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:38:44.229489+0000","last_undegraded":"2024-03-08T20:38:44.229489+0000","last_fullsized":"2024-03-08T20:38:44.229489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:19:52.665266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7458,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1270","reported_seq":1297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.640679+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:38:43.640679+0000","last_peered":"2024-03-08T20:38:43.640679+0000","last_clean":"2024-03-08T20:38:43.640679+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:38:43.640679+0000","last_undegraded":"2024-03-08T20:38:43.640679+0000","last_fullsized":"2024-03-08T20:38:43.640679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'413","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.559163+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:38:42.559163+0000","last_peered":"2024-03-08T20:38:42.559163+0000","last_clean":"2024-03-08T20:38:42.559163+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:42.559163+0000","last_undegraded":"2024-03-08T20:38:42.559163+0000","last_fullsized":"2024-03-08T20:38:42.559163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5121","reported_seq":5126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743210+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:38:43.743210+0000","last_peered":"2024-03-08T20:38:43.743210+0000","last_clean":"2024-03-08T20:38:43.743210+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:38:43.743210+0000","last_undegraded":"2024-03-08T20:38:43.743210+0000","last_fullsized":"2024-03-08T20:38:43.743210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7428,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1272","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.046416+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:38:43.046416+0000","last_peered":"2024-03-08T20:38:43.046416+0000","last_clean":"2024-03-08T20:38:43.046416+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:38:43.046416+0000","last_undegraded":"2024-03-08T20:38:43.046416+0000","last_fullsized":"2024-03-08T20:38:43.046416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1239","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.771963+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:38:43.771963+0000","last_peered":"2024-03-08T20:38:43.771963+0000","last_clean":"2024-03-08T20:38:43.771963+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:43.771963+0000","last_undegraded":"2024-03-08T20:38:43.771963+0000","last_fullsized":"2024-03-08T20:38:43.771963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1466,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5433","reported_seq":5437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.782104+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:38:43.782104+0000","last_peered":"2024-03-08T20:38:43.782104+0000","last_clean":"2024-03-08T20:38:43.782104+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:43.782104+0000","last_undegraded":"2024-03-08T20:38:43.782104+0000","last_fullsized":"2024-03-08T20:38:43.782104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5433,"log_dups_size":0,"ondisk_log_size":5433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7909,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665938+0000","last_change":"2024-03-08T20:30:10.908474+0000","last_active":"2024-03-08T20:38:43.665938+0000","last_peered":"2024-03-08T20:38:43.665938+0000","last_clean":"2024-03-08T20:38:43.665938+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:43.665938+0000","last_undegraded":"2024-03-08T20:38:43.665938+0000","last_fullsized":"2024-03-08T20:38:43.665938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:43.649481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1289","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.016702+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:38:43.016702+0000","last_peered":"2024-03-08T20:38:43.016702+0000","last_clean":"2024-03-08T20:38:43.016702+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:43.016702+0000","last_undegraded":"2024-03-08T20:38:43.016702+0000","last_fullsized":"2024-03-08T20:38:43.016702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'505","reported_seq":534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.913975+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:38:42.913975+0000","last_peered":"2024-03-08T20:38:42.913975+0000","last_clean":"2024-03-08T20:38:42.913975+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:38:42.913975+0000","last_undegraded":"2024-03-08T20:38:42.913975+0000","last_fullsized":"2024-03-08T20:38:42.913975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.053077+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:38:44.053077+0000","last_peered":"2024-03-08T20:38:44.053077+0000","last_clean":"2024-03-08T20:38:44.053077+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:38:44.053077+0000","last_undegraded":"2024-03-08T20:38:44.053077+0000","last_fullsized":"2024-03-08T20:38:44.053077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1296","reported_seq":1323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.801386+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:38:43.801386+0000","last_peered":"2024-03-08T20:38:43.801386+0000","last_clean":"2024-03-08T20:38:43.801386+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:38:43.801386+0000","last_undegraded":"2024-03-08T20:38:43.801386+0000","last_fullsized":"2024-03-08T20:38:43.801386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1164,"num_object_clones":0,"num_object_copies":2328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'385","reported_seq":414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.802950+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:38:42.802950+0000","last_peered":"2024-03-08T20:38:42.802950+0000","last_clean":"2024-03-08T20:38:42.802950+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:38:42.802950+0000","last_undegraded":"2024-03-08T20:38:42.802950+0000","last_fullsized":"2024-03-08T20:38:42.802950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9009041,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":650,"num_write_kb":14388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'542","reported_seq":571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152160+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:38:44.152160+0000","last_peered":"2024-03-08T20:38:44.152160+0000","last_clean":"2024-03-08T20:38:44.152160+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:38:44.152160+0000","last_undegraded":"2024-03-08T20:38:44.152160+0000","last_fullsized":"2024-03-08T20:38:44.152160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":804,"num_write_kb":34561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1252","reported_seq":1279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.301368+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:38:43.301368+0000","last_peered":"2024-03-08T20:38:43.301368+0000","last_clean":"2024-03-08T20:38:43.301368+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:38:43.301368+0000","last_undegraded":"2024-03-08T20:38:43.301368+0000","last_fullsized":"2024-03-08T20:38:43.301368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5220","reported_seq":5241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.558185+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:38:42.558185+0000","last_peered":"2024-03-08T20:38:42.558185+0000","last_clean":"2024-03-08T20:38:42.558185+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:38:42.558185+0000","last_undegraded":"2024-03-08T20:38:42.558185+0000","last_fullsized":"2024-03-08T20:38:42.558185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5220,"log_dups_size":0,"ondisk_log_size":5220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7552,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'410","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.897852+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:38:42.897852+0000","last_peered":"2024-03-08T20:38:42.897852+0000","last_clean":"2024-03-08T20:38:42.897852+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:38:42.897852+0000","last_undegraded":"2024-03-08T20:38:42.897852+0000","last_fullsized":"2024-03-08T20:38:42.897852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1278","reported_seq":1305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.276570+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:38:44.276570+0000","last_peered":"2024-03-08T20:38:44.276570+0000","last_clean":"2024-03-08T20:38:44.276570+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:38:44.276570+0000","last_undegraded":"2024-03-08T20:38:44.276570+0000","last_fullsized":"2024-03-08T20:38:44.276570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1159,"num_object_clones":0,"num_object_copies":2318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5217","reported_seq":5202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.795426+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:38:43.795426+0000","last_peered":"2024-03-08T20:38:43.795426+0000","last_clean":"2024-03-08T20:38:43.795426+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:38:43.795426+0000","last_undegraded":"2024-03-08T20:38:43.795426+0000","last_fullsized":"2024-03-08T20:38:43.795426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5217,"log_dups_size":0,"ondisk_log_size":5217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7565,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1249","reported_seq":1277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.427034+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:38:43.427034+0000","last_peered":"2024-03-08T20:38:43.427034+0000","last_clean":"2024-03-08T20:38:43.427034+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:38:43.427034+0000","last_undegraded":"2024-03-08T20:38:43.427034+0000","last_fullsized":"2024-03-08T20:38:43.427034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1342","reported_seq":1370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.140197+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:38:42.140197+0000","last_peered":"2024-03-08T20:38:42.140197+0000","last_clean":"2024-03-08T20:38:42.140197+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:38:42.140197+0000","last_undegraded":"2024-03-08T20:38:42.140197+0000","last_fullsized":"2024-03-08T20:38:42.140197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1258","reported_seq":1286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.669285+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:38:43.669285+0000","last_peered":"2024-03-08T20:38:43.669285+0000","last_clean":"2024-03-08T20:38:43.669285+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:38:43.669285+0000","last_undegraded":"2024-03-08T20:38:43.669285+0000","last_fullsized":"2024-03-08T20:38:43.669285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.305648+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:38:43.305648+0000","last_peered":"2024-03-08T20:38:43.305648+0000","last_clean":"2024-03-08T20:38:43.305648+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:38:43.305648+0000","last_undegraded":"2024-03-08T20:38:43.305648+0000","last_fullsized":"2024-03-08T20:38:43.305648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1268","reported_seq":1291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.788615+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:38:43.788615+0000","last_peered":"2024-03-08T20:38:43.788615+0000","last_clean":"2024-03-08T20:38:43.788615+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:43.788615+0000","last_undegraded":"2024-03-08T20:38:43.788615+0000","last_fullsized":"2024-03-08T20:38:43.788615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1266","reported_seq":1294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.066004+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:38:43.066004+0000","last_peered":"2024-03-08T20:38:43.066004+0000","last_clean":"2024-03-08T20:38:43.066004+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:38:43.066004+0000","last_undegraded":"2024-03-08T20:38:43.066004+0000","last_fullsized":"2024-03-08T20:38:43.066004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1345","reported_seq":1373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.026042+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:38:44.026042+0000","last_peered":"2024-03-08T20:38:44.026042+0000","last_clean":"2024-03-08T20:38:44.026042+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:38:44.026042+0000","last_undegraded":"2024-03-08T20:38:44.026042+0000","last_fullsized":"2024-03-08T20:38:44.026042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1288","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.455137+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:38:43.455137+0000","last_peered":"2024-03-08T20:38:43.455137+0000","last_clean":"2024-03-08T20:38:43.455137+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:38:43.455137+0000","last_undegraded":"2024-03-08T20:38:43.455137+0000","last_fullsized":"2024-03-08T20:38:43.455137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1288,"log_dups_size":0,"ondisk_log_size":1288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1271","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.272774+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:38:43.272774+0000","last_peered":"2024-03-08T20:38:43.272774+0000","last_clean":"2024-03-08T20:38:43.272774+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:38:43.272774+0000","last_undegraded":"2024-03-08T20:38:43.272774+0000","last_fullsized":"2024-03-08T20:38:43.272774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1268","reported_seq":1295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.636127+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:38:43.636127+0000","last_peered":"2024-03-08T20:38:43.636127+0000","last_clean":"2024-03-08T20:38:43.636127+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:38:43.636127+0000","last_undegraded":"2024-03-08T20:38:43.636127+0000","last_fullsized":"2024-03-08T20:38:43.636127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1132,"num_object_clones":0,"num_object_copies":2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.692530+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:38:43.692530+0000","last_peered":"2024-03-08T20:38:43.692530+0000","last_clean":"2024-03-08T20:38:43.692530+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:38:43.692530+0000","last_undegraded":"2024-03-08T20:38:43.692530+0000","last_fullsized":"2024-03-08T20:38:43.692530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1320","reported_seq":1348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665589+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.665589+0000","last_peered":"2024-03-08T20:38:43.665589+0000","last_clean":"2024-03-08T20:38:43.665589+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:38:43.665589+0000","last_undegraded":"2024-03-08T20:38:43.665589+0000","last_fullsized":"2024-03-08T20:38:43.665589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1298","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.142042+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:38:44.142042+0000","last_peered":"2024-03-08T20:38:44.142042+0000","last_clean":"2024-03-08T20:38:44.142042+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:38:44.142042+0000","last_undegraded":"2024-03-08T20:38:44.142042+0000","last_fullsized":"2024-03-08T20:38:44.142042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1298,"log_dups_size":0,"ondisk_log_size":1298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1310","reported_seq":1338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.437003+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:38:43.437003+0000","last_peered":"2024-03-08T20:38:43.437003+0000","last_clean":"2024-03-08T20:38:43.437003+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:38:43.437003+0000","last_undegraded":"2024-03-08T20:38:43.437003+0000","last_fullsized":"2024-03-08T20:38:43.437003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.279682+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:38:42.279682+0000","last_peered":"2024-03-08T20:38:42.279682+0000","last_clean":"2024-03-08T20:38:42.279682+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:38:42.279682+0000","last_undegraded":"2024-03-08T20:38:42.279682+0000","last_fullsized":"2024-03-08T20:38:42.279682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1324","reported_seq":1337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.215350+0000","last_change":"2024-03-08T20:30:10.906961+0000","last_active":"2024-03-08T20:38:42.215350+0000","last_peered":"2024-03-08T20:38:42.215350+0000","last_clean":"2024-03-08T20:38:42.215350+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:38:42.215350+0000","last_undegraded":"2024-03-08T20:38:42.215350+0000","last_fullsized":"2024-03-08T20:38:42.215350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1324,"log_dups_size":0,"ondisk_log_size":1324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'1255","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.944808+0000","last_change":"2024-03-08T20:30:10.632389+0000","last_active":"2024-03-08T20:38:41.944808+0000","last_peered":"2024-03-08T20:38:41.944808+0000","last_clean":"2024-03-08T20:38:41.944808+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:38:41.944808+0000","last_undegraded":"2024-03-08T20:38:41.944808+0000","last_fullsized":"2024-03-08T20:38:41.944808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.956611+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:38:42.956611+0000","last_peered":"2024-03-08T20:38:42.956611+0000","last_clean":"2024-03-08T20:38:42.956611+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:38:42.956611+0000","last_undegraded":"2024-03-08T20:38:42.956611+0000","last_fullsized":"2024-03-08T20:38:42.956611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1245","reported_seq":1272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.101433+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:38:43.101433+0000","last_peered":"2024-03-08T20:38:43.101433+0000","last_clean":"2024-03-08T20:38:43.101433+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:38:43.101433+0000","last_undegraded":"2024-03-08T20:38:43.101433+0000","last_fullsized":"2024-03-08T20:38:43.101433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1245,"log_dups_size":0,"ondisk_log_size":1245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1258","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.754953+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:38:43.754953+0000","last_peered":"2024-03-08T20:38:43.754953+0000","last_clean":"2024-03-08T20:38:43.754953+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:43.754953+0000","last_undegraded":"2024-03-08T20:38:43.754953+0000","last_fullsized":"2024-03-08T20:38:43.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1208","reported_seq":1224,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.936295+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:38:43.936295+0000","last_peered":"2024-03-08T20:38:43.936295+0000","last_clean":"2024-03-08T20:38:43.936295+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:38:43.936295+0000","last_undegraded":"2024-03-08T20:38:43.936295+0000","last_fullsized":"2024-03-08T20:38:43.936295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1096,"num_object_clones":0,"num_object_copies":2192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1266","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.933894+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:38:43.933894+0000","last_peered":"2024-03-08T20:38:43.933894+0000","last_clean":"2024-03-08T20:38:43.933894+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:38:43.933894+0000","last_undegraded":"2024-03-08T20:38:43.933894+0000","last_fullsized":"2024-03-08T20:38:43.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1285","reported_seq":1312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.047031+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:38:44.047031+0000","last_peered":"2024-03-08T20:38:44.047031+0000","last_clean":"2024-03-08T20:38:44.047031+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:38:44.047031+0000","last_undegraded":"2024-03-08T20:38:44.047031+0000","last_fullsized":"2024-03-08T20:38:44.047031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1281","reported_seq":1308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:38.718954+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:38:38.718954+0000","last_peered":"2024-03-08T20:38:38.718954+0000","last_clean":"2024-03-08T20:38:38.718954+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:38:38.718954+0000","last_undegraded":"2024-03-08T20:38:38.718954+0000","last_fullsized":"2024-03-08T20:38:38.718954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1259","reported_seq":1284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.827083+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:38:43.827083+0000","last_peered":"2024-03-08T20:38:43.827083+0000","last_clean":"2024-03-08T20:38:43.827083+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:38:43.827083+0000","last_undegraded":"2024-03-08T20:38:43.827083+0000","last_fullsized":"2024-03-08T20:38:43.827083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1259,"log_dups_size":0,"ondisk_log_size":1259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1131,"num_object_clones":0,"num_object_copies":2262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1240","reported_seq":1267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.418827+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:38:43.418827+0000","last_peered":"2024-03-08T20:38:43.418827+0000","last_clean":"2024-03-08T20:38:43.418827+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:38:43.418827+0000","last_undegraded":"2024-03-08T20:38:43.418827+0000","last_fullsized":"2024-03-08T20:38:43.418827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1221","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.574530+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:38:43.574530+0000","last_peered":"2024-03-08T20:38:43.574530+0000","last_clean":"2024-03-08T20:38:43.574530+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:38:43.574530+0000","last_undegraded":"2024-03-08T20:38:43.574530+0000","last_fullsized":"2024-03-08T20:38:43.574530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1323","reported_seq":1350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.971308+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:38:42.971308+0000","last_peered":"2024-03-08T20:38:42.971308+0000","last_clean":"2024-03-08T20:38:42.971308+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:38:42.971308+0000","last_undegraded":"2024-03-08T20:38:42.971308+0000","last_fullsized":"2024-03-08T20:38:42.971308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1270","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.424239+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:38:43.424239+0000","last_peered":"2024-03-08T20:38:43.424239+0000","last_clean":"2024-03-08T20:38:43.424239+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:38:43.424239+0000","last_undegraded":"2024-03-08T20:38:43.424239+0000","last_fullsized":"2024-03-08T20:38:43.424239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1303","reported_seq":1331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.990298+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:38:42.990298+0000","last_peered":"2024-03-08T20:38:42.990298+0000","last_clean":"2024-03-08T20:38:42.990298+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:42.990298+0000","last_undegraded":"2024-03-08T20:38:42.990298+0000","last_fullsized":"2024-03-08T20:38:42.990298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1204","reported_seq":1232,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.892932+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:38:42.892932+0000","last_peered":"2024-03-08T20:38:42.892932+0000","last_clean":"2024-03-08T20:38:42.892932+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:42.892932+0000","last_undegraded":"2024-03-08T20:38:42.892932+0000","last_fullsized":"2024-03-08T20:38:42.892932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1178","reported_seq":1206,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.655861+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:38:42.655861+0000","last_peered":"2024-03-08T20:38:42.655861+0000","last_clean":"2024-03-08T20:38:42.655861+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:38:42.655861+0000","last_undegraded":"2024-03-08T20:38:42.655861+0000","last_fullsized":"2024-03-08T20:38:42.655861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1070,"num_object_clones":0,"num_object_copies":2140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":242584,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167070,"ondisk_log_size":167070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73190,"num_object_clones":0,"num_object_copies":146380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77594,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81615,"ondisk_log_size":81615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":185758531,"num_objects":4499,"num_object_clones":0,"num_object_copies":8998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33031,"num_write_kb":742459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130699264,"data_stored":375816734,"data_compressed":52167254,"data_compressed_allocated":64143360,"data_compressed_original":309325824,"omap_allocated":0,"internal_metadata":0},"log_size":23530,"ondisk_log_size":23530,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582308,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93789532,"statfs":{"total":96636764160,"available":96040480768,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,13,37,35,48,28,170],"upper_bound":4096},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":707700,"kb_used_data":401708,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93664140,"statfs":{"total":96636764160,"available":95912079360,"internally_reserved":0,"allocated":411348992,"data_stored":564529961,"data_compressed":75981661,"data_compressed_allocated":89468928,"data_compressed_original":242831360,"omap_allocated":1594,"internal_metadata":313326022},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,10,18,31,36,47,203],"upper_bound":2048},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527844,"kb_used_data":253724,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93843996,"statfs":{"total":96636764160,"available":96096251904,"internally_reserved":0,"allocated":259813376,"data_stored":432525650,"data_compressed":68150985,"data_compressed_allocated":85839872,"data_compressed_original":258727936,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,0,23,0,19,23,10,191,31],"upper_bound":2048},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":619676,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93752164,"statfs":{"total":96636764160,"available":96002215936,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,5,32,55,90,69,30,27,70,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":823816,"kb_used_data":423360,"kb_used_omap":1,"kb_used_meta":400446,"kb_avail":93548024,"statfs":{"total":96636764160,"available":95793176576,"internally_reserved":0,"allocated":433520640,"data_stored":670953757,"data_compressed":105789092,"data_compressed_allocated":133480448,"data_compressed_original":371097600,"omap_allocated":1593,"internal_metadata":410057159},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,16,11,48,31,45,63,65,65],"upper_bound":4096},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569484,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93802356,"statfs":{"total":96636764160,"available":96053612544,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":888068,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":436478,"kb_avail":93483772,"statfs":{"total":96636764160,"available":95727382528,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":446953925},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600120,"kb_used_data":308016,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93771720,"statfs":{"total":96636764160,"available":96022241280,"internally_reserved":0,"allocated":315408384,"data_stored":435467670,"data_compressed":64254155,"data_compressed_allocated":77156352,"data_compressed_original":197402624,"omap_allocated":1594,"internal_metadata":299104710},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,0,2,5,14,0,0,18,65],"upper_bound":2048},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":25166462,"data_compressed":2865800,"data_compressed_allocated":3715072,"data_compressed_original":16809984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20426752,"data_stored":51610257,"data_compressed":6731091,"data_compressed_allocated":8540160,"data_compressed_original":39735296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":50987869,"data_compressed":7594478,"data_compressed_allocated":9105408,"data_compressed_original":46370816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:38:48.655 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:38:48.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.906+0000 7f19a6000640 1 Processor -- start 2024-03-08T20:38:48.906 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.906+0000 7f19a6000640 1 -- start start 2024-03-08T20:38:48.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f19a6000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f19a6000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19a01555c0 0x7f19a0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f19a6000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a006e0d0 con 0x7f19a01525b0 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f19a6000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a0155f50 con 0x7f19a01555c0 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f19a6000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c0340 con 0x7f19a006e750 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f199fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19a01555c0 0x7f19a0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f199fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f19a01555c0 0x7f19a0155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56236/0 (socket says 172.21.15.118:56236) 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f199fe00640 1 -- 172.21.15.118:0/401101287 learned_addr learned my addr 172.21.15.118:0/401101287 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.908+0000 7f1997e00640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.909+0000 7f199fe00640 1 -- 172.21.15.118:0/401101287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 msgr2=0x7f19a006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:48.911 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.909+0000 7f199fe00640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a006ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.909+0000 7f199fe00640 1 -- 172.21.15.118:0/401101287 >> v1:172.21.15.144:6789/0 conn(0x7f19a01525b0 legacy=0x7f19a00c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.909+0000 7f199fe00640 1 -- 172.21.15.118:0/401101287 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00c0620 con 0x7f19a01555c0 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.910+0000 7f199fe00640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01555c0 0x7f19a0155a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1998009e50 tx=0x7f199802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c55da99bfaf743d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.910+0000 7f199ea00640 1 -- 172.21.15.118:0/401101287 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199802c9e0 con 0x7f19a01555c0 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.910+0000 7f199ea00640 1 -- 172.21.15.118:0/401101287 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199802cb80 con 0x7f19a01555c0 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.910+0000 7f199ea00640 1 -- 172.21.15.118:0/401101287 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19980343f0 con 0x7f19a01555c0 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 -- 172.21.15.118:0/401101287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01555c0 msgr2=0x7f19a0155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01555c0 0x7f19a0155a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1998009e50 tx=0x7f199802be40 comp rx=0 tx=0).stop 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 -- 172.21.15.118:0/401101287 shutdown_connections 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 --2- 172.21.15.118:0/401101287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01555c0 0x7f19a0155a10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 -- 172.21.15.118:0/401101287 >> 172.21.15.118:0/401101287 conn(0x7f19a00a84c0 msgr2=0x7f19a00a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 -- 172.21.15.118:0/401101287 shutdown_connections 2024-03-08T20:38:48.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.911+0000 7f19a6000640 1 -- 172.21.15.118:0/401101287 wait complete. 2024-03-08T20:38:48.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.913+0000 7f19a6000640 1 Processor -- start 2024-03-08T20:38:48.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.913+0000 7f19a6000640 1 -- start start 2024-03-08T20:38:48.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a0150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a01555c0 0x7f19a01eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0152990 con 0x7f19a01525b0 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01550a0 con 0x7f19a01555c0 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f19a6000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00bfff0 con 0x7f19a006e750 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f1997e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f1997e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56248/0 (socket says 172.21.15.118:56248) 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.914+0000 7f1997e00640 1 -- 172.21.15.118:0/1948283580 learned_addr learned my addr 172.21.15.118:0/1948283580 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f199fe00640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a01555c0 0x7f19a01eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f199f400640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a0150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 -- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 msgr2=0x7f19a0150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a0150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 -- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a01555c0 msgr2=0x7f19a01eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a01555c0 0x7f19a01eadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 -- 172.21.15.118:0/1948283580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a014b3d0 con 0x7f19a01525b0 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997e00640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f198800d5f0 tx=0x7f198800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880125f0 con 0x7f19a01525b0 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.915+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988019070 con 0x7f19a01525b0 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.916+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880129d0 con 0x7f19a01525b0 2024-03-08T20:38:48.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.916+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a01eeae0 con 0x7f19a01525b0 2024-03-08T20:38:48.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.916+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a01ee7b0 con 0x7f19a01525b0 2024-03-08T20:38:48.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.917+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a0152d20 con 0x7f19a01525b0 2024-03-08T20:38:48.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.918+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1988012b70 con 0x7f19a01525b0 2024-03-08T20:38:48.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.919+0000 7f1997400640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 0x7f197c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:48.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.919+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f198808b280 con 0x7f19a01525b0 2024-03-08T20:38:48.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.919+0000 7f199f400640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 0x7f197c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:48.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.920+0000 7f199f400640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 0x7f197c06e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f19a01eb9b0 tx=0x7f1990009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:48.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:48.924+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f19a0152d20 con 0x7f19a01525b0 2024-03-08T20:38:49.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.115+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19a00c4280 con 0x7f197c06bbd0 2024-03-08T20:38:49.132 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.133+0000 7f1997400640 1 -- 172.21.15.118:0/1948283580 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337587 (secure 0 0 0) 0x7f19a00c4280 con 0x7f197c06bbd0 2024-03-08T20:38:49.136 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:49.138 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 msgr2=0x7f197c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 0x7f197c06e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f19a01eb9b0 tx=0x7f1990009040 comp rx=0 tx=0).stop 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 msgr2=0x7f19a01ea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f198800d5f0 tx=0x7f198800dab0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 shutdown_connections 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f197c06bbd0 0x7f197c06e090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19a01555c0 0x7f19a01eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.138+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19a01525b0 0x7f19a01ea880 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.139+0000 7f19a6000640 1 --2- 172.21.15.118:0/1948283580 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19a006e750 0x7f19a0150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.139+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 >> 172.21.15.118:0/1948283580 conn(0x7f19a00a84c0 msgr2=0x7f19a0153570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:49.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.139+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 shutdown_connections 2024-03-08T20:38:49.141 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.139+0000 7f19a6000640 1 -- 172.21.15.118:0/1948283580 wait complete. 2024-03-08T20:38:49.156 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-03-08T20:38:47.721925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1675067347,"num_objects":158923,"num_object_clones":0,"num_object_copies":480310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158923,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":353368,"num_write_kb":2319575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272332,"ondisk_log_size":272332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5319016,"kb_used_data":2799976,"kb_used_omap":12,"kb_used_meta":2518963,"kb_avail":749655704,"statfs":{"total":773094113280,"available":767647440896,"internally_reserved":0,"allocated":2867175424,"data_stored":4217762438,"data_compressed":624579107,"data_compressed_allocated":765898752,"data_compressed_original":2117931008,"omap_allocated":12751,"internal_metadata":2579418673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,4,1,47,59,167,212,195,397,419,305,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":254,"apply_latency_ms":254,"commit_latency_ns":254000000,"apply_latency_ns":254000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5552270,"num_objects":2500,"num_object_clones":0,"num_object_copies":5002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7476,"num_write_kb":19613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":193,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005593"},"pg_stats":[{"pgid":"2.1f","version":"27'261","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.196852+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:38:42.196852+0000","last_peered":"2024-03-08T20:38:42.196852+0000","last_clean":"2024-03-08T20:38:42.196852+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:42.196852+0000","last_undegraded":"2024-03-08T20:38:42.196852+0000","last_fullsized":"2024-03-08T20:38:42.196852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1257","reported_seq":1285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.329247+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:38:43.329247+0000","last_peered":"2024-03-08T20:38:43.329247+0000","last_clean":"2024-03-08T20:38:43.329247+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:38:43.329247+0000","last_undegraded":"2024-03-08T20:38:43.329247+0000","last_fullsized":"2024-03-08T20:38:43.329247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.820874+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:38:43.820874+0000","last_peered":"2024-03-08T20:38:43.820874+0000","last_clean":"2024-03-08T20:38:43.820874+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:38:43.820874+0000","last_undegraded":"2024-03-08T20:38:43.820874+0000","last_fullsized":"2024-03-08T20:38:43.820874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'561","reported_seq":591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.856665+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:38:42.856665+0000","last_peered":"2024-03-08T20:38:42.856665+0000","last_clean":"2024-03-08T20:38:42.856665+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:38:42.856665+0000","last_undegraded":"2024-03-08T20:38:42.856665+0000","last_fullsized":"2024-03-08T20:38:42.856665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1255","reported_seq":1283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.630169+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:38:43.630169+0000","last_peered":"2024-03-08T20:38:43.630169+0000","last_clean":"2024-03-08T20:38:43.630169+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:43.630169+0000","last_undegraded":"2024-03-08T20:38:43.630169+0000","last_fullsized":"2024-03-08T20:38:43.630169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5185","reported_seq":5200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.227513+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:38:44.227513+0000","last_peered":"2024-03-08T20:38:44.227513+0000","last_clean":"2024-03-08T20:38:44.227513+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:38:44.227513+0000","last_undegraded":"2024-03-08T20:38:44.227513+0000","last_fullsized":"2024-03-08T20:38:44.227513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5185,"log_dups_size":0,"ondisk_log_size":5185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7531,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.451423+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:38:43.451423+0000","last_peered":"2024-03-08T20:38:43.451423+0000","last_clean":"2024-03-08T20:38:43.451423+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:38:43.451423+0000","last_undegraded":"2024-03-08T20:38:43.451423+0000","last_fullsized":"2024-03-08T20:38:43.451423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1292","reported_seq":1319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.058874+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:38:43.058874+0000","last_peered":"2024-03-08T20:38:43.058874+0000","last_clean":"2024-03-08T20:38:43.058874+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:38:43.058874+0000","last_undegraded":"2024-03-08T20:38:43.058874+0000","last_fullsized":"2024-03-08T20:38:43.058874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5224","reported_seq":5240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229638+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:38:44.229638+0000","last_peered":"2024-03-08T20:38:44.229638+0000","last_clean":"2024-03-08T20:38:44.229638+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:38:44.229638+0000","last_undegraded":"2024-03-08T20:38:44.229638+0000","last_fullsized":"2024-03-08T20:38:44.229638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7563,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'311","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.761608+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:38:41.761608+0000","last_peered":"2024-03-08T20:38:41.761608+0000","last_clean":"2024-03-08T20:38:41.761608+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:38:41.761608+0000","last_undegraded":"2024-03-08T20:38:41.761608+0000","last_fullsized":"2024-03-08T20:38:41.761608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1260","reported_seq":1287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489526+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:38:43.489526+0000","last_peered":"2024-03-08T20:38:43.489526+0000","last_clean":"2024-03-08T20:38:43.489526+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:38:43.489526+0000","last_undegraded":"2024-03-08T20:38:43.489526+0000","last_fullsized":"2024-03-08T20:38:43.489526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5128","reported_seq":5147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.237389+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:38:44.237389+0000","last_peered":"2024-03-08T20:38:44.237389+0000","last_clean":"2024-03-08T20:38:44.237389+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:38:44.237389+0000","last_undegraded":"2024-03-08T20:38:44.237389+0000","last_fullsized":"2024-03-08T20:38:44.237389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5128,"log_dups_size":0,"ondisk_log_size":5128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7468,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1274","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152552+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:38:44.152552+0000","last_peered":"2024-03-08T20:38:44.152552+0000","last_clean":"2024-03-08T20:38:44.152552+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:38:44.152552+0000","last_undegraded":"2024-03-08T20:38:44.152552+0000","last_fullsized":"2024-03-08T20:38:44.152552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1127,"num_object_clones":0,"num_object_copies":2254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'403","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.607882+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:38:43.607882+0000","last_peered":"2024-03-08T20:38:43.607882+0000","last_clean":"2024-03-08T20:38:43.607882+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:38:43.607882+0000","last_undegraded":"2024-03-08T20:38:43.607882+0000","last_fullsized":"2024-03-08T20:38:43.607882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.877774+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:38:41.877774+0000","last_peered":"2024-03-08T20:38:41.877774+0000","last_clean":"2024-03-08T20:38:41.877774+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:38:41.877774+0000","last_undegraded":"2024-03-08T20:38:41.877774+0000","last_fullsized":"2024-03-08T20:38:41.877774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7560,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1326","reported_seq":1354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.757829+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:38:43.757829+0000","last_peered":"2024-03-08T20:38:43.757829+0000","last_clean":"2024-03-08T20:38:43.757829+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:38:43.757829+0000","last_undegraded":"2024-03-08T20:38:43.757829+0000","last_fullsized":"2024-03-08T20:38:43.757829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1510","reported_seq":1540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.049211+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:38:42.049211+0000","last_peered":"2024-03-08T20:38:42.049211+0000","last_clean":"2024-03-08T20:38:42.049211+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:38:42.049211+0000","last_undegraded":"2024-03-08T20:38:42.049211+0000","last_fullsized":"2024-03-08T20:38:42.049211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5253","reported_seq":5262,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.212333+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:38:44.212333+0000","last_peered":"2024-03-08T20:38:44.212333+0000","last_clean":"2024-03-08T20:38:44.212333+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:38:44.212333+0000","last_undegraded":"2024-03-08T20:38:44.212333+0000","last_fullsized":"2024-03-08T20:38:44.212333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7647,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.680909+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:38:43.680909+0000","last_peered":"2024-03-08T20:38:43.680909+0000","last_clean":"2024-03-08T20:38:43.680909+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:38:43.680909+0000","last_undegraded":"2024-03-08T20:38:43.680909+0000","last_fullsized":"2024-03-08T20:38:43.680909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1180,"num_object_clones":0,"num_object_copies":2360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.788109+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:38:41.788109+0000","last_peered":"2024-03-08T20:38:41.788109+0000","last_clean":"2024-03-08T20:38:41.788109+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:38:41.788109+0000","last_undegraded":"2024-03-08T20:38:41.788109+0000","last_fullsized":"2024-03-08T20:38:41.788109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.991706+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:38:43.991706+0000","last_peered":"2024-03-08T20:38:43.991706+0000","last_clean":"2024-03-08T20:38:43.991706+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:38:43.991706+0000","last_undegraded":"2024-03-08T20:38:43.991706+0000","last_fullsized":"2024-03-08T20:38:43.991706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.270605+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:38:44.270605+0000","last_peered":"2024-03-08T20:38:44.270605+0000","last_clean":"2024-03-08T20:38:44.270605+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:44.270605+0000","last_undegraded":"2024-03-08T20:38:44.270605+0000","last_fullsized":"2024-03-08T20:38:44.270605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'966","reported_seq":996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.817632+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:38:41.817632+0000","last_peered":"2024-03-08T20:38:41.817632+0000","last_clean":"2024-03-08T20:38:41.817632+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:38:41.817632+0000","last_undegraded":"2024-03-08T20:38:41.817632+0000","last_fullsized":"2024-03-08T20:38:41.817632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5268","reported_seq":5289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.323598+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:38:44.323598+0000","last_peered":"2024-03-08T20:38:44.323598+0000","last_clean":"2024-03-08T20:38:44.323598+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:38:44.323598+0000","last_undegraded":"2024-03-08T20:38:44.323598+0000","last_fullsized":"2024-03-08T20:38:44.323598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7657,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.375044+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:38:43.375044+0000","last_peered":"2024-03-08T20:38:43.375044+0000","last_clean":"2024-03-08T20:38:43.375044+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:38:43.375044+0000","last_undegraded":"2024-03-08T20:38:43.375044+0000","last_fullsized":"2024-03-08T20:38:43.375044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'313","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.028871+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:38:44.028871+0000","last_peered":"2024-03-08T20:38:44.028871+0000","last_clean":"2024-03-08T20:38:44.028871+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:38:44.028871+0000","last_undegraded":"2024-03-08T20:38:44.028871+0000","last_fullsized":"2024-03-08T20:38:44.028871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5191","reported_seq":5205,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.106192+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:38:44.106192+0000","last_peered":"2024-03-08T20:38:44.106192+0000","last_clean":"2024-03-08T20:38:44.106192+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:38:44.106192+0000","last_undegraded":"2024-03-08T20:38:44.106192+0000","last_fullsized":"2024-03-08T20:38:44.106192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5191,"log_dups_size":0,"ondisk_log_size":5191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7529,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1253","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.708868+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:38:43.708868+0000","last_peered":"2024-03-08T20:38:43.708868+0000","last_clean":"2024-03-08T20:38:43.708868+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:38:43.708868+0000","last_undegraded":"2024-03-08T20:38:43.708868+0000","last_fullsized":"2024-03-08T20:38:43.708868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1093,"num_object_clones":0,"num_object_copies":2186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'789","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.688930+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:38:42.688930+0000","last_peered":"2024-03-08T20:38:42.688930+0000","last_clean":"2024-03-08T20:38:42.688930+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:42.688930+0000","last_undegraded":"2024-03-08T20:38:42.688930+0000","last_fullsized":"2024-03-08T20:38:42.688930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5223","reported_seq":5238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.745388+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.745388+0000","last_peered":"2024-03-08T20:38:43.745388+0000","last_clean":"2024-03-08T20:38:43.745388+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:38:43.745388+0000","last_undegraded":"2024-03-08T20:38:43.745388+0000","last_fullsized":"2024-03-08T20:38:43.745388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5223,"log_dups_size":0,"ondisk_log_size":5223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7614,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1299","reported_seq":1327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.182639+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:38:43.182639+0000","last_peered":"2024-03-08T20:38:43.182639+0000","last_clean":"2024-03-08T20:38:43.182639+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:38:43.182639+0000","last_undegraded":"2024-03-08T20:38:43.182639+0000","last_fullsized":"2024-03-08T20:38:43.182639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.194981+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:38:43.194981+0000","last_peered":"2024-03-08T20:38:43.194981+0000","last_clean":"2024-03-08T20:38:43.194981+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:38:43.194981+0000","last_undegraded":"2024-03-08T20:38:43.194981+0000","last_fullsized":"2024-03-08T20:38:43.194981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.647089+0000","last_change":"2024-03-08T20:30:10.906802+0000","last_active":"2024-03-08T20:38:43.647089+0000","last_peered":"2024-03-08T20:38:43.647089+0000","last_clean":"2024-03-08T20:38:43.647089+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:38:43.647089+0000","last_undegraded":"2024-03-08T20:38:43.647089+0000","last_fullsized":"2024-03-08T20:38:43.647089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:04:20.777976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1255","reported_seq":1269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.161190+0000","last_change":"2024-03-08T20:30:10.908515+0000","last_active":"2024-03-08T20:38:42.161190+0000","last_peered":"2024-03-08T20:38:42.161190+0000","last_clean":"2024-03-08T20:38:42.161190+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:38:42.161190+0000","last_undegraded":"2024-03-08T20:38:42.161190+0000","last_fullsized":"2024-03-08T20:38:42.161190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2005","reported_seq":2035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.785945+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:38:42.785945+0000","last_peered":"2024-03-08T20:38:42.785945+0000","last_clean":"2024-03-08T20:38:42.785945+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:42.785945+0000","last_undegraded":"2024-03-08T20:38:42.785945+0000","last_fullsized":"2024-03-08T20:38:42.785945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2005,"log_dups_size":0,"ondisk_log_size":2005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.411242+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:38:43.411242+0000","last_peered":"2024-03-08T20:38:43.411242+0000","last_clean":"2024-03-08T20:38:43.411242+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:38:43.411242+0000","last_undegraded":"2024-03-08T20:38:43.411242+0000","last_fullsized":"2024-03-08T20:38:43.411242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1230","reported_seq":1258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.319124+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:38:44.319124+0000","last_peered":"2024-03-08T20:38:44.319124+0000","last_clean":"2024-03-08T20:38:44.319124+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:38:44.319124+0000","last_undegraded":"2024-03-08T20:38:44.319124+0000","last_fullsized":"2024-03-08T20:38:44.319124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'878","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489620+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:38:43.489620+0000","last_peered":"2024-03-08T20:38:43.489620+0000","last_clean":"2024-03-08T20:38:43.489620+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:43.489620+0000","last_undegraded":"2024-03-08T20:38:43.489620+0000","last_fullsized":"2024-03-08T20:38:43.489620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.798526+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:38:43.798526+0000","last_peered":"2024-03-08T20:38:43.798526+0000","last_clean":"2024-03-08T20:38:43.798526+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:38:43.798526+0000","last_undegraded":"2024-03-08T20:38:43.798526+0000","last_fullsized":"2024-03-08T20:38:43.798526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1293","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.986790+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:38:42.986790+0000","last_peered":"2024-03-08T20:38:42.986790+0000","last_clean":"2024-03-08T20:38:42.986790+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:38:42.986790+0000","last_undegraded":"2024-03-08T20:38:42.986790+0000","last_fullsized":"2024-03-08T20:38:42.986790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1408","reported_seq":1976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.857583+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:38:41.857583+0000","last_peered":"2024-03-08T20:38:41.857583+0000","last_clean":"2024-03-08T20:38:41.857583+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:41.857583+0000","last_undegraded":"2024-03-08T20:38:41.857583+0000","last_fullsized":"2024-03-08T20:38:41.857583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849604+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:38:43.849604+0000","last_peered":"2024-03-08T20:38:43.849604+0000","last_clean":"2024-03-08T20:38:43.849604+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:38:43.849604+0000","last_undegraded":"2024-03-08T20:38:43.849604+0000","last_fullsized":"2024-03-08T20:38:43.849604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1231","reported_seq":1259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.159968+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:38:43.159968+0000","last_peered":"2024-03-08T20:38:43.159968+0000","last_clean":"2024-03-08T20:38:43.159968+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:38:43.159968+0000","last_undegraded":"2024-03-08T20:38:43.159968+0000","last_fullsized":"2024-03-08T20:38:43.159968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'603","reported_seq":633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.085281+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:38:42.085281+0000","last_peered":"2024-03-08T20:38:42.085281+0000","last_clean":"2024-03-08T20:38:42.085281+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:38:42.085281+0000","last_undegraded":"2024-03-08T20:38:42.085281+0000","last_fullsized":"2024-03-08T20:38:42.085281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.671108+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:38:43.671108+0000","last_peered":"2024-03-08T20:38:43.671108+0000","last_clean":"2024-03-08T20:38:43.671108+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:38:43.671108+0000","last_undegraded":"2024-03-08T20:38:43.671108+0000","last_fullsized":"2024-03-08T20:38:43.671108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1306","reported_seq":1320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.368577+0000","last_change":"2024-03-08T20:30:10.640948+0000","last_active":"2024-03-08T20:38:43.368577+0000","last_peered":"2024-03-08T20:38:43.368577+0000","last_clean":"2024-03-08T20:38:43.368577+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:43.368577+0000","last_undegraded":"2024-03-08T20:38:43.368577+0000","last_fullsized":"2024-03-08T20:38:43.368577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:39.603548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'496","reported_seq":526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.543155+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:38:42.543155+0000","last_peered":"2024-03-08T20:38:42.543155+0000","last_clean":"2024-03-08T20:38:42.543155+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:42.543155+0000","last_undegraded":"2024-03-08T20:38:42.543155+0000","last_fullsized":"2024-03-08T20:38:42.543155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:35:22.321573+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:35:22.321573+0000","last_peered":"2024-03-08T20:35:22.321573+0000","last_clean":"2024-03-08T20:35:22.321573+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:35:22.321573+0000","last_undegraded":"2024-03-08T20:35:22.321573+0000","last_fullsized":"2024-03-08T20:35:22.321573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.117250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:38:44.117250+0000","last_peered":"2024-03-08T20:38:44.117250+0000","last_clean":"2024-03-08T20:38:44.117250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:38:44.117250+0000","last_undegraded":"2024-03-08T20:38:44.117250+0000","last_fullsized":"2024-03-08T20:38:44.117250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.341788+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:38:43.341788+0000","last_peered":"2024-03-08T20:38:43.341788+0000","last_clean":"2024-03-08T20:38:43.341788+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:38:43.341788+0000","last_undegraded":"2024-03-08T20:38:43.341788+0000","last_fullsized":"2024-03-08T20:38:43.341788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1395","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.749782+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:38:41.749782+0000","last_peered":"2024-03-08T20:38:41.749782+0000","last_clean":"2024-03-08T20:38:41.749782+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:41.749782+0000","last_undegraded":"2024-03-08T20:38:41.749782+0000","last_fullsized":"2024-03-08T20:38:41.749782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1649,"num_write_kb":30949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5294","reported_seq":5314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.139406+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:38:44.139406+0000","last_peered":"2024-03-08T20:38:44.139406+0000","last_clean":"2024-03-08T20:38:44.139406+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:38:44.139406+0000","last_undegraded":"2024-03-08T20:38:44.139406+0000","last_fullsized":"2024-03-08T20:38:44.139406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7633,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1281","reported_seq":1309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422930+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:38:43.422930+0000","last_peered":"2024-03-08T20:38:43.422930+0000","last_clean":"2024-03-08T20:38:43.422930+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:38:43.422930+0000","last_undegraded":"2024-03-08T20:38:43.422930+0000","last_fullsized":"2024-03-08T20:38:43.422930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1508","reported_seq":1538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.588098+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:38:42.588098+0000","last_peered":"2024-03-08T20:38:42.588098+0000","last_clean":"2024-03-08T20:38:42.588098+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:42.588098+0000","last_undegraded":"2024-03-08T20:38:42.588098+0000","last_fullsized":"2024-03-08T20:38:42.588098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.428601+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:38:43.428601+0000","last_peered":"2024-03-08T20:38:43.428601+0000","last_clean":"2024-03-08T20:38:43.428601+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:38:43.428601+0000","last_undegraded":"2024-03-08T20:38:43.428601+0000","last_fullsized":"2024-03-08T20:38:43.428601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1192","reported_seq":1220,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.845267+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:38:42.845267+0000","last_peered":"2024-03-08T20:38:42.845267+0000","last_clean":"2024-03-08T20:38:42.845267+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:38:42.845267+0000","last_undegraded":"2024-03-08T20:38:42.845267+0000","last_fullsized":"2024-03-08T20:38:42.845267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1072,"num_object_clones":0,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1370","reported_seq":1400,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.084592+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:38:42.084592+0000","last_peered":"2024-03-08T20:38:42.084592+0000","last_clean":"2024-03-08T20:38:42.084592+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:42.084592+0000","last_undegraded":"2024-03-08T20:38:42.084592+0000","last_fullsized":"2024-03-08T20:38:42.084592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.731509+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.731509+0000","last_peered":"2024-03-08T20:38:43.731509+0000","last_clean":"2024-03-08T20:38:43.731509+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:38:43.731509+0000","last_undegraded":"2024-03-08T20:38:43.731509+0000","last_fullsized":"2024-03-08T20:38:43.731509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1317","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.836024+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:38:43.836024+0000","last_peered":"2024-03-08T20:38:43.836024+0000","last_clean":"2024-03-08T20:38:43.836024+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:38:43.836024+0000","last_undegraded":"2024-03-08T20:38:43.836024+0000","last_fullsized":"2024-03-08T20:38:43.836024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'346","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.138038+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:38:44.138038+0000","last_peered":"2024-03-08T20:38:44.138038+0000","last_clean":"2024-03-08T20:38:44.138038+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:44.138038+0000","last_undegraded":"2024-03-08T20:38:44.138038+0000","last_fullsized":"2024-03-08T20:38:44.138038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.134901+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:38:44.134901+0000","last_peered":"2024-03-08T20:38:44.134901+0000","last_clean":"2024-03-08T20:38:44.134901+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:38:44.134901+0000","last_undegraded":"2024-03-08T20:38:44.134901+0000","last_fullsized":"2024-03-08T20:38:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7657,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1326","reported_seq":1353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422535+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:38:43.422535+0000","last_peered":"2024-03-08T20:38:43.422535+0000","last_clean":"2024-03-08T20:38:43.422535+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:38:43.422535+0000","last_undegraded":"2024-03-08T20:38:43.422535+0000","last_fullsized":"2024-03-08T20:38:43.422535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'491","reported_seq":520,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.868890+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:38:41.868890+0000","last_peered":"2024-03-08T20:38:41.868890+0000","last_clean":"2024-03-08T20:38:41.868890+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:41.868890+0000","last_undegraded":"2024-03-08T20:38:41.868890+0000","last_fullsized":"2024-03-08T20:38:41.868890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849964+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:38:43.849964+0000","last_peered":"2024-03-08T20:38:43.849964+0000","last_clean":"2024-03-08T20:38:43.849964+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:38:43.849964+0000","last_undegraded":"2024-03-08T20:38:43.849964+0000","last_fullsized":"2024-03-08T20:38:43.849964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1219","reported_seq":1244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.073298+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:38:44.073298+0000","last_peered":"2024-03-08T20:38:44.073298+0000","last_clean":"2024-03-08T20:38:44.073298+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:38:44.073298+0000","last_undegraded":"2024-03-08T20:38:44.073298+0000","last_fullsized":"2024-03-08T20:38:44.073298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'444","reported_seq":474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.337438+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:38:42.337438+0000","last_peered":"2024-03-08T20:38:42.337438+0000","last_clean":"2024-03-08T20:38:42.337438+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:38:42.337438+0000","last_undegraded":"2024-03-08T20:38:42.337438+0000","last_fullsized":"2024-03-08T20:38:42.337438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":710,"num_write_kb":9818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.582075+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:38:43.582075+0000","last_peered":"2024-03-08T20:38:43.582075+0000","last_clean":"2024-03-08T20:38:43.582075+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:38:43.582075+0000","last_undegraded":"2024-03-08T20:38:43.582075+0000","last_fullsized":"2024-03-08T20:38:43.582075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7651,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1283","reported_seq":1310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.590898+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:38:43.590898+0000","last_peered":"2024-03-08T20:38:43.590898+0000","last_clean":"2024-03-08T20:38:43.590898+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:38:43.590898+0000","last_undegraded":"2024-03-08T20:38:43.590898+0000","last_fullsized":"2024-03-08T20:38:43.590898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'774","reported_seq":803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.490411+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:38:43.490411+0000","last_peered":"2024-03-08T20:38:43.490411+0000","last_clean":"2024-03-08T20:38:43.490411+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:38:43.490411+0000","last_undegraded":"2024-03-08T20:38:43.490411+0000","last_fullsized":"2024-03-08T20:38:43.490411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.823900+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:38:43.823900+0000","last_peered":"2024-03-08T20:38:43.823900+0000","last_clean":"2024-03-08T20:38:43.823900+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:38:43.823900+0000","last_undegraded":"2024-03-08T20:38:43.823900+0000","last_fullsized":"2024-03-08T20:38:43.823900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1275","reported_seq":1302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.255300+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.255300+0000","last_peered":"2024-03-08T20:38:43.255300+0000","last_clean":"2024-03-08T20:38:43.255300+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:38:43.255300+0000","last_undegraded":"2024-03-08T20:38:43.255300+0000","last_fullsized":"2024-03-08T20:38:43.255300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'522","reported_seq":551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.253157+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:38:43.253157+0000","last_peered":"2024-03-08T20:38:43.253157+0000","last_clean":"2024-03-08T20:38:43.253157+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:43.253157+0000","last_undegraded":"2024-03-08T20:38:43.253157+0000","last_fullsized":"2024-03-08T20:38:43.253157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.247340+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:38:43.247340+0000","last_peered":"2024-03-08T20:38:43.247340+0000","last_clean":"2024-03-08T20:38:43.247340+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:38:43.247340+0000","last_undegraded":"2024-03-08T20:38:43.247340+0000","last_fullsized":"2024-03-08T20:38:43.247340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1234","reported_seq":1261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.436795+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:38:43.436795+0000","last_peered":"2024-03-08T20:38:43.436795+0000","last_clean":"2024-03-08T20:38:43.436795+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:38:43.436795+0000","last_undegraded":"2024-03-08T20:38:43.436795+0000","last_fullsized":"2024-03-08T20:38:43.436795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1234,"log_dups_size":0,"ondisk_log_size":1234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'648","reported_seq":677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.932498+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:38:43.932498+0000","last_peered":"2024-03-08T20:38:43.932498+0000","last_clean":"2024-03-08T20:38:43.932498+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:38:43.932498+0000","last_undegraded":"2024-03-08T20:38:43.932498+0000","last_fullsized":"2024-03-08T20:38:43.932498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":921,"num_write_kb":30369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743799+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:38:43.743799+0000","last_peered":"2024-03-08T20:38:43.743799+0000","last_clean":"2024-03-08T20:38:43.743799+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:38:43.743799+0000","last_undegraded":"2024-03-08T20:38:43.743799+0000","last_fullsized":"2024-03-08T20:38:43.743799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.298955+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:38:44.298955+0000","last_peered":"2024-03-08T20:38:44.298955+0000","last_clean":"2024-03-08T20:38:44.298955+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:38:44.298955+0000","last_undegraded":"2024-03-08T20:38:44.298955+0000","last_fullsized":"2024-03-08T20:38:44.298955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1149,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'629","reported_seq":658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.734087+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:38:41.734087+0000","last_peered":"2024-03-08T20:38:41.734087+0000","last_clean":"2024-03-08T20:38:41.734087+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:41.734087+0000","last_undegraded":"2024-03-08T20:38:41.734087+0000","last_fullsized":"2024-03-08T20:38:41.734087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5155","reported_seq":5177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229489+0000","last_change":"2024-03-08T20:30:10.640415+0000","last_active":"2024-03-08T20:38:44.229489+0000","last_peered":"2024-03-08T20:38:44.229489+0000","last_clean":"2024-03-08T20:38:44.229489+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:38:44.229489+0000","last_undegraded":"2024-03-08T20:38:44.229489+0000","last_fullsized":"2024-03-08T20:38:44.229489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:19:52.665266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7458,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1270","reported_seq":1297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.640679+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:38:43.640679+0000","last_peered":"2024-03-08T20:38:43.640679+0000","last_clean":"2024-03-08T20:38:43.640679+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:38:43.640679+0000","last_undegraded":"2024-03-08T20:38:43.640679+0000","last_fullsized":"2024-03-08T20:38:43.640679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'413","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.559163+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:38:42.559163+0000","last_peered":"2024-03-08T20:38:42.559163+0000","last_clean":"2024-03-08T20:38:42.559163+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:42.559163+0000","last_undegraded":"2024-03-08T20:38:42.559163+0000","last_fullsized":"2024-03-08T20:38:42.559163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5121","reported_seq":5126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743210+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:38:43.743210+0000","last_peered":"2024-03-08T20:38:43.743210+0000","last_clean":"2024-03-08T20:38:43.743210+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:38:43.743210+0000","last_undegraded":"2024-03-08T20:38:43.743210+0000","last_fullsized":"2024-03-08T20:38:43.743210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7428,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1272","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.046416+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:38:43.046416+0000","last_peered":"2024-03-08T20:38:43.046416+0000","last_clean":"2024-03-08T20:38:43.046416+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:38:43.046416+0000","last_undegraded":"2024-03-08T20:38:43.046416+0000","last_fullsized":"2024-03-08T20:38:43.046416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1239","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.771963+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:38:43.771963+0000","last_peered":"2024-03-08T20:38:43.771963+0000","last_clean":"2024-03-08T20:38:43.771963+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:43.771963+0000","last_undegraded":"2024-03-08T20:38:43.771963+0000","last_fullsized":"2024-03-08T20:38:43.771963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1466,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5433","reported_seq":5437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.782104+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:38:43.782104+0000","last_peered":"2024-03-08T20:38:43.782104+0000","last_clean":"2024-03-08T20:38:43.782104+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:43.782104+0000","last_undegraded":"2024-03-08T20:38:43.782104+0000","last_fullsized":"2024-03-08T20:38:43.782104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5433,"log_dups_size":0,"ondisk_log_size":5433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7909,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665938+0000","last_change":"2024-03-08T20:30:10.908474+0000","last_active":"2024-03-08T20:38:43.665938+0000","last_peered":"2024-03-08T20:38:43.665938+0000","last_clean":"2024-03-08T20:38:43.665938+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:43.665938+0000","last_undegraded":"2024-03-08T20:38:43.665938+0000","last_fullsized":"2024-03-08T20:38:43.665938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:43.649481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1289","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.016702+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:38:43.016702+0000","last_peered":"2024-03-08T20:38:43.016702+0000","last_clean":"2024-03-08T20:38:43.016702+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:43.016702+0000","last_undegraded":"2024-03-08T20:38:43.016702+0000","last_fullsized":"2024-03-08T20:38:43.016702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'505","reported_seq":534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.913975+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:38:42.913975+0000","last_peered":"2024-03-08T20:38:42.913975+0000","last_clean":"2024-03-08T20:38:42.913975+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:38:42.913975+0000","last_undegraded":"2024-03-08T20:38:42.913975+0000","last_fullsized":"2024-03-08T20:38:42.913975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.053077+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:38:44.053077+0000","last_peered":"2024-03-08T20:38:44.053077+0000","last_clean":"2024-03-08T20:38:44.053077+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:38:44.053077+0000","last_undegraded":"2024-03-08T20:38:44.053077+0000","last_fullsized":"2024-03-08T20:38:44.053077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1296","reported_seq":1323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.801386+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:38:43.801386+0000","last_peered":"2024-03-08T20:38:43.801386+0000","last_clean":"2024-03-08T20:38:43.801386+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:38:43.801386+0000","last_undegraded":"2024-03-08T20:38:43.801386+0000","last_fullsized":"2024-03-08T20:38:43.801386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1164,"num_object_clones":0,"num_object_copies":2328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'385","reported_seq":414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.802950+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:38:42.802950+0000","last_peered":"2024-03-08T20:38:42.802950+0000","last_clean":"2024-03-08T20:38:42.802950+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:38:42.802950+0000","last_undegraded":"2024-03-08T20:38:42.802950+0000","last_fullsized":"2024-03-08T20:38:42.802950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9009041,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":650,"num_write_kb":14388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'542","reported_seq":571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152160+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:38:44.152160+0000","last_peered":"2024-03-08T20:38:44.152160+0000","last_clean":"2024-03-08T20:38:44.152160+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:38:44.152160+0000","last_undegraded":"2024-03-08T20:38:44.152160+0000","last_fullsized":"2024-03-08T20:38:44.152160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":804,"num_write_kb":34561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1252","reported_seq":1279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.301368+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:38:43.301368+0000","last_peered":"2024-03-08T20:38:43.301368+0000","last_clean":"2024-03-08T20:38:43.301368+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:38:43.301368+0000","last_undegraded":"2024-03-08T20:38:43.301368+0000","last_fullsized":"2024-03-08T20:38:43.301368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5220","reported_seq":5241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.558185+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:38:42.558185+0000","last_peered":"2024-03-08T20:38:42.558185+0000","last_clean":"2024-03-08T20:38:42.558185+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:38:42.558185+0000","last_undegraded":"2024-03-08T20:38:42.558185+0000","last_fullsized":"2024-03-08T20:38:42.558185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5220,"log_dups_size":0,"ondisk_log_size":5220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7552,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'410","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.897852+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:38:42.897852+0000","last_peered":"2024-03-08T20:38:42.897852+0000","last_clean":"2024-03-08T20:38:42.897852+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:38:42.897852+0000","last_undegraded":"2024-03-08T20:38:42.897852+0000","last_fullsized":"2024-03-08T20:38:42.897852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1278","reported_seq":1305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.276570+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:38:44.276570+0000","last_peered":"2024-03-08T20:38:44.276570+0000","last_clean":"2024-03-08T20:38:44.276570+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:38:44.276570+0000","last_undegraded":"2024-03-08T20:38:44.276570+0000","last_fullsized":"2024-03-08T20:38:44.276570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1159,"num_object_clones":0,"num_object_copies":2318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5217","reported_seq":5202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.795426+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:38:43.795426+0000","last_peered":"2024-03-08T20:38:43.795426+0000","last_clean":"2024-03-08T20:38:43.795426+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:38:43.795426+0000","last_undegraded":"2024-03-08T20:38:43.795426+0000","last_fullsized":"2024-03-08T20:38:43.795426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5217,"log_dups_size":0,"ondisk_log_size":5217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7565,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1249","reported_seq":1277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.427034+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:38:43.427034+0000","last_peered":"2024-03-08T20:38:43.427034+0000","last_clean":"2024-03-08T20:38:43.427034+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:38:43.427034+0000","last_undegraded":"2024-03-08T20:38:43.427034+0000","last_fullsized":"2024-03-08T20:38:43.427034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1342","reported_seq":1370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.140197+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:38:42.140197+0000","last_peered":"2024-03-08T20:38:42.140197+0000","last_clean":"2024-03-08T20:38:42.140197+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:38:42.140197+0000","last_undegraded":"2024-03-08T20:38:42.140197+0000","last_fullsized":"2024-03-08T20:38:42.140197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1258","reported_seq":1286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.669285+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:38:43.669285+0000","last_peered":"2024-03-08T20:38:43.669285+0000","last_clean":"2024-03-08T20:38:43.669285+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:38:43.669285+0000","last_undegraded":"2024-03-08T20:38:43.669285+0000","last_fullsized":"2024-03-08T20:38:43.669285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.305648+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:38:43.305648+0000","last_peered":"2024-03-08T20:38:43.305648+0000","last_clean":"2024-03-08T20:38:43.305648+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:38:43.305648+0000","last_undegraded":"2024-03-08T20:38:43.305648+0000","last_fullsized":"2024-03-08T20:38:43.305648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1268","reported_seq":1291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.788615+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:38:43.788615+0000","last_peered":"2024-03-08T20:38:43.788615+0000","last_clean":"2024-03-08T20:38:43.788615+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:43.788615+0000","last_undegraded":"2024-03-08T20:38:43.788615+0000","last_fullsized":"2024-03-08T20:38:43.788615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1266","reported_seq":1294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.066004+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:38:43.066004+0000","last_peered":"2024-03-08T20:38:43.066004+0000","last_clean":"2024-03-08T20:38:43.066004+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:38:43.066004+0000","last_undegraded":"2024-03-08T20:38:43.066004+0000","last_fullsized":"2024-03-08T20:38:43.066004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1345","reported_seq":1373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.026042+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:38:44.026042+0000","last_peered":"2024-03-08T20:38:44.026042+0000","last_clean":"2024-03-08T20:38:44.026042+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:38:44.026042+0000","last_undegraded":"2024-03-08T20:38:44.026042+0000","last_fullsized":"2024-03-08T20:38:44.026042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1288","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.455137+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:38:43.455137+0000","last_peered":"2024-03-08T20:38:43.455137+0000","last_clean":"2024-03-08T20:38:43.455137+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:38:43.455137+0000","last_undegraded":"2024-03-08T20:38:43.455137+0000","last_fullsized":"2024-03-08T20:38:43.455137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1288,"log_dups_size":0,"ondisk_log_size":1288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1271","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.272774+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:38:43.272774+0000","last_peered":"2024-03-08T20:38:43.272774+0000","last_clean":"2024-03-08T20:38:43.272774+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:38:43.272774+0000","last_undegraded":"2024-03-08T20:38:43.272774+0000","last_fullsized":"2024-03-08T20:38:43.272774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1268","reported_seq":1295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.636127+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:38:43.636127+0000","last_peered":"2024-03-08T20:38:43.636127+0000","last_clean":"2024-03-08T20:38:43.636127+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:38:43.636127+0000","last_undegraded":"2024-03-08T20:38:43.636127+0000","last_fullsized":"2024-03-08T20:38:43.636127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1132,"num_object_clones":0,"num_object_copies":2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.692530+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:38:43.692530+0000","last_peered":"2024-03-08T20:38:43.692530+0000","last_clean":"2024-03-08T20:38:43.692530+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:38:43.692530+0000","last_undegraded":"2024-03-08T20:38:43.692530+0000","last_fullsized":"2024-03-08T20:38:43.692530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1320","reported_seq":1348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665589+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.665589+0000","last_peered":"2024-03-08T20:38:43.665589+0000","last_clean":"2024-03-08T20:38:43.665589+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:38:43.665589+0000","last_undegraded":"2024-03-08T20:38:43.665589+0000","last_fullsized":"2024-03-08T20:38:43.665589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1298","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.142042+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:38:44.142042+0000","last_peered":"2024-03-08T20:38:44.142042+0000","last_clean":"2024-03-08T20:38:44.142042+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:38:44.142042+0000","last_undegraded":"2024-03-08T20:38:44.142042+0000","last_fullsized":"2024-03-08T20:38:44.142042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1298,"log_dups_size":0,"ondisk_log_size":1298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1310","reported_seq":1338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.437003+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:38:43.437003+0000","last_peered":"2024-03-08T20:38:43.437003+0000","last_clean":"2024-03-08T20:38:43.437003+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:38:43.437003+0000","last_undegraded":"2024-03-08T20:38:43.437003+0000","last_fullsized":"2024-03-08T20:38:43.437003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.279682+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:38:42.279682+0000","last_peered":"2024-03-08T20:38:42.279682+0000","last_clean":"2024-03-08T20:38:42.279682+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:38:42.279682+0000","last_undegraded":"2024-03-08T20:38:42.279682+0000","last_fullsized":"2024-03-08T20:38:42.279682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1324","reported_seq":1337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.215350+0000","last_change":"2024-03-08T20:30:10.906961+0000","last_active":"2024-03-08T20:38:42.215350+0000","last_peered":"2024-03-08T20:38:42.215350+0000","last_clean":"2024-03-08T20:38:42.215350+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:38:42.215350+0000","last_undegraded":"2024-03-08T20:38:42.215350+0000","last_fullsized":"2024-03-08T20:38:42.215350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1324,"log_dups_size":0,"ondisk_log_size":1324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'1255","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.944808+0000","last_change":"2024-03-08T20:30:10.632389+0000","last_active":"2024-03-08T20:38:41.944808+0000","last_peered":"2024-03-08T20:38:41.944808+0000","last_clean":"2024-03-08T20:38:41.944808+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:38:41.944808+0000","last_undegraded":"2024-03-08T20:38:41.944808+0000","last_fullsized":"2024-03-08T20:38:41.944808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.956611+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:38:42.956611+0000","last_peered":"2024-03-08T20:38:42.956611+0000","last_clean":"2024-03-08T20:38:42.956611+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:38:42.956611+0000","last_undegraded":"2024-03-08T20:38:42.956611+0000","last_fullsized":"2024-03-08T20:38:42.956611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1245","reported_seq":1272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.101433+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:38:43.101433+0000","last_peered":"2024-03-08T20:38:43.101433+0000","last_clean":"2024-03-08T20:38:43.101433+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:38:43.101433+0000","last_undegraded":"2024-03-08T20:38:43.101433+0000","last_fullsized":"2024-03-08T20:38:43.101433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1245,"log_dups_size":0,"ondisk_log_size":1245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1258","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.754953+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:38:43.754953+0000","last_peered":"2024-03-08T20:38:43.754953+0000","last_clean":"2024-03-08T20:38:43.754953+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:43.754953+0000","last_undegraded":"2024-03-08T20:38:43.754953+0000","last_fullsized":"2024-03-08T20:38:43.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1208","reported_seq":1224,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.936295+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:38:43.936295+0000","last_peered":"2024-03-08T20:38:43.936295+0000","last_clean":"2024-03-08T20:38:43.936295+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:38:43.936295+0000","last_undegraded":"2024-03-08T20:38:43.936295+0000","last_fullsized":"2024-03-08T20:38:43.936295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1096,"num_object_clones":0,"num_object_copies":2192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1266","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.933894+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:38:43.933894+0000","last_peered":"2024-03-08T20:38:43.933894+0000","last_clean":"2024-03-08T20:38:43.933894+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:38:43.933894+0000","last_undegraded":"2024-03-08T20:38:43.933894+0000","last_fullsized":"2024-03-08T20:38:43.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1285","reported_seq":1312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.047031+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:38:44.047031+0000","last_peered":"2024-03-08T20:38:44.047031+0000","last_clean":"2024-03-08T20:38:44.047031+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:38:44.047031+0000","last_undegraded":"2024-03-08T20:38:44.047031+0000","last_fullsized":"2024-03-08T20:38:44.047031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1281","reported_seq":1308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:38.718954+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:38:38.718954+0000","last_peered":"2024-03-08T20:38:38.718954+0000","last_clean":"2024-03-08T20:38:38.718954+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:38:38.718954+0000","last_undegraded":"2024-03-08T20:38:38.718954+0000","last_fullsized":"2024-03-08T20:38:38.718954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1259","reported_seq":1284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.827083+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:38:43.827083+0000","last_peered":"2024-03-08T20:38:43.827083+0000","last_clean":"2024-03-08T20:38:43.827083+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:38:43.827083+0000","last_undegraded":"2024-03-08T20:38:43.827083+0000","last_fullsized":"2024-03-08T20:38:43.827083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1259,"log_dups_size":0,"ondisk_log_size":1259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1131,"num_object_clones":0,"num_object_copies":2262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1240","reported_seq":1267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.418827+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:38:43.418827+0000","last_peered":"2024-03-08T20:38:43.418827+0000","last_clean":"2024-03-08T20:38:43.418827+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:38:43.418827+0000","last_undegraded":"2024-03-08T20:38:43.418827+0000","last_fullsized":"2024-03-08T20:38:43.418827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1221","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.574530+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:38:43.574530+0000","last_peered":"2024-03-08T20:38:43.574530+0000","last_clean":"2024-03-08T20:38:43.574530+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:38:43.574530+0000","last_undegraded":"2024-03-08T20:38:43.574530+0000","last_fullsized":"2024-03-08T20:38:43.574530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1323","reported_seq":1350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.971308+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:38:42.971308+0000","last_peered":"2024-03-08T20:38:42.971308+0000","last_clean":"2024-03-08T20:38:42.971308+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:38:42.971308+0000","last_undegraded":"2024-03-08T20:38:42.971308+0000","last_fullsized":"2024-03-08T20:38:42.971308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1270","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.424239+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:38:43.424239+0000","last_peered":"2024-03-08T20:38:43.424239+0000","last_clean":"2024-03-08T20:38:43.424239+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:38:43.424239+0000","last_undegraded":"2024-03-08T20:38:43.424239+0000","last_fullsized":"2024-03-08T20:38:43.424239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1303","reported_seq":1331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.990298+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:38:42.990298+0000","last_peered":"2024-03-08T20:38:42.990298+0000","last_clean":"2024-03-08T20:38:42.990298+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:42.990298+0000","last_undegraded":"2024-03-08T20:38:42.990298+0000","last_fullsized":"2024-03-08T20:38:42.990298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1204","reported_seq":1232,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.892932+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:38:42.892932+0000","last_peered":"2024-03-08T20:38:42.892932+0000","last_clean":"2024-03-08T20:38:42.892932+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:42.892932+0000","last_undegraded":"2024-03-08T20:38:42.892932+0000","last_fullsized":"2024-03-08T20:38:42.892932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1178","reported_seq":1206,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.655861+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:38:42.655861+0000","last_peered":"2024-03-08T20:38:42.655861+0000","last_clean":"2024-03-08T20:38:42.655861+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:38:42.655861+0000","last_undegraded":"2024-03-08T20:38:42.655861+0000","last_fullsized":"2024-03-08T20:38:42.655861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1070,"num_object_clones":0,"num_object_copies":2140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":242584,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167070,"ondisk_log_size":167070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73190,"num_object_clones":0,"num_object_copies":146380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77594,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81615,"ondisk_log_size":81615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":185758531,"num_objects":4499,"num_object_clones":0,"num_object_copies":8998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33031,"num_write_kb":742459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130699264,"data_stored":375816734,"data_compressed":52167254,"data_compressed_allocated":64143360,"data_compressed_original":309325824,"omap_allocated":0,"internal_metadata":0},"log_size":23530,"ondisk_log_size":23530,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582308,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93789532,"statfs":{"total":96636764160,"available":96040480768,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,13,37,35,48,28,170],"upper_bound":4096},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":707700,"kb_used_data":401708,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93664140,"statfs":{"total":96636764160,"available":95912079360,"internally_reserved":0,"allocated":411348992,"data_stored":564529961,"data_compressed":75981661,"data_compressed_allocated":89468928,"data_compressed_original":242831360,"omap_allocated":1594,"internal_metadata":313326022},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,10,18,31,36,47,203],"upper_bound":2048},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527844,"kb_used_data":253724,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93843996,"statfs":{"total":96636764160,"available":96096251904,"internally_reserved":0,"allocated":259813376,"data_stored":432525650,"data_compressed":68150985,"data_compressed_allocated":85839872,"data_compressed_original":258727936,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,0,23,0,19,23,10,191,31],"upper_bound":2048},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":619676,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93752164,"statfs":{"total":96636764160,"available":96002215936,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,5,32,55,90,69,30,27,70,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":823816,"kb_used_data":423360,"kb_used_omap":1,"kb_used_meta":400446,"kb_avail":93548024,"statfs":{"total":96636764160,"available":95793176576,"internally_reserved":0,"allocated":433520640,"data_stored":670953757,"data_compressed":105789092,"data_compressed_allocated":133480448,"data_compressed_original":371097600,"omap_allocated":1593,"internal_metadata":410057159},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,16,11,48,31,45,63,65,65],"upper_bound":4096},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569484,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93802356,"statfs":{"total":96636764160,"available":96053612544,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":888068,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":436478,"kb_avail":93483772,"statfs":{"total":96636764160,"available":95727382528,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":446953925},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600120,"kb_used_data":308016,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93771720,"statfs":{"total":96636764160,"available":96022241280,"internally_reserved":0,"allocated":315408384,"data_stored":435467670,"data_compressed":64254155,"data_compressed_allocated":77156352,"data_compressed_original":197402624,"omap_allocated":1594,"internal_metadata":299104710},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,0,2,5,14,0,0,18,65],"upper_bound":2048},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":25166462,"data_compressed":2865800,"data_compressed_allocated":3715072,"data_compressed_original":16809984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20426752,"data_stored":51610257,"data_compressed":6731091,"data_compressed_allocated":8540160,"data_compressed_original":39735296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":50987869,"data_compressed":7594478,"data_compressed_allocated":9105408,"data_compressed_original":46370816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:38:49.160 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T20:38:49.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:38:49.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.403+0000 7f32fb200640 1 Processor -- start 2024-03-08T20:38:49.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.403+0000 7f32fb200640 1 -- start start 2024-03-08T20:38:49.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.404+0000 7f32fb200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32f406af80 0x7f32f406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.404+0000 7f32fb200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40aa980 con 0x7f32f406ebd0 2024-03-08T20:38:49.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.404+0000 7f32fb200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40aac60 con 0x7f32f41505e0 2024-03-08T20:38:49.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.404+0000 7f32fb200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f40aaf40 con 0x7f32f406af80 2024-03-08T20:38:49.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32f3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f32f406af80 0x7f32f406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32eb400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f32f406ebd0 0x7f32f414fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:32842/0 (socket says 172.21.15.118:32842) 2024-03-08T20:38:49.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32eb400640 1 -- 172.21.15.118:0/3823524344 learned_addr learned my addr 172.21.15.118:0/3823524344 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32f3e00640 1 -- 172.21.15.118:0/3823524344 >> v1:172.21.15.144:6789/0 conn(0x7f32f41505e0 legacy=0x7f32f4152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32f3e00640 1 -- 172.21.15.118:0/3823524344 >> v1:172.21.15.118:6789/0 conn(0x7f32f406ebd0 legacy=0x7f32f414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.405+0000 7f32f3e00640 1 -- 172.21.15.118:0/3823524344 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40ab220 con 0x7f32f406af80 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.406+0000 7f32f3e00640 1 --2- 172.21.15.118:0/3823524344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406af80 0x7f32f406e690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11edba0554e8ea22 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32f3400640 1 -- 172.21.15.118:0/3823524344 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40315a0 con 0x7f32f406af80 2024-03-08T20:38:49.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32f3400640 1 -- 172.21.15.118:0/3823524344 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e4037070 con 0x7f32f406af80 2024-03-08T20:38:49.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32f3400640 1 -- 172.21.15.118:0/3823524344 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4031960 con 0x7f32f406af80 2024-03-08T20:38:49.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 -- 172.21.15.118:0/3823524344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406af80 msgr2=0x7f32f406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 --2- 172.21.15.118:0/3823524344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406af80 0x7f32f406e690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b840 comp rx=0 tx=0).stop 2024-03-08T20:38:49.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 -- 172.21.15.118:0/3823524344 shutdown_connections 2024-03-08T20:38:49.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 --2- 172.21.15.118:0/3823524344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406af80 0x7f32f406e690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 -- 172.21.15.118:0/3823524344 >> 172.21.15.118:0/3823524344 conn(0x7f32f40a84c0 msgr2=0x7f32f40a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:49.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 -- 172.21.15.118:0/3823524344 shutdown_connections 2024-03-08T20:38:49.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.407+0000 7f32fb200640 1 -- 172.21.15.118:0/3823524344 wait complete. 2024-03-08T20:38:49.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.409+0000 7f32fb200640 1 Processor -- start 2024-03-08T20:38:49.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.409+0000 7f32fb200640 1 -- start start 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f406af80 0x7f32f40bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 0x7f32f41eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f406b4e0 con 0x7f32f406ebd0 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f406b360 con 0x7f32f41505e0 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32fb200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4153520 con 0x7f32f406af80 2024-03-08T20:38:49.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32eb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32eb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:56258/0 (socket says 172.21.15.118:56258) 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.410+0000 7f32eb400640 1 -- 172.21.15.118:0/1721013141 learned_addr learned my addr 172.21.15.118:0/1721013141 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f3e00640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f406af80 0x7f32f40bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f9200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 0x7f32f41eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 -- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f406af80 msgr2=0x7f32f40bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f406af80 0x7f32f40bfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 -- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 msgr2=0x7f32f41eaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 0x7f32f41eaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 -- 172.21.15.118:0/1721013141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40c0ad0 con 0x7f32f406ebd0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f9200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 0x7f32f41eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32eb400640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c400 tx=0x7f32dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x7f32f406ebd0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc005ce0 con 0x7f32f406ebd0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0072f0 con 0x7f32f406ebd0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f4070fb0 con 0x7f32f406ebd0 2024-03-08T20:38:49.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.411+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f4071550 con 0x7f32f406ebd0 2024-03-08T20:38:49.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.413+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4153340 con 0x7f32f406ebd0 2024-03-08T20:38:49.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.413+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f32dc01a070 con 0x7f32f406ebd0 2024-03-08T20:38:49.414 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.415+0000 7f32f0c00640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 0x7f32d006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.415+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f32dc08a310 con 0x7f32f406ebd0 2024-03-08T20:38:49.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.415+0000 7f32f3e00640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 0x7f32d006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.416+0000 7f32f3e00640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 0x7f32d006e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32e4036000 tx=0x7f32e403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.419 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.420+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f32f4153340 con 0x7f32f406ebd0 2024-03-08T20:38:49.611 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.611+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32f4074a40 con 0x7f32d006bbd0 2024-03-08T20:38:49.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.636+0000 7f32f0c00640 1 -- 172.21.15.118:0/1721013141 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+337587 (secure 0 0 0) 0x7f32f4074a40 con 0x7f32d006bbd0 2024-03-08T20:38:49.641 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:49.643 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:38:49.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.644+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 msgr2=0x7f32d006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.644+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 0x7f32d006e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32e4036000 tx=0x7f32e403d040 comp rx=0 tx=0).stop 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.644+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 msgr2=0x7f32f4072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.644+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c400 tx=0x7f32dc00c8c0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 shutdown_connections 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f32d006bbd0 0x7f32d006e090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f41505e0 0x7f32f41eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f32f406ebd0 0x7f32f4072950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 --2- 172.21.15.118:0/1721013141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f406af80 0x7f32f40bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 >> 172.21.15.118:0/1721013141 conn(0x7f32f40a84c0 msgr2=0x7f32f40c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:49.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 shutdown_connections 2024-03-08T20:38:49.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.645+0000 7f32fb200640 1 -- 172.21.15.118:0/1721013141 wait complete. 2024-03-08T20:38:49.664 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-03-08T20:38:47.721925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1675067347,"num_objects":158923,"num_object_clones":0,"num_object_copies":480310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158923,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":353368,"num_write_kb":2319575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272332,"ondisk_log_size":272332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5319016,"kb_used_data":2799976,"kb_used_omap":12,"kb_used_meta":2518963,"kb_avail":749655704,"statfs":{"total":773094113280,"available":767647440896,"internally_reserved":0,"allocated":2867175424,"data_stored":4217762438,"data_compressed":624579107,"data_compressed_allocated":765898752,"data_compressed_original":2117931008,"omap_allocated":12751,"internal_metadata":2579418673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[8,1,4,1,47,59,167,212,195,397,419,305,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":254,"apply_latency_ms":254,"commit_latency_ns":254000000,"apply_latency_ns":254000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5552270,"num_objects":2500,"num_object_clones":0,"num_object_copies":5002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7476,"num_write_kb":19613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":193,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005593"},"pg_stats":[{"pgid":"2.1f","version":"27'261","reported_seq":291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.196852+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:38:42.196852+0000","last_peered":"2024-03-08T20:38:42.196852+0000","last_clean":"2024-03-08T20:38:42.196852+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:42.196852+0000","last_undegraded":"2024-03-08T20:38:42.196852+0000","last_fullsized":"2024-03-08T20:38:42.196852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1257","reported_seq":1285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.329247+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:38:43.329247+0000","last_peered":"2024-03-08T20:38:43.329247+0000","last_clean":"2024-03-08T20:38:43.329247+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:38:43.329247+0000","last_undegraded":"2024-03-08T20:38:43.329247+0000","last_fullsized":"2024-03-08T20:38:43.329247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1257,"log_dups_size":0,"ondisk_log_size":1257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.820874+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:38:43.820874+0000","last_peered":"2024-03-08T20:38:43.820874+0000","last_clean":"2024-03-08T20:38:43.820874+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:38:43.820874+0000","last_undegraded":"2024-03-08T20:38:43.820874+0000","last_fullsized":"2024-03-08T20:38:43.820874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'561","reported_seq":591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.856665+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:38:42.856665+0000","last_peered":"2024-03-08T20:38:42.856665+0000","last_clean":"2024-03-08T20:38:42.856665+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:38:42.856665+0000","last_undegraded":"2024-03-08T20:38:42.856665+0000","last_fullsized":"2024-03-08T20:38:42.856665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'1255","reported_seq":1283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.630169+0000","last_change":"2024-03-08T20:29:24.254273+0000","last_active":"2024-03-08T20:38:43.630169+0000","last_peered":"2024-03-08T20:38:43.630169+0000","last_clean":"2024-03-08T20:38:43.630169+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:43.630169+0000","last_undegraded":"2024-03-08T20:38:43.630169+0000","last_fullsized":"2024-03-08T20:38:43.630169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5185","reported_seq":5200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.227513+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:38:44.227513+0000","last_peered":"2024-03-08T20:38:44.227513+0000","last_clean":"2024-03-08T20:38:44.227513+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:38:44.227513+0000","last_undegraded":"2024-03-08T20:38:44.227513+0000","last_fullsized":"2024-03-08T20:38:44.227513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5185,"log_dups_size":0,"ondisk_log_size":5185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7531,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.451423+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:38:43.451423+0000","last_peered":"2024-03-08T20:38:43.451423+0000","last_clean":"2024-03-08T20:38:43.451423+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:38:43.451423+0000","last_undegraded":"2024-03-08T20:38:43.451423+0000","last_fullsized":"2024-03-08T20:38:43.451423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1292","reported_seq":1319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.058874+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:38:43.058874+0000","last_peered":"2024-03-08T20:38:43.058874+0000","last_clean":"2024-03-08T20:38:43.058874+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:38:43.058874+0000","last_undegraded":"2024-03-08T20:38:43.058874+0000","last_fullsized":"2024-03-08T20:38:43.058874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5224","reported_seq":5240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229638+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:38:44.229638+0000","last_peered":"2024-03-08T20:38:44.229638+0000","last_clean":"2024-03-08T20:38:44.229638+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:38:44.229638+0000","last_undegraded":"2024-03-08T20:38:44.229638+0000","last_fullsized":"2024-03-08T20:38:44.229638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7563,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'311","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.761608+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:38:41.761608+0000","last_peered":"2024-03-08T20:38:41.761608+0000","last_clean":"2024-03-08T20:38:41.761608+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:38:41.761608+0000","last_undegraded":"2024-03-08T20:38:41.761608+0000","last_fullsized":"2024-03-08T20:38:41.761608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1260","reported_seq":1287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489526+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:38:43.489526+0000","last_peered":"2024-03-08T20:38:43.489526+0000","last_clean":"2024-03-08T20:38:43.489526+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:38:43.489526+0000","last_undegraded":"2024-03-08T20:38:43.489526+0000","last_fullsized":"2024-03-08T20:38:43.489526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5128","reported_seq":5147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.237389+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:38:44.237389+0000","last_peered":"2024-03-08T20:38:44.237389+0000","last_clean":"2024-03-08T20:38:44.237389+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:38:44.237389+0000","last_undegraded":"2024-03-08T20:38:44.237389+0000","last_fullsized":"2024-03-08T20:38:44.237389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5128,"log_dups_size":0,"ondisk_log_size":5128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7468,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1274","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152552+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:38:44.152552+0000","last_peered":"2024-03-08T20:38:44.152552+0000","last_clean":"2024-03-08T20:38:44.152552+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:38:44.152552+0000","last_undegraded":"2024-03-08T20:38:44.152552+0000","last_fullsized":"2024-03-08T20:38:44.152552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1127,"num_object_clones":0,"num_object_copies":2254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1127,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'403","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.607882+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:38:43.607882+0000","last_peered":"2024-03-08T20:38:43.607882+0000","last_clean":"2024-03-08T20:38:43.607882+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:38:43.607882+0000","last_undegraded":"2024-03-08T20:38:43.607882+0000","last_fullsized":"2024-03-08T20:38:43.607882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.877774+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:38:41.877774+0000","last_peered":"2024-03-08T20:38:41.877774+0000","last_clean":"2024-03-08T20:38:41.877774+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:38:41.877774+0000","last_undegraded":"2024-03-08T20:38:41.877774+0000","last_fullsized":"2024-03-08T20:38:41.877774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7560,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1326","reported_seq":1354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.757829+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:38:43.757829+0000","last_peered":"2024-03-08T20:38:43.757829+0000","last_clean":"2024-03-08T20:38:43.757829+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:38:43.757829+0000","last_undegraded":"2024-03-08T20:38:43.757829+0000","last_fullsized":"2024-03-08T20:38:43.757829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1510","reported_seq":1540,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.049211+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:38:42.049211+0000","last_peered":"2024-03-08T20:38:42.049211+0000","last_clean":"2024-03-08T20:38:42.049211+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:38:42.049211+0000","last_undegraded":"2024-03-08T20:38:42.049211+0000","last_fullsized":"2024-03-08T20:38:42.049211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5253","reported_seq":5262,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.212333+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:38:44.212333+0000","last_peered":"2024-03-08T20:38:44.212333+0000","last_clean":"2024-03-08T20:38:44.212333+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:38:44.212333+0000","last_undegraded":"2024-03-08T20:38:44.212333+0000","last_fullsized":"2024-03-08T20:38:44.212333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5253,"log_dups_size":0,"ondisk_log_size":5253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7647,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.680909+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:38:43.680909+0000","last_peered":"2024-03-08T20:38:43.680909+0000","last_clean":"2024-03-08T20:38:43.680909+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:38:43.680909+0000","last_undegraded":"2024-03-08T20:38:43.680909+0000","last_fullsized":"2024-03-08T20:38:43.680909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1180,"num_object_clones":0,"num_object_copies":2360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.788109+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:38:41.788109+0000","last_peered":"2024-03-08T20:38:41.788109+0000","last_clean":"2024-03-08T20:38:41.788109+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:38:41.788109+0000","last_undegraded":"2024-03-08T20:38:41.788109+0000","last_fullsized":"2024-03-08T20:38:41.788109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.991706+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:38:43.991706+0000","last_peered":"2024-03-08T20:38:43.991706+0000","last_clean":"2024-03-08T20:38:43.991706+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:38:43.991706+0000","last_undegraded":"2024-03-08T20:38:43.991706+0000","last_fullsized":"2024-03-08T20:38:43.991706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.270605+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:38:44.270605+0000","last_peered":"2024-03-08T20:38:44.270605+0000","last_clean":"2024-03-08T20:38:44.270605+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:44.270605+0000","last_undegraded":"2024-03-08T20:38:44.270605+0000","last_fullsized":"2024-03-08T20:38:44.270605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'966","reported_seq":996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.817632+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:38:41.817632+0000","last_peered":"2024-03-08T20:38:41.817632+0000","last_clean":"2024-03-08T20:38:41.817632+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:38:41.817632+0000","last_undegraded":"2024-03-08T20:38:41.817632+0000","last_fullsized":"2024-03-08T20:38:41.817632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5268","reported_seq":5289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.323598+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:38:44.323598+0000","last_peered":"2024-03-08T20:38:44.323598+0000","last_clean":"2024-03-08T20:38:44.323598+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:38:44.323598+0000","last_undegraded":"2024-03-08T20:38:44.323598+0000","last_fullsized":"2024-03-08T20:38:44.323598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7657,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.375044+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:38:43.375044+0000","last_peered":"2024-03-08T20:38:43.375044+0000","last_clean":"2024-03-08T20:38:43.375044+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:38:43.375044+0000","last_undegraded":"2024-03-08T20:38:43.375044+0000","last_fullsized":"2024-03-08T20:38:43.375044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'313","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.028871+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:38:44.028871+0000","last_peered":"2024-03-08T20:38:44.028871+0000","last_clean":"2024-03-08T20:38:44.028871+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:38:44.028871+0000","last_undegraded":"2024-03-08T20:38:44.028871+0000","last_fullsized":"2024-03-08T20:38:44.028871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5191","reported_seq":5205,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.106192+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:38:44.106192+0000","last_peered":"2024-03-08T20:38:44.106192+0000","last_clean":"2024-03-08T20:38:44.106192+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:38:44.106192+0000","last_undegraded":"2024-03-08T20:38:44.106192+0000","last_fullsized":"2024-03-08T20:38:44.106192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5191,"log_dups_size":0,"ondisk_log_size":5191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7529,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1253","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.708868+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:38:43.708868+0000","last_peered":"2024-03-08T20:38:43.708868+0000","last_clean":"2024-03-08T20:38:43.708868+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:38:43.708868+0000","last_undegraded":"2024-03-08T20:38:43.708868+0000","last_fullsized":"2024-03-08T20:38:43.708868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1093,"num_object_clones":0,"num_object_copies":2186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1093,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'789","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.688930+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:38:42.688930+0000","last_peered":"2024-03-08T20:38:42.688930+0000","last_clean":"2024-03-08T20:38:42.688930+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:42.688930+0000","last_undegraded":"2024-03-08T20:38:42.688930+0000","last_fullsized":"2024-03-08T20:38:42.688930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5223","reported_seq":5238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.745388+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.745388+0000","last_peered":"2024-03-08T20:38:43.745388+0000","last_clean":"2024-03-08T20:38:43.745388+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:38:43.745388+0000","last_undegraded":"2024-03-08T20:38:43.745388+0000","last_fullsized":"2024-03-08T20:38:43.745388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5223,"log_dups_size":0,"ondisk_log_size":5223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7614,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1299","reported_seq":1327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.182639+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:38:43.182639+0000","last_peered":"2024-03-08T20:38:43.182639+0000","last_clean":"2024-03-08T20:38:43.182639+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:38:43.182639+0000","last_undegraded":"2024-03-08T20:38:43.182639+0000","last_fullsized":"2024-03-08T20:38:43.182639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.194981+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:38:43.194981+0000","last_peered":"2024-03-08T20:38:43.194981+0000","last_clean":"2024-03-08T20:38:43.194981+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:38:43.194981+0000","last_undegraded":"2024-03-08T20:38:43.194981+0000","last_fullsized":"2024-03-08T20:38:43.194981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.647089+0000","last_change":"2024-03-08T20:30:10.906802+0000","last_active":"2024-03-08T20:38:43.647089+0000","last_peered":"2024-03-08T20:38:43.647089+0000","last_clean":"2024-03-08T20:38:43.647089+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:38:43.647089+0000","last_undegraded":"2024-03-08T20:38:43.647089+0000","last_fullsized":"2024-03-08T20:38:43.647089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:04:20.777976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1255","reported_seq":1269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.161190+0000","last_change":"2024-03-08T20:30:10.908515+0000","last_active":"2024-03-08T20:38:42.161190+0000","last_peered":"2024-03-08T20:38:42.161190+0000","last_clean":"2024-03-08T20:38:42.161190+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:38:42.161190+0000","last_undegraded":"2024-03-08T20:38:42.161190+0000","last_fullsized":"2024-03-08T20:38:42.161190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2005","reported_seq":2035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.785945+0000","last_change":"2024-03-08T20:29:23.231976+0000","last_active":"2024-03-08T20:38:42.785945+0000","last_peered":"2024-03-08T20:38:42.785945+0000","last_clean":"2024-03-08T20:38:42.785945+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:42.785945+0000","last_undegraded":"2024-03-08T20:38:42.785945+0000","last_fullsized":"2024-03-08T20:38:42.785945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":2005,"log_dups_size":0,"ondisk_log_size":2005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.411242+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:38:43.411242+0000","last_peered":"2024-03-08T20:38:43.411242+0000","last_clean":"2024-03-08T20:38:43.411242+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:38:43.411242+0000","last_undegraded":"2024-03-08T20:38:43.411242+0000","last_fullsized":"2024-03-08T20:38:43.411242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1230","reported_seq":1258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.319124+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:38:44.319124+0000","last_peered":"2024-03-08T20:38:44.319124+0000","last_clean":"2024-03-08T20:38:44.319124+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:38:44.319124+0000","last_undegraded":"2024-03-08T20:38:44.319124+0000","last_fullsized":"2024-03-08T20:38:44.319124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'878","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489620+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:38:43.489620+0000","last_peered":"2024-03-08T20:38:43.489620+0000","last_clean":"2024-03-08T20:38:43.489620+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:43.489620+0000","last_undegraded":"2024-03-08T20:38:43.489620+0000","last_fullsized":"2024-03-08T20:38:43.489620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.798526+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:38:43.798526+0000","last_peered":"2024-03-08T20:38:43.798526+0000","last_clean":"2024-03-08T20:38:43.798526+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:38:43.798526+0000","last_undegraded":"2024-03-08T20:38:43.798526+0000","last_fullsized":"2024-03-08T20:38:43.798526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1293","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.986790+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:38:42.986790+0000","last_peered":"2024-03-08T20:38:42.986790+0000","last_clean":"2024-03-08T20:38:42.986790+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:38:42.986790+0000","last_undegraded":"2024-03-08T20:38:42.986790+0000","last_fullsized":"2024-03-08T20:38:42.986790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1408","reported_seq":1976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.857583+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:38:41.857583+0000","last_peered":"2024-03-08T20:38:41.857583+0000","last_clean":"2024-03-08T20:38:41.857583+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:41.857583+0000","last_undegraded":"2024-03-08T20:38:41.857583+0000","last_fullsized":"2024-03-08T20:38:41.857583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849604+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:38:43.849604+0000","last_peered":"2024-03-08T20:38:43.849604+0000","last_clean":"2024-03-08T20:38:43.849604+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:38:43.849604+0000","last_undegraded":"2024-03-08T20:38:43.849604+0000","last_fullsized":"2024-03-08T20:38:43.849604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:04.052290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1231","reported_seq":1259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.159968+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:38:43.159968+0000","last_peered":"2024-03-08T20:38:43.159968+0000","last_clean":"2024-03-08T20:38:43.159968+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:38:43.159968+0000","last_undegraded":"2024-03-08T20:38:43.159968+0000","last_fullsized":"2024-03-08T20:38:43.159968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:49.292004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'603","reported_seq":633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.085281+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:38:42.085281+0000","last_peered":"2024-03-08T20:38:42.085281+0000","last_clean":"2024-03-08T20:38:42.085281+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:38:42.085281+0000","last_undegraded":"2024-03-08T20:38:42.085281+0000","last_fullsized":"2024-03-08T20:38:42.085281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.671108+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:38:43.671108+0000","last_peered":"2024-03-08T20:38:43.671108+0000","last_clean":"2024-03-08T20:38:43.671108+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:38:43.671108+0000","last_undegraded":"2024-03-08T20:38:43.671108+0000","last_fullsized":"2024-03-08T20:38:43.671108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:25.800409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'1306","reported_seq":1320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.368577+0000","last_change":"2024-03-08T20:30:10.640948+0000","last_active":"2024-03-08T20:38:43.368577+0000","last_peered":"2024-03-08T20:38:43.368577+0000","last_clean":"2024-03-08T20:38:43.368577+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:43.368577+0000","last_undegraded":"2024-03-08T20:38:43.368577+0000","last_fullsized":"2024-03-08T20:38:43.368577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1306,"log_dups_size":0,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:39.603548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'496","reported_seq":526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.543155+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:38:42.543155+0000","last_peered":"2024-03-08T20:38:42.543155+0000","last_clean":"2024-03-08T20:38:42.543155+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:42.543155+0000","last_undegraded":"2024-03-08T20:38:42.543155+0000","last_fullsized":"2024-03-08T20:38:42.543155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:35:22.321573+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:35:22.321573+0000","last_peered":"2024-03-08T20:35:22.321573+0000","last_clean":"2024-03-08T20:35:22.321573+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:35:22.321573+0000","last_undegraded":"2024-03-08T20:35:22.321573+0000","last_fullsized":"2024-03-08T20:35:22.321573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.117250+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:38:44.117250+0000","last_peered":"2024-03-08T20:38:44.117250+0000","last_clean":"2024-03-08T20:38:44.117250+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:38:44.117250+0000","last_undegraded":"2024-03-08T20:38:44.117250+0000","last_fullsized":"2024-03-08T20:38:44.117250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.341788+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:38:43.341788+0000","last_peered":"2024-03-08T20:38:43.341788+0000","last_clean":"2024-03-08T20:38:43.341788+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:38:43.341788+0000","last_undegraded":"2024-03-08T20:38:43.341788+0000","last_fullsized":"2024-03-08T20:38:43.341788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1395","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.749782+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:38:41.749782+0000","last_peered":"2024-03-08T20:38:41.749782+0000","last_clean":"2024-03-08T20:38:41.749782+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:41.749782+0000","last_undegraded":"2024-03-08T20:38:41.749782+0000","last_fullsized":"2024-03-08T20:38:41.749782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1649,"num_write_kb":30949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5294","reported_seq":5314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.139406+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:38:44.139406+0000","last_peered":"2024-03-08T20:38:44.139406+0000","last_clean":"2024-03-08T20:38:44.139406+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:38:44.139406+0000","last_undegraded":"2024-03-08T20:38:44.139406+0000","last_fullsized":"2024-03-08T20:38:44.139406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7633,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1281","reported_seq":1309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422930+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:38:43.422930+0000","last_peered":"2024-03-08T20:38:43.422930+0000","last_clean":"2024-03-08T20:38:43.422930+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:38:43.422930+0000","last_undegraded":"2024-03-08T20:38:43.422930+0000","last_fullsized":"2024-03-08T20:38:43.422930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1508","reported_seq":1538,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.588098+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:38:42.588098+0000","last_peered":"2024-03-08T20:38:42.588098+0000","last_clean":"2024-03-08T20:38:42.588098+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:42.588098+0000","last_undegraded":"2024-03-08T20:38:42.588098+0000","last_fullsized":"2024-03-08T20:38:42.588098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.428601+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:38:43.428601+0000","last_peered":"2024-03-08T20:38:43.428601+0000","last_clean":"2024-03-08T20:38:43.428601+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:38:43.428601+0000","last_undegraded":"2024-03-08T20:38:43.428601+0000","last_fullsized":"2024-03-08T20:38:43.428601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1192","reported_seq":1220,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.845267+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:38:42.845267+0000","last_peered":"2024-03-08T20:38:42.845267+0000","last_clean":"2024-03-08T20:38:42.845267+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:38:42.845267+0000","last_undegraded":"2024-03-08T20:38:42.845267+0000","last_fullsized":"2024-03-08T20:38:42.845267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1072,"num_object_clones":0,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1072,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1370","reported_seq":1400,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.084592+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:38:42.084592+0000","last_peered":"2024-03-08T20:38:42.084592+0000","last_clean":"2024-03-08T20:38:42.084592+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:42.084592+0000","last_undegraded":"2024-03-08T20:38:42.084592+0000","last_fullsized":"2024-03-08T20:38:42.084592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.731509+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.731509+0000","last_peered":"2024-03-08T20:38:43.731509+0000","last_clean":"2024-03-08T20:38:43.731509+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:38:43.731509+0000","last_undegraded":"2024-03-08T20:38:43.731509+0000","last_fullsized":"2024-03-08T20:38:43.731509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1317","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.836024+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:38:43.836024+0000","last_peered":"2024-03-08T20:38:43.836024+0000","last_clean":"2024-03-08T20:38:43.836024+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:38:43.836024+0000","last_undegraded":"2024-03-08T20:38:43.836024+0000","last_fullsized":"2024-03-08T20:38:43.836024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'346","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.138038+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:38:44.138038+0000","last_peered":"2024-03-08T20:38:44.138038+0000","last_clean":"2024-03-08T20:38:44.138038+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:44.138038+0000","last_undegraded":"2024-03-08T20:38:44.138038+0000","last_fullsized":"2024-03-08T20:38:44.138038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.134901+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:38:44.134901+0000","last_peered":"2024-03-08T20:38:44.134901+0000","last_clean":"2024-03-08T20:38:44.134901+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:38:44.134901+0000","last_undegraded":"2024-03-08T20:38:44.134901+0000","last_fullsized":"2024-03-08T20:38:44.134901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7657,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1326","reported_seq":1353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422535+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:38:43.422535+0000","last_peered":"2024-03-08T20:38:43.422535+0000","last_clean":"2024-03-08T20:38:43.422535+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:38:43.422535+0000","last_undegraded":"2024-03-08T20:38:43.422535+0000","last_fullsized":"2024-03-08T20:38:43.422535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'491","reported_seq":520,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.868890+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:38:41.868890+0000","last_peered":"2024-03-08T20:38:41.868890+0000","last_clean":"2024-03-08T20:38:41.868890+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:41.868890+0000","last_undegraded":"2024-03-08T20:38:41.868890+0000","last_fullsized":"2024-03-08T20:38:41.868890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.849964+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:38:43.849964+0000","last_peered":"2024-03-08T20:38:43.849964+0000","last_clean":"2024-03-08T20:38:43.849964+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:38:43.849964+0000","last_undegraded":"2024-03-08T20:38:43.849964+0000","last_fullsized":"2024-03-08T20:38:43.849964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:06.147445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1219","reported_seq":1244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.073298+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:38:44.073298+0000","last_peered":"2024-03-08T20:38:44.073298+0000","last_clean":"2024-03-08T20:38:44.073298+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:38:44.073298+0000","last_undegraded":"2024-03-08T20:38:44.073298+0000","last_fullsized":"2024-03-08T20:38:44.073298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'444","reported_seq":474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.337438+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:38:42.337438+0000","last_peered":"2024-03-08T20:38:42.337438+0000","last_clean":"2024-03-08T20:38:42.337438+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:38:42.337438+0000","last_undegraded":"2024-03-08T20:38:42.337438+0000","last_fullsized":"2024-03-08T20:38:42.337438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":710,"num_write_kb":9818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5286","reported_seq":5305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.582075+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:38:43.582075+0000","last_peered":"2024-03-08T20:38:43.582075+0000","last_clean":"2024-03-08T20:38:43.582075+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:38:43.582075+0000","last_undegraded":"2024-03-08T20:38:43.582075+0000","last_fullsized":"2024-03-08T20:38:43.582075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7651,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1283","reported_seq":1310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.590898+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:38:43.590898+0000","last_peered":"2024-03-08T20:38:43.590898+0000","last_clean":"2024-03-08T20:38:43.590898+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:38:43.590898+0000","last_undegraded":"2024-03-08T20:38:43.590898+0000","last_fullsized":"2024-03-08T20:38:43.590898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'774","reported_seq":803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.490411+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:38:43.490411+0000","last_peered":"2024-03-08T20:38:43.490411+0000","last_clean":"2024-03-08T20:38:43.490411+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:38:43.490411+0000","last_undegraded":"2024-03-08T20:38:43.490411+0000","last_fullsized":"2024-03-08T20:38:43.490411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.823900+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:38:43.823900+0000","last_peered":"2024-03-08T20:38:43.823900+0000","last_clean":"2024-03-08T20:38:43.823900+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:38:43.823900+0000","last_undegraded":"2024-03-08T20:38:43.823900+0000","last_fullsized":"2024-03-08T20:38:43.823900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1275","reported_seq":1302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.255300+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.255300+0000","last_peered":"2024-03-08T20:38:43.255300+0000","last_clean":"2024-03-08T20:38:43.255300+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:38:43.255300+0000","last_undegraded":"2024-03-08T20:38:43.255300+0000","last_fullsized":"2024-03-08T20:38:43.255300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:17:02.949202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'522","reported_seq":551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.253157+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:38:43.253157+0000","last_peered":"2024-03-08T20:38:43.253157+0000","last_clean":"2024-03-08T20:38:43.253157+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:43.253157+0000","last_undegraded":"2024-03-08T20:38:43.253157+0000","last_fullsized":"2024-03-08T20:38:43.253157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:06:15.343705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.247340+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:38:43.247340+0000","last_peered":"2024-03-08T20:38:43.247340+0000","last_clean":"2024-03-08T20:38:43.247340+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:38:43.247340+0000","last_undegraded":"2024-03-08T20:38:43.247340+0000","last_fullsized":"2024-03-08T20:38:43.247340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1234","reported_seq":1261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.436795+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:38:43.436795+0000","last_peered":"2024-03-08T20:38:43.436795+0000","last_clean":"2024-03-08T20:38:43.436795+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:38:43.436795+0000","last_undegraded":"2024-03-08T20:38:43.436795+0000","last_fullsized":"2024-03-08T20:38:43.436795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1234,"log_dups_size":0,"ondisk_log_size":1234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'648","reported_seq":677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.932498+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:38:43.932498+0000","last_peered":"2024-03-08T20:38:43.932498+0000","last_clean":"2024-03-08T20:38:43.932498+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:38:43.932498+0000","last_undegraded":"2024-03-08T20:38:43.932498+0000","last_fullsized":"2024-03-08T20:38:43.932498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":921,"num_write_kb":30369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743799+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:38:43.743799+0000","last_peered":"2024-03-08T20:38:43.743799+0000","last_clean":"2024-03-08T20:38:43.743799+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:38:43.743799+0000","last_undegraded":"2024-03-08T20:38:43.743799+0000","last_fullsized":"2024-03-08T20:38:43.743799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:32.275974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.298955+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:38:44.298955+0000","last_peered":"2024-03-08T20:38:44.298955+0000","last_clean":"2024-03-08T20:38:44.298955+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:38:44.298955+0000","last_undegraded":"2024-03-08T20:38:44.298955+0000","last_fullsized":"2024-03-08T20:38:44.298955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1149,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'629","reported_seq":658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.734087+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:38:41.734087+0000","last_peered":"2024-03-08T20:38:41.734087+0000","last_clean":"2024-03-08T20:38:41.734087+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:41.734087+0000","last_undegraded":"2024-03-08T20:38:41.734087+0000","last_fullsized":"2024-03-08T20:38:41.734087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5155","reported_seq":5177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.229489+0000","last_change":"2024-03-08T20:30:10.640415+0000","last_active":"2024-03-08T20:38:44.229489+0000","last_peered":"2024-03-08T20:38:44.229489+0000","last_clean":"2024-03-08T20:38:44.229489+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:38:44.229489+0000","last_undegraded":"2024-03-08T20:38:44.229489+0000","last_fullsized":"2024-03-08T20:38:44.229489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:19:52.665266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7458,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1270","reported_seq":1297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.640679+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:38:43.640679+0000","last_peered":"2024-03-08T20:38:43.640679+0000","last_clean":"2024-03-08T20:38:43.640679+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:38:43.640679+0000","last_undegraded":"2024-03-08T20:38:43.640679+0000","last_fullsized":"2024-03-08T20:38:43.640679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'413","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.559163+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:38:42.559163+0000","last_peered":"2024-03-08T20:38:42.559163+0000","last_clean":"2024-03-08T20:38:42.559163+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:42.559163+0000","last_undegraded":"2024-03-08T20:38:42.559163+0000","last_fullsized":"2024-03-08T20:38:42.559163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5121","reported_seq":5126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.743210+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:38:43.743210+0000","last_peered":"2024-03-08T20:38:43.743210+0000","last_clean":"2024-03-08T20:38:43.743210+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:38:43.743210+0000","last_undegraded":"2024-03-08T20:38:43.743210+0000","last_fullsized":"2024-03-08T20:38:43.743210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5121,"log_dups_size":0,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7428,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1272","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.046416+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:38:43.046416+0000","last_peered":"2024-03-08T20:38:43.046416+0000","last_clean":"2024-03-08T20:38:43.046416+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:38:43.046416+0000","last_undegraded":"2024-03-08T20:38:43.046416+0000","last_fullsized":"2024-03-08T20:38:43.046416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1239","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.771963+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:38:43.771963+0000","last_peered":"2024-03-08T20:38:43.771963+0000","last_clean":"2024-03-08T20:38:43.771963+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:43.771963+0000","last_undegraded":"2024-03-08T20:38:43.771963+0000","last_fullsized":"2024-03-08T20:38:43.771963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":121,"num_object_clones":0,"num_object_copies":242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":121,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1466,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5433","reported_seq":5437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.782104+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:38:43.782104+0000","last_peered":"2024-03-08T20:38:43.782104+0000","last_clean":"2024-03-08T20:38:43.782104+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:43.782104+0000","last_undegraded":"2024-03-08T20:38:43.782104+0000","last_fullsized":"2024-03-08T20:38:43.782104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5433,"log_dups_size":0,"ondisk_log_size":5433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7909,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665938+0000","last_change":"2024-03-08T20:30:10.908474+0000","last_active":"2024-03-08T20:38:43.665938+0000","last_peered":"2024-03-08T20:38:43.665938+0000","last_clean":"2024-03-08T20:38:43.665938+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:43.665938+0000","last_undegraded":"2024-03-08T20:38:43.665938+0000","last_fullsized":"2024-03-08T20:38:43.665938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:53:43.649481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'1289","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.016702+0000","last_change":"2024-03-08T20:29:24.243111+0000","last_active":"2024-03-08T20:38:43.016702+0000","last_peered":"2024-03-08T20:38:43.016702+0000","last_clean":"2024-03-08T20:38:43.016702+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:43.016702+0000","last_undegraded":"2024-03-08T20:38:43.016702+0000","last_fullsized":"2024-03-08T20:38:43.016702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'505","reported_seq":534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.913975+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:38:42.913975+0000","last_peered":"2024-03-08T20:38:42.913975+0000","last_clean":"2024-03-08T20:38:42.913975+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:38:42.913975+0000","last_undegraded":"2024-03-08T20:38:42.913975+0000","last_fullsized":"2024-03-08T20:38:42.913975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.053077+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:38:44.053077+0000","last_peered":"2024-03-08T20:38:44.053077+0000","last_clean":"2024-03-08T20:38:44.053077+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:38:44.053077+0000","last_undegraded":"2024-03-08T20:38:44.053077+0000","last_fullsized":"2024-03-08T20:38:44.053077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1296","reported_seq":1323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.801386+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:38:43.801386+0000","last_peered":"2024-03-08T20:38:43.801386+0000","last_clean":"2024-03-08T20:38:43.801386+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:38:43.801386+0000","last_undegraded":"2024-03-08T20:38:43.801386+0000","last_fullsized":"2024-03-08T20:38:43.801386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1164,"num_object_clones":0,"num_object_copies":2328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1164,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'385","reported_seq":414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.802950+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:38:42.802950+0000","last_peered":"2024-03-08T20:38:42.802950+0000","last_clean":"2024-03-08T20:38:42.802950+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:38:42.802950+0000","last_undegraded":"2024-03-08T20:38:42.802950+0000","last_fullsized":"2024-03-08T20:38:42.802950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9009041,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":650,"num_write_kb":14388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'542","reported_seq":571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.152160+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:38:44.152160+0000","last_peered":"2024-03-08T20:38:44.152160+0000","last_clean":"2024-03-08T20:38:44.152160+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:38:44.152160+0000","last_undegraded":"2024-03-08T20:38:44.152160+0000","last_fullsized":"2024-03-08T20:38:44.152160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":804,"num_write_kb":34561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1252","reported_seq":1279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.301368+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:38:43.301368+0000","last_peered":"2024-03-08T20:38:43.301368+0000","last_clean":"2024-03-08T20:38:43.301368+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:38:43.301368+0000","last_undegraded":"2024-03-08T20:38:43.301368+0000","last_fullsized":"2024-03-08T20:38:43.301368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5220","reported_seq":5241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.558185+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:38:42.558185+0000","last_peered":"2024-03-08T20:38:42.558185+0000","last_clean":"2024-03-08T20:38:42.558185+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:38:42.558185+0000","last_undegraded":"2024-03-08T20:38:42.558185+0000","last_fullsized":"2024-03-08T20:38:42.558185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5220,"log_dups_size":0,"ondisk_log_size":5220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7552,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'410","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.897852+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:38:42.897852+0000","last_peered":"2024-03-08T20:38:42.897852+0000","last_clean":"2024-03-08T20:38:42.897852+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:38:42.897852+0000","last_undegraded":"2024-03-08T20:38:42.897852+0000","last_fullsized":"2024-03-08T20:38:42.897852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1278","reported_seq":1305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.276570+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:38:44.276570+0000","last_peered":"2024-03-08T20:38:44.276570+0000","last_clean":"2024-03-08T20:38:44.276570+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:38:44.276570+0000","last_undegraded":"2024-03-08T20:38:44.276570+0000","last_fullsized":"2024-03-08T20:38:44.276570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1159,"num_object_clones":0,"num_object_copies":2318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1159,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5217","reported_seq":5202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.795426+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:38:43.795426+0000","last_peered":"2024-03-08T20:38:43.795426+0000","last_clean":"2024-03-08T20:38:43.795426+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:38:43.795426+0000","last_undegraded":"2024-03-08T20:38:43.795426+0000","last_fullsized":"2024-03-08T20:38:43.795426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5217,"log_dups_size":0,"ondisk_log_size":5217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7565,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1249","reported_seq":1277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.427034+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:38:43.427034+0000","last_peered":"2024-03-08T20:38:43.427034+0000","last_clean":"2024-03-08T20:38:43.427034+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:38:43.427034+0000","last_undegraded":"2024-03-08T20:38:43.427034+0000","last_fullsized":"2024-03-08T20:38:43.427034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1342","reported_seq":1370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.140197+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:38:42.140197+0000","last_peered":"2024-03-08T20:38:42.140197+0000","last_clean":"2024-03-08T20:38:42.140197+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:38:42.140197+0000","last_undegraded":"2024-03-08T20:38:42.140197+0000","last_fullsized":"2024-03-08T20:38:42.140197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1258","reported_seq":1286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.669285+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:38:43.669285+0000","last_peered":"2024-03-08T20:38:43.669285+0000","last_clean":"2024-03-08T20:38:43.669285+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:38:43.669285+0000","last_undegraded":"2024-03-08T20:38:43.669285+0000","last_fullsized":"2024-03-08T20:38:43.669285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1329","reported_seq":1357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.305648+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:38:43.305648+0000","last_peered":"2024-03-08T20:38:43.305648+0000","last_clean":"2024-03-08T20:38:43.305648+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:38:43.305648+0000","last_undegraded":"2024-03-08T20:38:43.305648+0000","last_fullsized":"2024-03-08T20:38:43.305648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1268","reported_seq":1291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.788615+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:38:43.788615+0000","last_peered":"2024-03-08T20:38:43.788615+0000","last_clean":"2024-03-08T20:38:43.788615+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:43.788615+0000","last_undegraded":"2024-03-08T20:38:43.788615+0000","last_fullsized":"2024-03-08T20:38:43.788615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1266","reported_seq":1294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.066004+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:38:43.066004+0000","last_peered":"2024-03-08T20:38:43.066004+0000","last_clean":"2024-03-08T20:38:43.066004+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:38:43.066004+0000","last_undegraded":"2024-03-08T20:38:43.066004+0000","last_fullsized":"2024-03-08T20:38:43.066004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1345","reported_seq":1373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.026042+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:38:44.026042+0000","last_peered":"2024-03-08T20:38:44.026042+0000","last_clean":"2024-03-08T20:38:44.026042+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:38:44.026042+0000","last_undegraded":"2024-03-08T20:38:44.026042+0000","last_fullsized":"2024-03-08T20:38:44.026042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1288","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.455137+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:38:43.455137+0000","last_peered":"2024-03-08T20:38:43.455137+0000","last_clean":"2024-03-08T20:38:43.455137+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:38:43.455137+0000","last_undegraded":"2024-03-08T20:38:43.455137+0000","last_fullsized":"2024-03-08T20:38:43.455137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1288,"log_dups_size":0,"ondisk_log_size":1288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1271","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.272774+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:38:43.272774+0000","last_peered":"2024-03-08T20:38:43.272774+0000","last_clean":"2024-03-08T20:38:43.272774+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:38:43.272774+0000","last_undegraded":"2024-03-08T20:38:43.272774+0000","last_fullsized":"2024-03-08T20:38:43.272774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1268","reported_seq":1295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.636127+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:38:43.636127+0000","last_peered":"2024-03-08T20:38:43.636127+0000","last_clean":"2024-03-08T20:38:43.636127+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:38:43.636127+0000","last_undegraded":"2024-03-08T20:38:43.636127+0000","last_fullsized":"2024-03-08T20:38:43.636127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1132,"num_object_clones":0,"num_object_copies":2264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1132,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1206,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.692530+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:38:43.692530+0000","last_peered":"2024-03-08T20:38:43.692530+0000","last_clean":"2024-03-08T20:38:43.692530+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:38:43.692530+0000","last_undegraded":"2024-03-08T20:38:43.692530+0000","last_fullsized":"2024-03-08T20:38:43.692530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1320","reported_seq":1348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665589+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.665589+0000","last_peered":"2024-03-08T20:38:43.665589+0000","last_clean":"2024-03-08T20:38:43.665589+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:38:43.665589+0000","last_undegraded":"2024-03-08T20:38:43.665589+0000","last_fullsized":"2024-03-08T20:38:43.665589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1298","reported_seq":1321,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.142042+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:38:44.142042+0000","last_peered":"2024-03-08T20:38:44.142042+0000","last_clean":"2024-03-08T20:38:44.142042+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:38:44.142042+0000","last_undegraded":"2024-03-08T20:38:44.142042+0000","last_fullsized":"2024-03-08T20:38:44.142042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1298,"log_dups_size":0,"ondisk_log_size":1298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1310","reported_seq":1338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.437003+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:38:43.437003+0000","last_peered":"2024-03-08T20:38:43.437003+0000","last_clean":"2024-03-08T20:38:43.437003+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:38:43.437003+0000","last_undegraded":"2024-03-08T20:38:43.437003+0000","last_fullsized":"2024-03-08T20:38:43.437003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1273","reported_seq":1300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.279682+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:38:42.279682+0000","last_peered":"2024-03-08T20:38:42.279682+0000","last_clean":"2024-03-08T20:38:42.279682+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:38:42.279682+0000","last_undegraded":"2024-03-08T20:38:42.279682+0000","last_fullsized":"2024-03-08T20:38:42.279682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1324","reported_seq":1337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.215350+0000","last_change":"2024-03-08T20:30:10.906961+0000","last_active":"2024-03-08T20:38:42.215350+0000","last_peered":"2024-03-08T20:38:42.215350+0000","last_clean":"2024-03-08T20:38:42.215350+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:38:42.215350+0000","last_undegraded":"2024-03-08T20:38:42.215350+0000","last_fullsized":"2024-03-08T20:38:42.215350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1324,"log_dups_size":0,"ondisk_log_size":1324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'1255","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.944808+0000","last_change":"2024-03-08T20:30:10.632389+0000","last_active":"2024-03-08T20:38:41.944808+0000","last_peered":"2024-03-08T20:38:41.944808+0000","last_clean":"2024-03-08T20:38:41.944808+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:38:41.944808+0000","last_undegraded":"2024-03-08T20:38:41.944808+0000","last_fullsized":"2024-03-08T20:38:41.944808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'1316","reported_seq":1343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.956611+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:38:42.956611+0000","last_peered":"2024-03-08T20:38:42.956611+0000","last_clean":"2024-03-08T20:38:42.956611+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:38:42.956611+0000","last_undegraded":"2024-03-08T20:38:42.956611+0000","last_fullsized":"2024-03-08T20:38:42.956611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1245","reported_seq":1272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.101433+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:38:43.101433+0000","last_peered":"2024-03-08T20:38:43.101433+0000","last_clean":"2024-03-08T20:38:43.101433+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:38:43.101433+0000","last_undegraded":"2024-03-08T20:38:43.101433+0000","last_fullsized":"2024-03-08T20:38:43.101433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1245,"log_dups_size":0,"ondisk_log_size":1245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:43:17.612515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1258","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.754953+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:38:43.754953+0000","last_peered":"2024-03-08T20:38:43.754953+0000","last_clean":"2024-03-08T20:38:43.754953+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:43.754953+0000","last_undegraded":"2024-03-08T20:38:43.754953+0000","last_fullsized":"2024-03-08T20:38:43.754953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1208","reported_seq":1224,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.936295+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:38:43.936295+0000","last_peered":"2024-03-08T20:38:43.936295+0000","last_clean":"2024-03-08T20:38:43.936295+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:38:43.936295+0000","last_undegraded":"2024-03-08T20:38:43.936295+0000","last_fullsized":"2024-03-08T20:38:43.936295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1096,"num_object_clones":0,"num_object_copies":2192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1096,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1266","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.933894+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:38:43.933894+0000","last_peered":"2024-03-08T20:38:43.933894+0000","last_clean":"2024-03-08T20:38:43.933894+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:38:43.933894+0000","last_undegraded":"2024-03-08T20:38:43.933894+0000","last_fullsized":"2024-03-08T20:38:43.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1285","reported_seq":1312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.047031+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:38:44.047031+0000","last_peered":"2024-03-08T20:38:44.047031+0000","last_clean":"2024-03-08T20:38:44.047031+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:38:44.047031+0000","last_undegraded":"2024-03-08T20:38:44.047031+0000","last_fullsized":"2024-03-08T20:38:44.047031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1281","reported_seq":1308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:38.718954+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:38:38.718954+0000","last_peered":"2024-03-08T20:38:38.718954+0000","last_clean":"2024-03-08T20:38:38.718954+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:38:38.718954+0000","last_undegraded":"2024-03-08T20:38:38.718954+0000","last_fullsized":"2024-03-08T20:38:38.718954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1259","reported_seq":1284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.827083+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:38:43.827083+0000","last_peered":"2024-03-08T20:38:43.827083+0000","last_clean":"2024-03-08T20:38:43.827083+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:38:43.827083+0000","last_undegraded":"2024-03-08T20:38:43.827083+0000","last_fullsized":"2024-03-08T20:38:43.827083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1259,"log_dups_size":0,"ondisk_log_size":1259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1131,"num_object_clones":0,"num_object_copies":2262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1240","reported_seq":1267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.418827+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:38:43.418827+0000","last_peered":"2024-03-08T20:38:43.418827+0000","last_clean":"2024-03-08T20:38:43.418827+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:38:43.418827+0000","last_undegraded":"2024-03-08T20:38:43.418827+0000","last_fullsized":"2024-03-08T20:38:43.418827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1221","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.574530+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:38:43.574530+0000","last_peered":"2024-03-08T20:38:43.574530+0000","last_clean":"2024-03-08T20:38:43.574530+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:38:43.574530+0000","last_undegraded":"2024-03-08T20:38:43.574530+0000","last_fullsized":"2024-03-08T20:38:43.574530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1323","reported_seq":1350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.971308+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:38:42.971308+0000","last_peered":"2024-03-08T20:38:42.971308+0000","last_clean":"2024-03-08T20:38:42.971308+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:38:42.971308+0000","last_undegraded":"2024-03-08T20:38:42.971308+0000","last_fullsized":"2024-03-08T20:38:42.971308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1270","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.424239+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:38:43.424239+0000","last_peered":"2024-03-08T20:38:43.424239+0000","last_clean":"2024-03-08T20:38:43.424239+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:38:43.424239+0000","last_undegraded":"2024-03-08T20:38:43.424239+0000","last_fullsized":"2024-03-08T20:38:43.424239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1303","reported_seq":1331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.990298+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:38:42.990298+0000","last_peered":"2024-03-08T20:38:42.990298+0000","last_clean":"2024-03-08T20:38:42.990298+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:42.990298+0000","last_undegraded":"2024-03-08T20:38:42.990298+0000","last_fullsized":"2024-03-08T20:38:42.990298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'1204","reported_seq":1232,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.892932+0000","last_change":"2024-03-08T20:29:24.239914+0000","last_active":"2024-03-08T20:38:42.892932+0000","last_peered":"2024-03-08T20:38:42.892932+0000","last_clean":"2024-03-08T20:38:42.892932+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:42.892932+0000","last_undegraded":"2024-03-08T20:38:42.892932+0000","last_fullsized":"2024-03-08T20:38:42.892932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1178","reported_seq":1206,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.655861+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:38:42.655861+0000","last_peered":"2024-03-08T20:38:42.655861+0000","last_clean":"2024-03-08T20:38:42.655861+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:38:42.655861+0000","last_undegraded":"2024-03-08T20:38:42.655861+0000","last_fullsized":"2024-03-08T20:38:42.655861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1070,"num_object_clones":0,"num_object_copies":2140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":242584,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167070,"ondisk_log_size":167070,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73190,"num_object_clones":0,"num_object_copies":146380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77594,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81615,"ondisk_log_size":81615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":185758531,"num_objects":4499,"num_object_clones":0,"num_object_copies":8998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4499,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33031,"num_write_kb":742459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4446,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130699264,"data_stored":375816734,"data_compressed":52167254,"data_compressed_allocated":64143360,"data_compressed_original":309325824,"omap_allocated":0,"internal_metadata":0},"log_size":23530,"ondisk_log_size":23530,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582308,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93789532,"statfs":{"total":96636764160,"available":96040480768,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,13,37,35,48,28,170],"upper_bound":4096},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574963,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":707700,"kb_used_data":401708,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93664140,"statfs":{"total":96636764160,"available":95912079360,"internally_reserved":0,"allocated":411348992,"data_stored":564529961,"data_compressed":75981661,"data_compressed_allocated":89468928,"data_compressed_original":242831360,"omap_allocated":1594,"internal_metadata":313326022},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,10,18,31,36,47,203],"upper_bound":2048},"perf_stat":{"commit_latency_ms":54,"apply_latency_ms":54,"commit_latency_ns":54000000,"apply_latency_ns":54000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527844,"kb_used_data":253724,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93843996,"statfs":{"total":96636764160,"available":96096251904,"internally_reserved":0,"allocated":259813376,"data_stored":432525650,"data_compressed":68150985,"data_compressed_allocated":85839872,"data_compressed_original":258727936,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,0,23,0,19,23,10,191,31],"upper_bound":2048},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":619676,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93752164,"statfs":{"total":96636764160,"available":96002215936,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,5,32,55,90,69,30,27,70,60],"upper_bound":8192},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":823816,"kb_used_data":423360,"kb_used_omap":1,"kb_used_meta":400446,"kb_avail":93548024,"statfs":{"total":96636764160,"available":95793176576,"internally_reserved":0,"allocated":433520640,"data_stored":670953757,"data_compressed":105789092,"data_compressed_allocated":133480448,"data_compressed_original":371097600,"omap_allocated":1593,"internal_metadata":410057159},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,16,11,48,31,45,63,65,65],"upper_bound":4096},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569484,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93802356,"statfs":{"total":96636764160,"available":96053612544,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":888068,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":436478,"kb_avail":93483772,"statfs":{"total":96636764160,"available":95727382528,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":446953925},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600120,"kb_used_data":308016,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93771720,"statfs":{"total":96636764160,"available":96022241280,"internally_reserved":0,"allocated":315408384,"data_stored":435467670,"data_compressed":64254155,"data_compressed_allocated":77156352,"data_compressed_original":197402624,"omap_allocated":1594,"internal_metadata":299104710},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,0,2,5,14,0,0,18,65],"upper_bound":2048},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12083200,"data_stored":25166462,"data_compressed":2865800,"data_compressed_allocated":3715072,"data_compressed_original":16809984,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20426752,"data_stored":51610257,"data_compressed":6731091,"data_compressed_allocated":8540160,"data_compressed_original":39735296,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13733888,"data_stored":50987869,"data_compressed":7594478,"data_compressed_allocated":9105408,"data_compressed_original":46370816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:38:49.668 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:38:49.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.913+0000 7f817bc00640 1 Processor -- start 2024-03-08T20:38:49.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.913+0000 7f817bc00640 1 -- start start 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f817bc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81740c22b0 0x7f8174071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f817bc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81740a6330 con 0x7f817406bf90 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f817bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81740730b0 con 0x7f81740716a0 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f817bc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8174073390 con 0x7f81740c22b0 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f8179200640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f817406bf90 0x7f81740c5190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34518/0 (socket says 172.21.15.118:34518) 2024-03-08T20:38:49.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.914+0000 7f8179200640 1 -- 172.21.15.118:0/2009070839 learned_addr learned my addr 172.21.15.118:0/2009070839 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:49.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8179c00640 1 --2- 172.21.15.118:0/2009070839 >> v2:172.21.15.144:3300/0 conn(0x7f81740c22b0 0x7f8174071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589317336 0 0) 0x7f81740a6330 con 0x7f817406bf90 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8158003520 con 0x7f817406bf90 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1731259875 0 0) 0x7f8158003520 con 0x7f817406bf90 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 >> v2:172.21.15.144:3300/0 conn(0x7f81740c22b0 msgr2=0x7f8174071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 --2- 172.21.15.118:0/2009070839 >> v2:172.21.15.144:3300/0 conn(0x7f81740c22b0 0x7f8174071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 >> v1:172.21.15.144:6789/0 conn(0x7f81740716a0 legacy=0x7f8174158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740c3400 con 0x7f817406bf90 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f8164001670 con 0x7f817406bf90 2024-03-08T20:38:49.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 >> v1:172.21.15.118:6789/0 conn(0x7f817406bf90 legacy=0x7f81740c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158003a00 0x7f8158003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 0x7f8158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.915+0000 7f8173400640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81580052e0 0x7f815800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174073390 con 0x7f8158004800 2024-03-08T20:38:49.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815800c1e0 con 0x7f8158003a00 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815800c3e0 con 0x7f81580052e0 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8179c00640 1 --2- 172.21.15.118:0/2009070839 >> v2:172.21.15.144:3300/0 conn(0x7f81740c22b0 0x7f8174071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8179200640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158003a00 0x7f8158003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8173e00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 0x7f8158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8179c00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81580052e0 0x7f815800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.916+0000 7f8173e00640 1 -- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81580052e0 msgr2=0x7f815800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.917+0000 7f8173e00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81580052e0 0x7f815800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.917+0000 7f8173e00640 1 -- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158003a00 msgr2=0x7f8158003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:49.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.917+0000 7f8173e00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158003a00 0x7f8158003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.917+0000 7f8173e00640 1 -- 172.21.15.118:0/2009070839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158003520 con 0x7f8158004800 2024-03-08T20:38:49.920 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.917+0000 7f8179c00640 1 -- 172.21.15.118:0/2009070839 reap_dead start 2024-03-08T20:38:49.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f8173e00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 0x7f8158004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8160001720 tx=0x7f8158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281807f663061d2e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.923 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160001370 con 0x7f8158004800 2024-03-08T20:38:49.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81600052d0 con 0x7f8158004800 2024-03-08T20:38:49.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f8173400640 1 -- 172.21.15.118:0/2009070839 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160003830 con 0x7f8158004800 2024-03-08T20:38:49.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f817bc00640 1 -- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 msgr2=0x7f8158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f817bc00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 0x7f8158004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8160001720 tx=0x7f8158005830 comp rx=0 tx=0).stop 2024-03-08T20:38:49.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.918+0000 7f817bc00640 1 -- 172.21.15.118:0/2009070839 shutdown_connections 2024-03-08T20:38:49.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.919+0000 7f817bc00640 1 --2- 172.21.15.118:0/2009070839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8158004800 0x7f8158004c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.919+0000 7f817bc00640 1 -- 172.21.15.118:0/2009070839 >> 172.21.15.118:0/2009070839 conn(0x7f81740c36e0 msgr2=0x7f81740c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:49.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.919+0000 7f817bc00640 1 -- 172.21.15.118:0/2009070839 shutdown_connections 2024-03-08T20:38:49.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.919+0000 7f817bc00640 1 -- 172.21.15.118:0/2009070839 wait complete. 2024-03-08T20:38:49.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.920+0000 7f817bc00640 1 Processor -- start 2024-03-08T20:38:49.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.921+0000 7f817bc00640 1 -- start start 2024-03-08T20:38:49.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.921+0000 7f817bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 0x7f81740abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.921+0000 7f817bc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f817bc00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81740a9c10 0x7f81741ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f817bc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740c4d00 con 0x7f8174099ad0 2024-03-08T20:38:49.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f817bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817406c580 con 0x7f8158004800 2024-03-08T20:38:49.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f817bc00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8174071bb0 con 0x7f81740a9c10 2024-03-08T20:38:49.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44276/0 (socket says 172.21.15.118:44276) 2024-03-08T20:38:49.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 -- 172.21.15.118:0/4144661370 learned_addr learned my addr 172.21.15.118:0/4144661370 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:49.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8179200640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 0x7f81740abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 -- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81740a9c10 msgr2=0x7f81741ddc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8179c00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81740a9c10 0x7f81741ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81740a9c10 0x7f81741ddc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 -- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 msgr2=0x7f81740abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:49.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 0x7f81740abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:49.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8173e00640 1 -- 172.21.15.118:0/4144661370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740aad00 con 0x7f8174099ad0 2024-03-08T20:38:49.930 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.922+0000 7f8179200640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 0x7f81740abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:49.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f8173e00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8160005040 tx=0x7f8160001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160041020 con 0x7f8174099ad0 2024-03-08T20:38:49.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8160005480 con 0x7f8174099ad0 2024-03-08T20:38:49.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160007a30 con 0x7f8174099ad0 2024-03-08T20:38:49.931 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740aafe0 con 0x7f8174099ad0 2024-03-08T20:38:49.932 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.923+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740ab5a0 con 0x7f8174099ad0 2024-03-08T20:38:49.933 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.924+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8174074a40 con 0x7f8174099ad0 2024-03-08T20:38:49.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.925+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8160044020 con 0x7f8174099ad0 2024-03-08T20:38:49.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.926+0000 7f8170c00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 0x7f815406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:49.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.926+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f81600ac910 con 0x7f8174099ad0 2024-03-08T20:38:49.934 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.926+0000 7f8179200640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 0x7f815406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:49.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.927+0000 7f8179200640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 0x7f815406e0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8164000c00 tx=0x7f8164009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:49.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:49.931+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f816004b030 con 0x7f8174099ad0 2024-03-08T20:38:50.127 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.128+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81740c1070 con 0x7f8174099ad0 2024-03-08T20:38:50.131 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.132+0000 7f8170c00640 1 -- 172.21.15.118:0/4144661370 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18950 (secure 0 0 0) 0x7f81600303c0 con 0x7f8174099ad0 2024-03-08T20:38:50.132 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:50.132 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:30:10.610951+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 msgr2=0x7f815406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 0x7f815406e0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8164000c00 tx=0x7f8164009040 comp rx=0 tx=0).stop 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 msgr2=0x7f81741eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8160005040 tx=0x7f8160001120 comp rx=0 tx=0).stop 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 shutdown_connections 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f815406bc00 0x7f815406e0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81740a9c10 0x7f81741ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:50.135 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8174099ad0 0x7f81741eb430 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 --2- 172.21.15.118:0/4144661370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8158004800 0x7f81740abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 >> 172.21.15.118:0/4144661370 conn(0x7f81740c36e0 msgr2=0x7f81741d9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 shutdown_connections 2024-03-08T20:38:50.136 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:50.135+0000 7f817bc00640 1 -- 172.21.15.118:0/4144661370 wait complete. 2024-03-08T20:38:51.154 INFO:tasks.ceph:Scrubbing osd.0 2024-03-08T20:38:51.154 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:51.370 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.371+0000 7fa43ec00640 1 Processor -- start 2024-03-08T20:38:51.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.371+0000 7fa43ec00640 1 -- start start 2024-03-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.372+0000 7fa43ec00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.372+0000 7fa43ec00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa438070f40 0x7fa4380713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.372+0000 7fa43ec00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4380c1450 con 0x7fa43814ee30 2024-03-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.372+0000 7fa43ec00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4380c2060 con 0x7fa438070f40 2024-03-08T20:38:51.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa43ec00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380c1730 con 0x7fa4380c3320 2024-03-08T20:38:51.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa43cc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa438070f40 0x7fa4380713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.373 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa437e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa42f400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa43814ee30 0x7fa43814f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34534/0 (socket says 172.21.15.118:34534) 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa42f400640 1 -- 172.21.15.118:0/2365959064 learned_addr learned my addr 172.21.15.118:0/2365959064 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa43cc00640 1 -- 172.21.15.118:0/2365959064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 msgr2=0x7fa438151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa43cc00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.373+0000 7fa43cc00640 1 -- 172.21.15.118:0/2365959064 >> v1:172.21.15.118:6789/0 conn(0x7fa43814ee30 legacy=0x7fa43814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.374+0000 7fa43cc00640 1 -- 172.21.15.118:0/2365959064 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380c1a10 con 0x7fa438070f40 2024-03-08T20:38:51.374 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.374+0000 7fa437e00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:51.375 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.374+0000 7fa437400640 1 -- 172.21.15.118:0/2365959064 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994686070 0 0) 0x7fa4380c1450 con 0x7fa43814ee30 2024-03-08T20:38:51.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa43cc00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa4380713d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa430009d90 tx=0x7fa43002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ceba5b191fba6e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa437400640 1 -- 172.21.15.118:0/2365959064 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430039070 con 0x7fa438070f40 2024-03-08T20:38:51.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa437400640 1 -- 172.21.15.118:0/2365959064 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43002cbd0 con 0x7fa438070f40 2024-03-08T20:38:51.376 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa437400640 1 -- 172.21.15.118:0/2365959064 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430034440 con 0x7fa438070f40 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa43ec00640 1 -- 172.21.15.118:0/2365959064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 msgr2=0x7fa4380713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.375+0000 7fa43ec00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa4380713d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa430009d90 tx=0x7fa43002be20 comp rx=0 tx=0).stop 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 -- 172.21.15.118:0/2365959064 shutdown_connections 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa4380713d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 --2- 172.21.15.118:0/2365959064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 -- 172.21.15.118:0/2365959064 >> 172.21.15.118:0/2365959064 conn(0x7fa4380a8cb0 msgr2=0x7fa43806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:51.377 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 -- 172.21.15.118:0/2365959064 shutdown_connections 2024-03-08T20:38:51.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.376+0000 7fa43ec00640 1 -- 172.21.15.118:0/2365959064 wait complete. 2024-03-08T20:38:51.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.377+0000 7fa43ec00640 1 Processor -- start 2024-03-08T20:38:51.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 -- start start 2024-03-08T20:38:51.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa438153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43814ee30 0x7fa4381eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380c2e80 con 0x7fa438070f40 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380c2d00 con 0x7fa43814ee30 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.378+0000 7fa43ec00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380c1020 con 0x7fa4380c3320 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa438153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa438153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44282/0 (socket says 172.21.15.118:44282) 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 -- 172.21.15.118:0/345655213 learned_addr learned my addr 172.21.15.118:0/345655213 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:51.381 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa42f400640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa43cc00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43814ee30 0x7fa4381eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 -- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 msgr2=0x7fa438072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 -- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43814ee30 msgr2=0x7fa4381eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43814ee30 0x7fa4381eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.382 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438145050 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa42f400640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4380c3320 0x7fa438072040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.379+0000 7fa437e00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa438153bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e990 tx=0x7fa42800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.380+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428017070 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.380+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42800c9e0 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.380+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438147c30 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.380+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42800cdb0 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.380+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa438147f10 con 0x7fa438070f40 2024-03-08T20:38:51.383 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.381+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa438074a40 con 0x7fa438070f40 2024-03-08T20:38:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.382+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa42801a070 con 0x7fa438070f40 2024-03-08T20:38:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa434c00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa41406bbd0 0x7fa41406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa42808b520 con 0x7fa438070f40 2024-03-08T20:38:51.385 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa42f400640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa41406bbd0 0x7fa41406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa434c00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7fa4140755f0 0x7fa414077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa414078160 con 0x7fa4140755f0 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.383+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42808b8d0 con 0x7fa438070f40 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.384+0000 7fa43cc00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7fa4140755f0 0x7fa414077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.384+0000 7fa42f400640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa41406bbd0 0x7fa41406e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4380c2850 tx=0x7fa420007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.384+0000 7fa43cc00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7fa4140755f0 0x7fa414077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.386 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.385+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== osd.0 v2:172.21.15.118:6800/822956166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa414078160 con 0x7fa4140755f0 2024-03-08T20:38:51.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.399+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 --> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa438147a00 con 0x7fa4140755f0 2024-03-08T20:38:51.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.400+0000 7fa434c00640 1 -- 172.21.15.118:0/345655213 <== osd.0 v2:172.21.15.118:6800/822956166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa438147a00 con 0x7fa4140755f0 2024-03-08T20:38:51.400 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:51.400 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:51.400 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:51.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.400+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7fa4140755f0 msgr2=0x7fa414077a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.400+0000 7fa43ec00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6800/822956166,v1:172.21.15.118:6801/822956166] conn(0x7fa4140755f0 0x7fa414077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.400+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa41406bbd0 msgr2=0x7fa41406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.400+0000 7fa43ec00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa41406bbd0 0x7fa41406e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4380c2850 tx=0x7fa420007c10 comp rx=0 tx=0).stop 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 msgr2=0x7fa438153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 --2- 172.21.15.118:0/345655213 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa438070f40 0x7fa438153bc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e990 tx=0x7fa42800ee50 comp rx=0 tx=0).stop 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43cc00640 1 -- 172.21.15.118:0/345655213 reap_dead start 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 shutdown_connections 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 >> 172.21.15.118:0/345655213 conn(0x7fa4380a8cb0 msgr2=0x7fa43814d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 shutdown_connections 2024-03-08T20:38:51.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.401+0000 7fa43ec00640 1 -- 172.21.15.118:0/345655213 wait complete. 2024-03-08T20:38:51.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-08T20:38:51.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.617+0000 7f6324c00640 1 Processor -- start 2024-03-08T20:38:51.617 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.617+0000 7f6324c00640 1 -- start start 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.618+0000 7f6324c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63200c2750 0x7f63200c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.618+0000 7f6324c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6320155d20 con 0x7f63200c3970 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.618+0000 7f6324c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6320156000 con 0x7f632006e6a0 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.618+0000 7f6324c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200c34e0 con 0x7f63200c2750 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.619+0000 7f631d400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f63200c3970 0x7f6320072080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34544/0 (socket says 172.21.15.118:34544) 2024-03-08T20:38:51.618 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.619+0000 7f631d400640 1 -- 172.21.15.118:0/1029448509 learned_addr learned my addr 172.21.15.118:0/1029448509 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:51.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.619+0000 7f631de00640 1 --2- 172.21.15.118:0/1029448509 >> v2:172.21.15.144:3300/0 conn(0x7f63200c2750 0x7f63200c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.619+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291635803 0 0) 0x7f6320155d20 con 0x7f63200c3970 2024-03-08T20:38:51.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.619+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003520 con 0x7f63200c3970 2024-03-08T20:38:51.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1915098393 0 0) 0x7f6304003520 con 0x7f63200c3970 2024-03-08T20:38:51.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 >> v2:172.21.15.144:3300/0 conn(0x7f63200c2750 msgr2=0x7f63200c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 --2- 172.21.15.118:0/1029448509 >> v2:172.21.15.144:3300/0 conn(0x7f63200c2750 0x7f63200c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 >> v1:172.21.15.144:6789/0 conn(0x7f632006e6a0 legacy=0x7f6320155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200c3170 con 0x7f63200c3970 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f630c001670 con 0x7f63200c3970 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 >> v1:172.21.15.118:6789/0 conn(0x7f63200c3970 legacy=0x7f6320072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f6304003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63040051c0 0x7f630400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200c34e0 con 0x7f6304003a00 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630400e2d0 con 0x7f6304004800 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630400e4d0 con 0x7f63040051c0 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f6304003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631e800640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63040051c0 0x7f630400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 -- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63040051c0 msgr2=0x7f630400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63040051c0 0x7f630400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 -- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6304004800 msgr2=0x7f6304004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631de00640 1 -- 172.21.15.118:0/1029448509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304003520 con 0x7f6304003a00 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631e800640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63040051c0 0x7f630400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.620+0000 7f631e800640 1 -- 172.21.15.118:0/1029448509 reap_dead start 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.621+0000 7f631de00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f6304003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6310009ac0 tx=0x7f6304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a06a6296d0e8df server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310039070 con 0x7f6304003a00 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631002c6b0 con 0x7f6304003a00 2024-03-08T20:38:51.624 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f631ca00640 1 -- 172.21.15.118:0/1029448509 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310009690 con 0x7f6304003a00 2024-03-08T20:38:51.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 -- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 msgr2=0x7f6304003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f6304003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6310009ac0 tx=0x7f6304005830 comp rx=0 tx=0).stop 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 -- 172.21.15.118:0/1029448509 shutdown_connections 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 --2- 172.21.15.118:0/1029448509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f6304003e20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 -- 172.21.15.118:0/1029448509 >> 172.21.15.118:0/1029448509 conn(0x7f63200c6760 msgr2=0x7f63200c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 -- 172.21.15.118:0/1029448509 shutdown_connections 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.622+0000 7f6324c00640 1 -- 172.21.15.118:0/1029448509 wait complete. 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.624+0000 7f6324c00640 1 Processor -- start 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.624+0000 7f6324c00640 1 -- start start 2024-03-08T20:38:51.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63200ac4b0 0x7f632014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63201db940 0x7f6320153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320151f90 con 0x7f6304003a00 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6320151e10 con 0x7f63200ac4b0 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f6324c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200c2b30 con 0x7f63201db940 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f631de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f631de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44290/0 (socket says 172.21.15.118:44290) 2024-03-08T20:38:51.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.625+0000 7f631de00640 1 -- 172.21.15.118:0/3276402199 learned_addr learned my addr 172.21.15.118:0/3276402199 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631e800640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63201db940 0x7f6320153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631d400640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63200ac4b0 0x7f632014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 -- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63201db940 msgr2=0x7f6320153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63201db940 0x7f6320153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 -- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63200ac4b0 msgr2=0x7f632014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63200ac4b0 0x7f632014db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 -- 172.21.15.118:0/3276402199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63201545c0 con 0x7f6304003a00 2024-03-08T20:38:51.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f631de00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6310037040 tx=0x7f6310004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310042020 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631003a040 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310039070 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.626+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6320154860 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.627+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6320154e20 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.628+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6320074a40 con 0x7f6304003a00 2024-03-08T20:38:51.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.628+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6310045020 con 0x7f6304003a00 2024-03-08T20:38:51.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.629+0000 7f6316000640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 0x7f630006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:51.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.629+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f63100abed0 con 0x7f6304003a00 2024-03-08T20:38:51.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.629+0000 7f631d400640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 0x7f630006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:51.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.630+0000 7f631d400640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 0x7f630006e0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f63200c6330 tx=0x7f630c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:51.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.634+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f631004c020 con 0x7f6304003a00 2024-03-08T20:38:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.832+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f63200c52b0 con 0x7f630006bc00 2024-03-08T20:38:51.832 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.833+0000 7f6316000640 1 -- 172.21.15.118:0/3276402199 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f63200c52b0 con 0x7f630006bc00 2024-03-08T20:38:51.833 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 0 to deep-scrub 2024-03-08T20:38:51.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 msgr2=0x7f630006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 0x7f630006e0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f63200c6330 tx=0x7f630c009040 comp rx=0 tx=0).stop 2024-03-08T20:38:51.836 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 msgr2=0x7f63200abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6310037040 tx=0x7f6310004730 comp rx=0 tx=0).stop 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 shutdown_connections 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f630006bc00 0x7f630006e0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63201db940 0x7f6320153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63200ac4b0 0x7f632014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 --2- 172.21.15.118:0/3276402199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6304003a00 0x7f63200abf70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 >> 172.21.15.118:0/3276402199 conn(0x7f63200c6760 msgr2=0x7f63200a7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 shutdown_connections 2024-03-08T20:38:51.837 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:51.836+0000 7f6324c00640 1 -- 172.21.15.118:0/3276402199 wait complete. 2024-03-08T20:38:51.854 INFO:tasks.ceph:Scrubbing osd.1 2024-03-08T20:38:51.854 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:52.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.073+0000 7fbec8c00640 1 Processor -- start 2024-03-08T20:38:52.073 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.074+0000 7fbec8c00640 1 -- start start 2024-03-08T20:38:52.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbec40c1020 0x7fbec40c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec8c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbec40a9760 0x7fbec40a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.075 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec8c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec4152d00 con 0x7fbec406e000 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec8c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec4153bd0 con 0x7fbec40a9760 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec8c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec4152fc0 con 0x7fbec40c1020 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbeb9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbec40a9760 0x7fbec40a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.075+0000 7fbec2800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbec406e000 0x7fbec406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34548/0 (socket says 172.21.15.118:34548) 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbec2800640 1 -- 172.21.15.118:0/2234332939 learned_addr learned my addr 172.21.15.118:0/2234332939 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbec1e00640 1 --2- 172.21.15.118:0/2234332939 >> v2:172.21.15.144:3300/0 conn(0x7fbec40c1020 0x7fbec40c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbeb9400640 1 -- 172.21.15.118:0/2234332939 >> v2:172.21.15.144:3300/0 conn(0x7fbec40c1020 msgr2=0x7fbec40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:52.076 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbeb9400640 1 --2- 172.21.15.118:0/2234332939 >> v2:172.21.15.144:3300/0 conn(0x7fbec40c1020 0x7fbec40c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbeb9400640 1 -- 172.21.15.118:0/2234332939 >> v1:172.21.15.118:6789/0 conn(0x7fbec406e000 legacy=0x7fbec406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.077 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.076+0000 7fbeb9400640 1 -- 172.21.15.118:0/2234332939 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec41532a0 con 0x7fbec40a9760 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.077+0000 7fbeb9400640 1 --2- 172.21.15.118:0/2234332939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec40a9bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbec406f050 tx=0x7fbeac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15c87431df9257c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.077+0000 7fbec1400640 1 -- 172.21.15.118:0/2234332939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0315a0 con 0x7fbec40a9760 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.077+0000 7fbec1400640 1 -- 172.21.15.118:0/2234332939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac037070 con 0x7fbec40a9760 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.077+0000 7fbec1400640 1 -- 172.21.15.118:0/2234332939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac031960 con 0x7fbec40a9760 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 -- 172.21.15.118:0/2234332939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 msgr2=0x7fbec40a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 --2- 172.21.15.118:0/2234332939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec40a9bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbec406f050 tx=0x7fbeac02b840 comp rx=0 tx=0).stop 2024-03-08T20:38:52.079 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 -- 172.21.15.118:0/2234332939 shutdown_connections 2024-03-08T20:38:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 --2- 172.21.15.118:0/2234332939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec40a9bc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 --2- 172.21.15.118:0/2234332939 >> v2:172.21.15.144:3300/0 conn(0x7fbec40c1020 0x7fbec40c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 -- 172.21.15.118:0/2234332939 >> 172.21.15.118:0/2234332939 conn(0x7fbec40a8cb0 msgr2=0x7fbec406ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 -- 172.21.15.118:0/2234332939 shutdown_connections 2024-03-08T20:38:52.080 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.078+0000 7fbec8c00640 1 -- 172.21.15.118:0/2234332939 wait complete. 2024-03-08T20:38:52.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.080+0000 7fbec8c00640 1 Processor -- start 2024-03-08T20:38:52.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.080+0000 7fbec8c00640 1 -- start start 2024-03-08T20:38:52.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbec406e000 0x7fbec41ea980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec4072a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbec40c1020 0x7fbec41ee660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40aa100 con 0x7fbec40a9760 2024-03-08T20:38:52.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4153860 con 0x7fbec406e000 2024-03-08T20:38:52.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec8c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec406eb80 con 0x7fbec40c1020 2024-03-08T20:38:52.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbeb9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec4072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbeb9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec4072a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44314/0 (socket says 172.21.15.118:44314) 2024-03-08T20:38:52.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbeb9400640 1 -- 172.21.15.118:0/4192772810 learned_addr learned my addr 172.21.15.118:0/4192772810 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:52.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.081+0000 7fbec1e00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbec406e000 0x7fbec41ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbec2800640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbec40c1020 0x7fbec41ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 -- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbec40c1020 msgr2=0x7fbec41ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbec40c1020 0x7fbec41ee660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 -- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbec406e000 msgr2=0x7fbec41ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbec406e000 0x7fbec41ea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4072f80 con 0x7fbec40a9760 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbeb9400640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec4072a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbeac02be50 tx=0x7fbeac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac032630 con 0x7fbec40a9760 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac0327d0 con 0x7fbec40a9760 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac032ba0 con 0x7fbec40a9760 2024-03-08T20:38:52.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec4143800 con 0x7fbec40a9760 2024-03-08T20:38:52.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.082+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec4149e90 con 0x7fbec40a9760 2024-03-08T20:38:52.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.083+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbec4142cf0 con 0x7fbec40a9760 2024-03-08T20:38:52.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.085+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbeac04c020 con 0x7fbec40a9760 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.085+0000 7fbebaa00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbea006bbd0 0x7fbea006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbeac02f020 con 0x7fbec40a9760 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbec1e00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbea006bbd0 0x7fbea006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbebaa00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7fbea00755f0 0x7fbea0077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbeac033e90 con 0x7fbea00755f0 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeac0ad150 con 0x7fbec40a9760 2024-03-08T20:38:52.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbec2800640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7fbea00755f0 0x7fbea0077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.086+0000 7fbec1e00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbea006bbd0 0x7fbea006e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40099c0 tx=0x7fbeb4003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.087+0000 7fbec2800640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7fbea00755f0 0x7fbea0077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.087+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== osd.1 v2:172.21.15.118:6808/1158609225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbeac033e90 con 0x7fbea00755f0 2024-03-08T20:38:52.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.102+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 --> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbec40aa3e0 con 0x7fbea00755f0 2024-03-08T20:38:52.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.102+0000 7fbebaa00640 1 -- 172.21.15.118:0/4192772810 <== osd.1 v2:172.21.15.118:6808/1158609225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbec40aa3e0 con 0x7fbea00755f0 2024-03-08T20:38:52.102 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:52.103 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:52.103 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:52.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7fbea00755f0 msgr2=0x7fbea0077a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6808/1158609225,v1:172.21.15.118:6810/1158609225] conn(0x7fbea00755f0 0x7fbea0077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbea006bbd0 msgr2=0x7fbea006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbea006bbd0 0x7fbea006e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40099c0 tx=0x7fbeb4003990 comp rx=0 tx=0).stop 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 msgr2=0x7fbec4072a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 --2- 172.21.15.118:0/4192772810 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbec40a9760 0x7fbec4072a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbeac02be50 tx=0x7fbeac0046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec2800640 1 -- 172.21.15.118:0/4192772810 reap_dead start 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 shutdown_connections 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 >> 172.21.15.118:0/4192772810 conn(0x7fbec40a8cb0 msgr2=0x7fbec406ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 shutdown_connections 2024-03-08T20:38:52.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.103+0000 7fbec8c00640 1 -- 172.21.15.118:0/4192772810 wait complete. 2024-03-08T20:38:52.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-08T20:38:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.327+0000 7f9148c00640 1 Processor -- start 2024-03-08T20:38:52.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.327+0000 7f9148c00640 1 -- start start 2024-03-08T20:38:52.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.328+0000 7f9148c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91440c2750 0x7f91440c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.328+0000 7f9148c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f914406e6a0 0x7f914406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.328+0000 7f9148c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9144155d20 con 0x7f91440c3970 2024-03-08T20:38:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.328+0000 7f9148c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91440c34e0 con 0x7f914406e6a0 2024-03-08T20:38:52.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.328+0000 7f9148c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9144156000 con 0x7f91440c2750 2024-03-08T20:38:52.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f914406e6a0 0x7f914406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f914406e6a0 0x7f914406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44320/0 (socket says 172.21.15.118:44320) 2024-03-08T20:38:52.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 -- 172.21.15.118:0/3698236428 learned_addr learned my addr 172.21.15.118:0/3698236428 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:52.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9141e00640 1 --2- 172.21.15.118:0/3698236428 >> v2:172.21.15.144:3300/0 conn(0x7f91440c2750 0x7f91440c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 -- 172.21.15.118:0/3698236428 >> v2:172.21.15.144:3300/0 conn(0x7f91440c2750 msgr2=0x7f91440c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:52.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 --2- 172.21.15.118:0/3698236428 >> v2:172.21.15.144:3300/0 conn(0x7f91440c2750 0x7f91440c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 -- 172.21.15.118:0/3698236428 >> v1:172.21.15.144:6789/0 conn(0x7f91440c3970 legacy=0x7f9144072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.329+0000 7f9142800640 1 -- 172.21.15.118:0/3698236428 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440c3170 con 0x7f914406e6a0 2024-03-08T20:38:52.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.330+0000 7f9142800640 1 --2- 172.21.15.118:0/3698236428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f914406e6a0 0x7f914406eb30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f914406f450 tx=0x7f913c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2014b9ad6101d736 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9141400640 1 -- 172.21.15.118:0/3698236428 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c034070 con 0x7f914406e6a0 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9141400640 1 -- 172.21.15.118:0/3698236428 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c030860 con 0x7f914406e6a0 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9141400640 1 -- 172.21.15.118:0/3698236428 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c030c30 con 0x7f914406e6a0 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9148c00640 1 -- 172.21.15.118:0/3698236428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f914406e6a0 msgr2=0x7f914406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9148c00640 1 --2- 172.21.15.118:0/3698236428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f914406e6a0 0x7f914406eb30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f914406f450 tx=0x7f913c02b9a0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9148c00640 1 -- 172.21.15.118:0/3698236428 shutdown_connections 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.331+0000 7f9148c00640 1 --2- 172.21.15.118:0/3698236428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f914406e6a0 0x7f914406eb30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.332+0000 7f9148c00640 1 --2- 172.21.15.118:0/3698236428 >> v2:172.21.15.144:3300/0 conn(0x7f91440c2750 0x7f91440c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.332+0000 7f9148c00640 1 -- 172.21.15.118:0/3698236428 >> 172.21.15.118:0/3698236428 conn(0x7f91440c6760 msgr2=0x7f91440c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.332+0000 7f9148c00640 1 -- 172.21.15.118:0/3698236428 shutdown_connections 2024-03-08T20:38:52.333 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.332+0000 7f9148c00640 1 -- 172.21.15.118:0/3698236428 wait complete. 2024-03-08T20:38:52.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.333+0000 7f9148c00640 1 Processor -- start 2024-03-08T20:38:52.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.333+0000 7f9148c00640 1 -- start start 2024-03-08T20:38:52.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 0x7f91441dd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.335 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 0x7f91440aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144151f90 con 0x7f91440c3970 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9144151e10 con 0x7f91440c2750 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.334+0000 7f9148c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9144155250 con 0x7f914406e6a0 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44336/0 (socket says 172.21.15.118:44336) 2024-03-08T20:38:52.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 -- 172.21.15.118:0/474890586 learned_addr learned my addr 172.21.15.118:0/474890586 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9139400640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 0x7f91440aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9141e00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 0x7f91441dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 -- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 msgr2=0x7f91441dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 0x7f91441dd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 -- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 msgr2=0x7f91440aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 0x7f91440aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.337 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 -- 172.21.15.118:0/474890586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440c0290 con 0x7f91440c3970 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9139400640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 0x7f91440aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9141e00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 0x7f91441dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.335+0000 7f9142800640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f913c009960 tx=0x7f913c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.336+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c048070 con 0x7f91440c3970 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.336+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c030660 con 0x7f91440c3970 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.336+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c034040 con 0x7f91440c3970 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.336+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91441e9350 con 0x7f91440c3970 2024-03-08T20:38:52.338 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.336+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91440ac030 con 0x7f91440c3970 2024-03-08T20:38:52.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.337+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9144074a40 con 0x7f91440c3970 2024-03-08T20:38:52.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.338+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f913c04b070 con 0x7f91440c3970 2024-03-08T20:38:52.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.339+0000 7f913aa00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 0x7f912006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.339+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f913c0acdb0 con 0x7f91440c3970 2024-03-08T20:38:52.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.340+0000 7f9141e00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 0x7f912006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.340+0000 7f9141e00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 0x7f912006e0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9134007520 tx=0x7f913400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.343 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.344+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f913c07b650 con 0x7f91440c3970 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.543+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f91440c52b0 con 0x7f912006bc00 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.544+0000 7f913aa00640 1 -- 172.21.15.118:0/474890586 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91440c52b0 con 0x7f912006bc00 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 1 to deep-scrub 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.546+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 msgr2=0x7f912006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.546+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 0x7f912006e0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9134007520 tx=0x7f913400b040 comp rx=0 tx=0).stop 2024-03-08T20:38:52.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 msgr2=0x7f91440aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f913c009960 tx=0x7f913c004730 comp rx=0 tx=0).stop 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 shutdown_connections 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f912006bc00 0x7f912006e0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f91440c3970 0x7f91440aaa80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91440c2750 0x7f91440aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 --2- 172.21.15.118:0/474890586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914406e6a0 0x7f91441dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 >> 172.21.15.118:0/474890586 conn(0x7f91440c6760 msgr2=0x7f9144152110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 shutdown_connections 2024-03-08T20:38:52.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.547+0000 7f9148c00640 1 -- 172.21.15.118:0/474890586 wait complete. 2024-03-08T20:38:52.565 INFO:tasks.ceph:Scrubbing osd.2 2024-03-08T20:38:52.566 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:52.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.787+0000 7f02ef600640 1 Processor -- start 2024-03-08T20:38:52.787 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.787+0000 7f02ef600640 1 -- start start 2024-03-08T20:38:52.789 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ef600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02e814e800 0x7f02e806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ef600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 0x7f02e806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ef600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e806e120 con 0x7f02e8151fe0 2024-03-08T20:38:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ef600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80ad280 con 0x7f02e814e800 2024-03-08T20:38:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ef600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806de40 con 0x7f02e806d7b0 2024-03-08T20:38:52.790 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ecc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02e814e800 0x7f02e806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ecc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02e814e800 0x7f02e806f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44338/0 (socket says 172.21.15.118:44338) 2024-03-08T20:38:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.789+0000 7f02ecc00640 1 -- 172.21.15.118:0/1495102345 learned_addr learned my addr 172.21.15.118:0/1495102345 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ed600640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 0x7f02e806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ecc00640 1 -- 172.21.15.118:0/1495102345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 msgr2=0x7f02e806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:52.791 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ecc00640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 0x7f02e806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02e7400640 1 -- 172.21.15.118:0/1495102345 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691520283 0 0) 0x7f02e806e120 con 0x7f02e8151fe0 2024-03-08T20:38:52.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ecc00640 1 -- 172.21.15.118:0/1495102345 >> v1:172.21.15.118:6789/0 conn(0x7f02e8151fe0 legacy=0x7f02e80a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ecc00640 1 -- 172.21.15.118:0/1495102345 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8151500 con 0x7f02e814e800 2024-03-08T20:38:52.792 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.790+0000 7f02ed600640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 0x7f02e806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:52.793 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.791+0000 7f02ecc00640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e806f600 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009870 tx=0x7f02dc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a9b6fea5b731dd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.791+0000 7f02e7400640 1 -- 172.21.15.118:0/1495102345 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc034070 con 0x7f02e814e800 2024-03-08T20:38:52.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02e7400640 1 -- 172.21.15.118:0/1495102345 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc030840 con 0x7f02e814e800 2024-03-08T20:38:52.794 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02e7400640 1 -- 172.21.15.118:0/1495102345 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc030c10 con 0x7f02e814e800 2024-03-08T20:38:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 -- 172.21.15.118:0/1495102345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 msgr2=0x7f02e806f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e806f600 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009870 tx=0x7f02dc02b980 comp rx=0 tx=0).stop 2024-03-08T20:38:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 -- 172.21.15.118:0/1495102345 shutdown_connections 2024-03-08T20:38:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e806d7b0 0x7f02e806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.795 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 --2- 172.21.15.118:0/1495102345 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e806f600 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.792+0000 7f02ef600640 1 -- 172.21.15.118:0/1495102345 >> 172.21.15.118:0/1495102345 conn(0x7f02e80719a0 msgr2=0x7f02e8071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.793+0000 7f02ef600640 1 -- 172.21.15.118:0/1495102345 shutdown_connections 2024-03-08T20:38:52.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.793+0000 7f02ef600640 1 -- 172.21.15.118:0/1495102345 wait complete. 2024-03-08T20:38:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.795+0000 7f02ef600640 1 Processor -- start 2024-03-08T20:38:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.795+0000 7f02ef600640 1 -- start start 2024-03-08T20:38:52.799 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e806d7b0 0x7f02e8155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e80c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e8151fe0 0x7f02e814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e8151ac0 con 0x7f02e814e800 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e806dbc0 con 0x7f02e806d7b0 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02ef600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80a8bd0 con 0x7f02e8151fe0 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e80c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e80c07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44350/0 (socket says 172.21.15.118:44350) 2024-03-08T20:38:52.800 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.796+0000 7f02e7e00640 1 -- 172.21.15.118:0/3333370305 learned_addr learned my addr 172.21.15.118:0/3333370305 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02ecc00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e806d7b0 0x7f02e8155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02ed600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e8151fe0 0x7f02e814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 -- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e8151fe0 msgr2=0x7f02e814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02e8151fe0 0x7f02e814fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 -- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e806d7b0 msgr2=0x7f02e8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e806d7b0 0x7f02e8155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e81ea560 con 0x7f02e814e800 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02ecc00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02e806d7b0 0x7f02e8155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:52.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.797+0000 7f02e7e00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e80c07d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c410 tx=0x7f02d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.798+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4017070 con 0x7f02e814e800 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.798+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d40035f0 con 0x7f02e814e800 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.798+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e81ea840 con 0x7f02e814e800 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.798+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d40039e0 con 0x7f02e814e800 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.798+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e81eae00 con 0x7f02e814e800 2024-03-08T20:38:52.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.799+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02e8074a40 con 0x7f02e814e800 2024-03-08T20:38:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.801+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f02d401a070 con 0x7f02e814e800 2024-03-08T20:38:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.802+0000 7f02e4c00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f02c806bc20 0x7f02c806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.802+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f02d408a180 con 0x7f02e814e800 2024-03-08T20:38:52.804 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.802+0000 7f02ecc00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f02c806bc20 0x7f02c806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.803+0000 7f02e4c00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f02c80756b0 0x7f02c8077b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.803+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02c8078220 con 0x7f02c80756b0 2024-03-08T20:38:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.803+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02d4091050 con 0x7f02e814e800 2024-03-08T20:38:52.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.803+0000 7f02ed600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f02c80756b0 0x7f02c8077b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.803+0000 7f02ecc00640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f02c806bc20 0x7f02c806e0e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f02dc036000 tx=0x7f02dc03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.804+0000 7f02ed600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f02c80756b0 0x7f02c8077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:52.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.804+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== osd.2 v2:172.21.15.118:6809/1361206557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f02c8078220 con 0x7f02c80756b0 2024-03-08T20:38:52.818 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.819+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 --> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02e80a9b90 con 0x7f02c80756b0 2024-03-08T20:38:52.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02e4c00640 1 -- 172.21.15.118:0/3333370305 <== osd.2 v2:172.21.15.118:6809/1361206557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f02e80a9b90 con 0x7f02c80756b0 2024-03-08T20:38:52.819 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:52.820 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:52.820 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f02c80756b0 msgr2=0x7f02c8077b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6809/1361206557,v1:172.21.15.118:6811/1361206557] conn(0x7f02c80756b0 0x7f02c8077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f02c806bc20 msgr2=0x7f02c806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f02c806bc20 0x7f02c806e0e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f02dc036000 tx=0x7f02dc03b040 comp rx=0 tx=0).stop 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 msgr2=0x7f02e80c07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.820+0000 7f02ef600640 1 --2- 172.21.15.118:0/3333370305 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02e814e800 0x7f02e80c07d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f02d400c410 tx=0x7f02d400c8d0 comp rx=0 tx=0).stop 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.821+0000 7f02ed600640 1 -- 172.21.15.118:0/3333370305 reap_dead start 2024-03-08T20:38:52.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.821+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 shutdown_connections 2024-03-08T20:38:52.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.821+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 >> 172.21.15.118:0/3333370305 conn(0x7f02e80719a0 msgr2=0x7f02e80a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:52.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.821+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 shutdown_connections 2024-03-08T20:38:52.822 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:52.821+0000 7f02ef600640 1 -- 172.21.15.118:0/3333370305 wait complete. 2024-03-08T20:38:52.837 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-08T20:38:53.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.044+0000 7f700ca00640 1 Processor -- start 2024-03-08T20:38:53.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.044+0000 7f700ca00640 1 -- start start 2024-03-08T20:38:53.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.045+0000 7f700ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f700814ee30 0x7f70080c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.045+0000 7f700ca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 0x7f70080c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.045+0000 7f700ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080c7810 con 0x7f7008156350 2024-03-08T20:38:53.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.045+0000 7f700ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7008156800 con 0x7f700814ee30 2024-03-08T20:38:53.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.045+0000 7f700ca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080c7af0 con 0x7f7008155900 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.046+0000 7f7006800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f700814ee30 0x7f70080c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.046+0000 7f7006800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f700814ee30 0x7f70080c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48848/0 (socket says 172.21.15.118:48848) 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.046+0000 7f7006800640 1 -- 172.21.15.118:0/2169323044 learned_addr learned my addr 172.21.15.118:0/2169323044 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.046+0000 7f7007200640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 0x7f70080c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7005400640 1 -- 172.21.15.118:0/2169323044 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204719430 0 0) 0x7f70080c7810 con 0x7f7008156350 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7005400640 1 -- 172.21.15.118:0/2169323044 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fec003520 con 0x7f7008156350 2024-03-08T20:38:53.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7006800640 1 -- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 msgr2=0x7f70080c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:53.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7006800640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 0x7f70080c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7006800640 1 -- 172.21.15.118:0/2169323044 >> v1:172.21.15.144:6789/0 conn(0x7f7008156350 legacy=0x7f700806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7006800640 1 -- 172.21.15.118:0/2169323044 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700806c430 con 0x7f700814ee30 2024-03-08T20:38:53.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.047+0000 7f7007200640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 0x7f70080c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:53.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.048+0000 7f7006800640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700814ee30 0x7f70080c7150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cceea3b95ac6a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.049+0000 7f7005400640 1 -- 172.21.15.118:0/2169323044 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8035020 con 0x7f700814ee30 2024-03-08T20:38:53.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.049+0000 7f7005400640 1 -- 172.21.15.118:0/2169323044 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8031640 con 0x7f700814ee30 2024-03-08T20:38:53.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.049+0000 7f7005400640 1 -- 172.21.15.118:0/2169323044 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff802d040 con 0x7f700814ee30 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.049+0000 7f700ca00640 1 -- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700814ee30 msgr2=0x7f70080c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.049+0000 7f700ca00640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700814ee30 0x7f70080c7150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff802b8f0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 -- 172.21.15.118:0/2169323044 shutdown_connections 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7008155900 0x7f70080c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 --2- 172.21.15.118:0/2169323044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700814ee30 0x7f70080c7150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 -- 172.21.15.118:0/2169323044 >> 172.21.15.118:0/2169323044 conn(0x7f70080ac2d0 msgr2=0x7f70080ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 -- 172.21.15.118:0/2169323044 shutdown_connections 2024-03-08T20:38:53.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.050+0000 7f700ca00640 1 -- 172.21.15.118:0/2169323044 wait complete. 2024-03-08T20:38:53.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.051+0000 7f700ca00640 1 Processor -- start 2024-03-08T20:38:53.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.051+0000 7f700ca00640 1 -- start start 2024-03-08T20:38:53.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f700814ee30 0x7f70080c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7008156350 0x7f70081eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7008155d50 con 0x7f7008155900 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700806c9f0 con 0x7f7008156350 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.052+0000 7f700ca00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700814f210 con 0x7f700814ee30 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44352/0 (socket says 172.21.15.118:44352) 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 -- 172.21.15.118:0/2877443998 learned_addr learned my addr 172.21.15.118:0/2877443998 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7006800640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f700814ee30 0x7f70080c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7007200640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7008156350 0x7f70081eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 -- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f700814ee30 msgr2=0x7f70080c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f700814ee30 0x7f70080c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 -- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7008156350 msgr2=0x7f70081eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7008156350 0x7f70081eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 -- 172.21.15.118:0/2877443998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700814adc0 con 0x7f7008155900 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.053+0000 7f7005e00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c420 tx=0x7f6ff400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.054+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4017070 con 0x7f7008155900 2024-03-08T20:38:53.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.054+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff40052d0 con 0x7f7008155900 2024-03-08T20:38:53.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.054+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4003810 con 0x7f7008155900 2024-03-08T20:38:53.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.054+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70080c0420 con 0x7f7008155900 2024-03-08T20:38:53.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.054+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70080c09e0 con 0x7f7008155900 2024-03-08T20:38:53.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.055+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080c0be0 con 0x7f7008155900 2024-03-08T20:38:53.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.057+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6ff401a070 con 0x7f7008155900 2024-03-08T20:38:53.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.057+0000 7f6ffea00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 0x7f6fe806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.058+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6ff408a050 con 0x7f7008155900 2024-03-08T20:38:53.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.058+0000 7f7006800640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 0x7f6fe806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.058+0000 7f7006800640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 0x7f6fe806e0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8036000 tx=0x7f6ff803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.062+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f70080c0be0 con 0x7f7008155900 2024-03-08T20:38:53.371 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.371+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f700814b0a0 con 0x7f6fe806bc20 2024-03-08T20:38:53.372 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.373+0000 7f6ffea00640 1 -- 172.21.15.118:0/2877443998 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f700814b0a0 con 0x7f6fe806bc20 2024-03-08T20:38:53.372 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 2 to deep-scrub 2024-03-08T20:38:53.378 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.378+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 msgr2=0x7f6fe806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.378+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 0x7f6fe806e0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8036000 tx=0x7f6ff803c040 comp rx=0 tx=0).stop 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.378+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 msgr2=0x7f7008152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.378+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6ff400c420 tx=0x7f6ff400c8e0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 shutdown_connections 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f6fe806bc20 0x7f6fe806e0e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7008156350 0x7f70081eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7008155900 0x7f7008152430 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.379 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 --2- 172.21.15.118:0/2877443998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f700814ee30 0x7f70080c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 >> 172.21.15.118:0/2877443998 conn(0x7f70080ac2d0 msgr2=0x7f70080aaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:53.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 shutdown_connections 2024-03-08T20:38:53.380 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.379+0000 7f700ca00640 1 -- 172.21.15.118:0/2877443998 wait complete. 2024-03-08T20:38:53.403 INFO:tasks.ceph:Scrubbing osd.3 2024-03-08T20:38:53.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:53.668 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.669+0000 7fe117e00640 1 Processor -- start 2024-03-08T20:38:53.669 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.669+0000 7fe117e00640 1 -- start start 2024-03-08T20:38:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.671+0000 7fe117e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 0x7fe11814af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.671+0000 7fe117e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.671 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.671+0000 7fe117e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1180aa860 con 0x7fe1180c0e80 2024-03-08T20:38:53.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.671+0000 7fe117e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11806f190 con 0x7fe11806b830 2024-03-08T20:38:53.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.671+0000 7fe117e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11806f710 con 0x7fe1180c2f10 2024-03-08T20:38:53.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.672+0000 7fe116000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 0x7fe11814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.673 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.672+0000 7fe117400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.672+0000 7fe117400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:36364/0 (socket says 172.21.15.118:36364) 2024-03-08T20:38:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.672+0000 7fe117400640 1 -- 172.21.15.118:0/3726899757 learned_addr learned my addr 172.21.15.118:0/3726899757 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.672+0000 7fe116a00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe1180c0e80 0x7fe1180c63f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34562/0 (socket says 172.21.15.118:34562) 2024-03-08T20:38:53.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.673+0000 7fe117400640 1 -- 172.21.15.118:0/3726899757 >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 msgr2=0x7fe11814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.673+0000 7fe115600640 1 -- 172.21.15.118:0/3726899757 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011417016 0 0) 0x7fe1180aa860 con 0x7fe1180c0e80 2024-03-08T20:38:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.674+0000 7fe117400640 1 --2- 172.21.15.118:0/3726899757 >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 0x7fe11814af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.674+0000 7fe117400640 1 -- 172.21.15.118:0/3726899757 >> v1:172.21.15.118:6789/0 conn(0x7fe1180c0e80 legacy=0x7fe1180c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.675 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.674+0000 7fe117400640 1 -- 172.21.15.118:0/3726899757 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118151d20 con 0x7fe1180c2f10 2024-03-08T20:38:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.674+0000 7fe116000640 1 --2- 172.21.15.118:0/3726899757 >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 0x7fe11814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.676+0000 7fe117400640 1 --2- 172.21.15.118:0/3726899757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe110009e50 tx=0x7fe11002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c601fc3c40a875b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.677+0000 7fe115600640 1 -- 172.21.15.118:0/3726899757 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11002cb00 con 0x7fe1180c2f10 2024-03-08T20:38:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.677+0000 7fe115600640 1 -- 172.21.15.118:0/3726899757 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11002cca0 con 0x7fe1180c2f10 2024-03-08T20:38:53.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.677+0000 7fe115600640 1 -- 172.21.15.118:0/3726899757 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110034610 con 0x7fe1180c2f10 2024-03-08T20:38:53.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 -- 172.21.15.118:0/3726899757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 msgr2=0x7fe1180c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 --2- 172.21.15.118:0/3726899757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe110009e50 tx=0x7fe11002bf60 comp rx=0 tx=0).stop 2024-03-08T20:38:53.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 -- 172.21.15.118:0/3726899757 shutdown_connections 2024-03-08T20:38:53.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 --2- 172.21.15.118:0/3726899757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c2f10 0x7fe1180c3380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 --2- 172.21.15.118:0/3726899757 >> v2:172.21.15.118:3300/0 conn(0x7fe11806b830 0x7fe11814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 -- 172.21.15.118:0/3726899757 >> 172.21.15.118:0/3726899757 conn(0x7fe11806ad10 msgr2=0x7fe11806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:53.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.678+0000 7fe117e00640 1 -- 172.21.15.118:0/3726899757 shutdown_connections 2024-03-08T20:38:53.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.679+0000 7fe117e00640 1 -- 172.21.15.118:0/3726899757 wait complete. 2024-03-08T20:38:53.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.681+0000 7fe117e00640 1 Processor -- start 2024-03-08T20:38:53.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 -- start start 2024-03-08T20:38:53.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11806b830 0x7fe11813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c0e80 0x7fe11813e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 0x7fe11814b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c38c0 con 0x7fe1180c2f10 2024-03-08T20:38:53.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180c26c0 con 0x7fe11806b830 2024-03-08T20:38:53.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.682+0000 7fe117e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180aae70 con 0x7fe1180c0e80 2024-03-08T20:38:53.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.683+0000 7fe117400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 0x7fe11814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.683+0000 7fe117400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 0x7fe11814b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44372/0 (socket says 172.21.15.118:44372) 2024-03-08T20:38:53.684 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.683+0000 7fe117400640 1 -- 172.21.15.118:0/879953065 learned_addr learned my addr 172.21.15.118:0/879953065 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:53.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.684+0000 7fe116a00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11806b830 0x7fe11813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.684+0000 7fe116000640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c0e80 0x7fe11813e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.684+0000 7fe116000640 1 -- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11806b830 msgr2=0x7fe11813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.684+0000 7fe116000640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11806b830 0x7fe11813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.684+0000 7fe116000640 1 -- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 msgr2=0x7fe11814b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.685+0000 7fe116000640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 0x7fe11814b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.685+0000 7fe116000640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118154880 con 0x7fe1180c0e80 2024-03-08T20:38:53.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.685+0000 7fe117400640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1180c2f10 0x7fe11814b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:53.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.685+0000 7fe116000640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c0e80 0x7fe11813e700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe10400e870 tx=0x7fe10400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.686+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104017070 con 0x7fe1180c0e80 2024-03-08T20:38:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.686+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10400c940 con 0x7fe1180c0e80 2024-03-08T20:38:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.686+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10400cd10 con 0x7fe1180c0e80 2024-03-08T20:38:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.686+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe118154b60 con 0x7fe1180c0e80 2024-03-08T20:38:53.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.686+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe118155120 con 0x7fe1180c0e80 2024-03-08T20:38:53.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.688+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0f0001030 con 0x7fe1180c0e80 2024-03-08T20:38:53.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.691+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe10401a070 con 0x7fe1180c0e80 2024-03-08T20:38:53.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe10ea00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe0f806bc50 0x7fe0f806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe10408add0 con 0x7fe1180c0e80 2024-03-08T20:38:53.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe10ea00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7fe0f80756e0 0x7fe0f8077b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:53.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe116a00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe0f806bc50 0x7fe0f806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0f8078250 con 0x7fe0f80756e0 2024-03-08T20:38:53.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.693+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe10408b180 con 0x7fe1180c0e80 2024-03-08T20:38:53.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.694+0000 7fe117400640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7fe0f80756e0 0x7fe0f8077b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:53.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.694+0000 7fe116a00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe0f806bc50 0x7fe0f806e110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe108000f60 tx=0x7fe108007d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.695+0000 7fe117400640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7fe0f80756e0 0x7fe0f8077b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:53.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.696+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== osd.3 v2:172.21.15.118:6824/2572185717 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe0f8078250 con 0x7fe0f80756e0 2024-03-08T20:38:53.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.730+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 --> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0f0002e30 con 0x7fe0f80756e0 2024-03-08T20:38:53.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.731+0000 7fe10ea00640 1 -- 172.21.15.118:0/879953065 <== osd.3 v2:172.21.15.118:6824/2572185717 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe0f0002e30 con 0x7fe0f80756e0 2024-03-08T20:38:53.731 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:53.731 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:53.731 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:53.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.731+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7fe0f80756e0 msgr2=0x7fe0f8077b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.731+0000 7fe117e00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6824/2572185717,v1:172.21.15.118:6825/2572185717] conn(0x7fe0f80756e0 0x7fe0f8077b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:53.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.733+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe0f806bc50 msgr2=0x7fe0f806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.733+0000 7fe117e00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe0f806bc50 0x7fe0f806e110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe108000f60 tx=0x7fe108007d00 comp rx=0 tx=0).stop 2024-03-08T20:38:53.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.733+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c0e80 msgr2=0x7fe11813e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:53.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.733+0000 7fe117e00640 1 --2- 172.21.15.118:0/879953065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1180c0e80 0x7fe11813e700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe10400e870 tx=0x7fe10400ed30 comp rx=0 tx=0).stop 2024-03-08T20:38:53.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.734+0000 7fe117400640 1 -- 172.21.15.118:0/879953065 reap_dead start 2024-03-08T20:38:53.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.734+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 shutdown_connections 2024-03-08T20:38:53.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.735+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 >> 172.21.15.118:0/879953065 conn(0x7fe11806ad10 msgr2=0x7fe11806b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:53.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.735+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 shutdown_connections 2024-03-08T20:38:53.735 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:53.735+0000 7fe117e00640 1 -- 172.21.15.118:0/879953065 wait complete. 2024-03-08T20:38:53.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-08T20:38:54.035 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.036+0000 7fbda4c00640 1 Processor -- start 2024-03-08T20:38:54.036 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.036+0000 7fbda4c00640 1 -- start start 2024-03-08T20:38:54.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbda4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbda00c8bd0 0x7fbda00c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbda4c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda00c71d0 con 0x7fbda01526e0 2024-03-08T20:38:54.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbda4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda00c74b0 con 0x7fbda00c8750 2024-03-08T20:38:54.037 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbda4c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda0155250 con 0x7fbda00c8bd0 2024-03-08T20:38:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbd9de00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbda01526e0 0x7fbda0158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34564/0 (socket says 172.21.15.118:34564) 2024-03-08T20:38:54.038 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbd9de00640 1 -- 172.21.15.118:0/349618900 learned_addr learned my addr 172.21.15.118:0/349618900 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.038+0000 7fbd9e800640 1 --2- 172.21.15.118:0/349618900 >> v2:172.21.15.118:3300/0 conn(0x7fbda00c8bd0 0x7fbda00c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.039+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722872236 0 0) 0x7fbda00c71d0 con 0x7fbda01526e0 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.039+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd84003520 con 0x7fbda01526e0 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.039+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100672442 0 0) 0x7fbda00c74b0 con 0x7fbda00c8750 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.039+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda00c71d0 con 0x7fbda00c8750 2024-03-08T20:38:54.039 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.040+0000 7fbd9e800640 1 -- 172.21.15.118:0/349618900 >> v1:172.21.15.144:6789/0 conn(0x7fbda00c8750 legacy=0x7fbda01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.040+0000 7fbd9e800640 1 -- 172.21.15.118:0/349618900 >> v1:172.21.15.118:6789/0 conn(0x7fbda01526e0 legacy=0x7fbda0158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.040+0000 7fbd9e800640 1 -- 172.21.15.118:0/349618900 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00c7790 con 0x7fbda00c8bd0 2024-03-08T20:38:54.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.040+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60664390 0 0) 0x7fbd84003520 con 0x7fbda01526e0 2024-03-08T20:38:54.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.041+0000 7fbd9e800640 1 --2- 172.21.15.118:0/349618900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8bd0 0x7fbda00c5140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbda01553d0 tx=0x7fbd9802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7952bcd06c1446 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.041 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.042+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98039070 con 0x7fbda00c8bd0 2024-03-08T20:38:54.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.042+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9802c8a0 con 0x7fbda00c8bd0 2024-03-08T20:38:54.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.042+0000 7fbd9ca00640 1 -- 172.21.15.118:0/349618900 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90001670 con 0x7fbda00c8bd0 2024-03-08T20:38:54.042 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.043+0000 7fbda4c00640 1 -- 172.21.15.118:0/349618900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8bd0 msgr2=0x7fbda00c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.043+0000 7fbda4c00640 1 --2- 172.21.15.118:0/349618900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8bd0 0x7fbda00c5140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbda01553d0 tx=0x7fbd9802bd70 comp rx=0 tx=0).stop 2024-03-08T20:38:54.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.044+0000 7fbda4c00640 1 -- 172.21.15.118:0/349618900 shutdown_connections 2024-03-08T20:38:54.043 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.044+0000 7fbda4c00640 1 --2- 172.21.15.118:0/349618900 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8bd0 0x7fbda00c5140 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.044+0000 7fbda4c00640 1 -- 172.21.15.118:0/349618900 >> 172.21.15.118:0/349618900 conn(0x7fbda0072c30 msgr2=0x7fbda00ac390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:54.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.044+0000 7fbda4c00640 1 -- 172.21.15.118:0/349618900 shutdown_connections 2024-03-08T20:38:54.044 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.044+0000 7fbda4c00640 1 -- 172.21.15.118:0/349618900 wait complete. 2024-03-08T20:38:54.045 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.046+0000 7fbda4c00640 1 Processor -- start 2024-03-08T20:38:54.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.047+0000 7fbda4c00640 1 -- start start 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.047+0000 7fbda4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.047+0000 7fbda4c00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbda00c8bd0 0x7fbda00c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.047+0000 7fbda4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda01526e0 0x7fbda00c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbda4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0155f70 con 0x7fbda00c8750 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbda4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0155df0 con 0x7fbda01526e0 2024-03-08T20:38:54.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbda4c00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda00c5680 con 0x7fbda00c8bd0 2024-03-08T20:38:54.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44392/0 (socket says 172.21.15.118:44392) 2024-03-08T20:38:54.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda01526e0 0x7fbda00c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 -- 172.21.15.118:0/3821501276 learned_addr learned my addr 172.21.15.118:0/3821501276 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 -- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbda00c8bd0 msgr2=0x7fbda00c3910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbda00c8bd0 0x7fbda00c3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 -- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda01526e0 msgr2=0x7fbda00c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda01526e0 0x7fbda00c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.048+0000 7fbd9de00640 1 -- 172.21.15.118:0/3821501276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda014c330 con 0x7fbda00c8750 2024-03-08T20:38:54.049 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.049+0000 7fbd9de00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000c780 tx=0x7fbd9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.049+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90017070 con 0x7fbda00c8750 2024-03-08T20:38:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.049+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90005af0 con 0x7fbda00c8750 2024-03-08T20:38:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.049+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90007070 con 0x7fbda00c8750 2024-03-08T20:38:54.050 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.050+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda014bd70 con 0x7fbda00c8750 2024-03-08T20:38:54.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.050+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00c1930 con 0x7fbda00c8750 2024-03-08T20:38:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.052+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda0074a40 con 0x7fbda00c8750 2024-03-08T20:38:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.053+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbd9001a070 con 0x7fbda00c8750 2024-03-08T20:38:54.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.054+0000 7fbd96000640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 0x7fbd8006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.054+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbd9008a310 con 0x7fbda00c8750 2024-03-08T20:38:54.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.055+0000 7fbd9d400640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 0x7fbd8006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.057+0000 7fbd9d400640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 0x7fbd8006e160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbda00c4260 tx=0x7fbd8c007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.065+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbd90058420 con 0x7fbda00c8750 2024-03-08T20:38:54.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.403+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbda00b0760 con 0x7fbd8006bca0 2024-03-08T20:38:54.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.403+0000 7fbd96000640 1 -- 172.21.15.118:0/3821501276 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbda00b0760 con 0x7fbd8006bca0 2024-03-08T20:38:54.403 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 3 to deep-scrub 2024-03-08T20:38:54.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 msgr2=0x7fbd8006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 0x7fbd8006e160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbda00c4260 tx=0x7fbd8c007990 comp rx=0 tx=0).stop 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 msgr2=0x7fbda01eb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000c780 tx=0x7fbd9000cc40 comp rx=0 tx=0).stop 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 shutdown_connections 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbd8006bca0 0x7fbd8006e160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda01526e0 0x7fbda00c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbda00c8bd0 0x7fbda00c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 --2- 172.21.15.118:0/3821501276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbda00c8750 0x7fbda01eb480 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.411+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 >> 172.21.15.118:0/3821501276 conn(0x7fbda0072c30 msgr2=0x7fbda0150410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:54.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.412+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 shutdown_connections 2024-03-08T20:38:54.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.412+0000 7fbda4c00640 1 -- 172.21.15.118:0/3821501276 wait complete. 2024-03-08T20:38:54.439 INFO:tasks.ceph:Scrubbing osd.4 2024-03-08T20:38:54.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:54.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.702+0000 7f0d7a000640 1 Processor -- start 2024-03-08T20:38:54.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.702+0000 7f0d7a000640 1 -- start start 2024-03-08T20:38:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d7a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d740c7180 0x7f0d740c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d7a000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d740b0900 con 0x7f0d740c1b90 2024-03-08T20:38:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d7a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d74155280 con 0x7f0d741523e0 2024-03-08T20:38:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d7a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74155560 con 0x7f0d740c7180 2024-03-08T20:38:54.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d73e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0d740c1b90 0x7f0d740c1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34568/0 (socket says 172.21.15.118:34568) 2024-03-08T20:38:54.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d72a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d740c7180 0x7f0d740c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.704+0000 7f0d73e00640 1 -- 172.21.15.118:0/1609971844 learned_addr learned my addr 172.21.15.118:0/1609971844 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:54.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.705+0000 7f0d72a00640 1 -- 172.21.15.118:0/1609971844 >> v1:172.21.15.144:6789/0 conn(0x7f0d741523e0 legacy=0x7f0d740b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:54.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.705+0000 7f0d72a00640 1 -- 172.21.15.118:0/1609971844 >> v1:172.21.15.118:6789/0 conn(0x7f0d740c1b90 legacy=0x7f0d740c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.705+0000 7f0d72a00640 1 -- 172.21.15.118:0/1609971844 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74155840 con 0x7f0d740c7180 2024-03-08T20:38:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.707+0000 7f0d72a00640 1 --2- 172.21.15.118:0/1609971844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d740c75e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac3ea307d7aedd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.707+0000 7f0d72000640 1 -- 172.21.15.118:0/1609971844 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c034070 con 0x7f0d740c7180 2024-03-08T20:38:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.707+0000 7f0d72000640 1 -- 172.21.15.118:0/1609971844 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c030610 con 0x7f0d740c7180 2024-03-08T20:38:54.707 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.707+0000 7f0d72000640 1 -- 172.21.15.118:0/1609971844 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0309e0 con 0x7f0d740c7180 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 -- 172.21.15.118:0/1609971844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 msgr2=0x7f0d740c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 --2- 172.21.15.118:0/1609971844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d740c75e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02b960 comp rx=0 tx=0).stop 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 -- 172.21.15.118:0/1609971844 shutdown_connections 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 --2- 172.21.15.118:0/1609971844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d740c75e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 -- 172.21.15.118:0/1609971844 >> 172.21.15.118:0/1609971844 conn(0x7f0d74072a70 msgr2=0x7f0d7406cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:54.708 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 -- 172.21.15.118:0/1609971844 shutdown_connections 2024-03-08T20:38:54.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.708+0000 7f0d7a000640 1 -- 172.21.15.118:0/1609971844 wait complete. 2024-03-08T20:38:54.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.711+0000 7f0d7a000640 1 Processor -- start 2024-03-08T20:38:54.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.711+0000 7f0d7a000640 1 -- start start 2024-03-08T20:38:54.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 0x7f0d741eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.712 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d7414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d741523e0 0x7f0d7414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740c26d0 con 0x7f0d740c1b90 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741527c0 con 0x7f0d740c7180 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.712+0000 7f0d7a000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740c2850 con 0x7f0d741523e0 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 0x7f0d741eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d741523e0 0x7f0d7414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 0x7f0d741eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44402/0 (socket says 172.21.15.118:44402) 2024-03-08T20:38:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d7414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 -- 172.21.15.118:0/1009454577 learned_addr learned my addr 172.21.15.118:0/1009454577 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 -- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d741523e0 msgr2=0x7f0d7414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d741523e0 0x7f0d7414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 -- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 msgr2=0x7f0d7414cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d740c7180 0x7f0d7414cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.713+0000 7f0d73400640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d741dda10 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d73400640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 0x7f0d741eaa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b3f0 tx=0x7f0d6c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c015020 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c011830 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011c00 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d741eb390 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.714+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d741eb670 con 0x7f0d740c1b90 2024-03-08T20:38:54.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.715+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d74074a40 con 0x7f0d740c1b90 2024-03-08T20:38:54.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.718+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0d6c018020 con 0x7f0d740c1b90 2024-03-08T20:38:54.718 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.719+0000 7f0d6b400640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0d5006bca0 0x7f0d5006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.719+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0d6c08b310 con 0x7f0d740c1b90 2024-03-08T20:38:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.720+0000 7f0d6b400640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7f0d50075740 0x7f0d50077be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.720+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d6c018ec0 con 0x7f0d50075740 2024-03-08T20:38:54.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.720+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6c08b700 con 0x7f0d740c1b90 2024-03-08T20:38:54.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.720+0000 7f0d72a00640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0d5006bca0 0x7f0d5006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.721+0000 7f0d73e00640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7f0d50075740 0x7f0d50077be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.722+0000 7f0d72a00640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0d5006bca0 0x7f0d5006e160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c036000 tx=0x7f0d5c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.722+0000 7f0d73e00640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7f0d50075740 0x7f0d50077be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.722 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.723+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== osd.4 v2:172.21.15.144:6808/2013996799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0d6c018ec0 con 0x7f0d50075740 2024-03-08T20:38:54.748 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.749+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 --> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d740743c0 con 0x7f0d50075740 2024-03-08T20:38:54.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d6b400640 1 -- 172.21.15.118:0/1009454577 <== osd.4 v2:172.21.15.144:6808/2013996799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0d740743c0 con 0x7f0d50075740 2024-03-08T20:38:54.749 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:54.750 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:54.750 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:54.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7f0d50075740 msgr2=0x7f0d50077be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.144:6808/2013996799,v1:172.21.15.144:6809/2013996799] conn(0x7f0d50075740 0x7f0d50077be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0d5006bca0 msgr2=0x7f0d5006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f0d5006bca0 0x7f0d5006e160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c036000 tx=0x7f0d5c03b040 comp rx=0 tx=0).stop 2024-03-08T20:38:54.751 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 msgr2=0x7f0d741eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 --2- 172.21.15.118:0/1009454577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0d740c1b90 0x7f0d741eaa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b3f0 tx=0x7f0d6c00b8b0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d73e00640 1 -- 172.21.15.118:0/1009454577 reap_dead start 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 shutdown_connections 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.750+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 >> 172.21.15.118:0/1009454577 conn(0x7f0d74072a70 msgr2=0x7f0d741545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.751+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 shutdown_connections 2024-03-08T20:38:54.752 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.751+0000 7f0d7a000640 1 -- 172.21.15.118:0/1009454577 wait complete. 2024-03-08T20:38:54.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-08T20:38:54.981 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.982+0000 7fbcfbe00640 1 Processor -- start 2024-03-08T20:38:54.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.982+0000 7fbcfbe00640 1 -- start start 2024-03-08T20:38:54.982 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.983+0000 7fbcfbe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcfc14ee30 0x7fbcfc0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.983+0000 7fbcfbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbcfc155900 0x7fbcfc0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.983+0000 7fbcfbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcfc0c7810 con 0x7fbcfc156350 2024-03-08T20:38:54.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.983+0000 7fbcfbe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc156800 con 0x7fbcfc14ee30 2024-03-08T20:38:54.983 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.983+0000 7fbcfbe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc0c7af0 con 0x7fbcfc155900 2024-03-08T20:38:54.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.984+0000 7fbcfaa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcfc14ee30 0x7fbcfc0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.984 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.984+0000 7fbcfaa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbcfc14ee30 0x7fbcfc0c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44406/0 (socket says 172.21.15.118:44406) 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.984+0000 7fbcfaa00640 1 -- 172.21.15.118:0/4020048307 learned_addr learned my addr 172.21.15.118:0/4020048307 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.984+0000 7fbcfb400640 1 --2- 172.21.15.118:0/4020048307 >> v2:172.21.15.144:3300/0 conn(0x7fbcfc155900 0x7fbcfc0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.985+0000 7fbcfaa00640 1 -- 172.21.15.118:0/4020048307 >> v2:172.21.15.144:3300/0 conn(0x7fbcfc155900 msgr2=0x7fbcfc0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.985+0000 7fbcfaa00640 1 --2- 172.21.15.118:0/4020048307 >> v2:172.21.15.144:3300/0 conn(0x7fbcfc155900 0x7fbcfc0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.985+0000 7fbcfaa00640 1 -- 172.21.15.118:0/4020048307 >> v1:172.21.15.144:6789/0 conn(0x7fbcfc156350 legacy=0x7fbcfc06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.985 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.985+0000 7fbcfaa00640 1 -- 172.21.15.118:0/4020048307 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc06c430 con 0x7fbcfc14ee30 2024-03-08T20:38:54.986 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.987+0000 7fbcfaa00640 1 --2- 172.21.15.118:0/4020048307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc0c7150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c70c0 tx=0x7fbcec02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cf76cbedc37470 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.987+0000 7fbcf9600640 1 -- 172.21.15.118:0/4020048307 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec035020 con 0x7fbcfc14ee30 2024-03-08T20:38:54.987 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.988+0000 7fbcf9600640 1 -- 172.21.15.118:0/4020048307 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec031880 con 0x7fbcfc14ee30 2024-03-08T20:38:54.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.988+0000 7fbcf9600640 1 -- 172.21.15.118:0/4020048307 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec031c50 con 0x7fbcfc14ee30 2024-03-08T20:38:54.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.989+0000 7fbcfbe00640 1 -- 172.21.15.118:0/4020048307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc14ee30 msgr2=0x7fbcfc0c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.988 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.989+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/4020048307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc0c7150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0c70c0 tx=0x7fbcec02b920 comp rx=0 tx=0).stop 2024-03-08T20:38:54.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 -- 172.21.15.118:0/4020048307 shutdown_connections 2024-03-08T20:38:54.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/4020048307 >> v2:172.21.15.144:3300/0 conn(0x7fbcfc155900 0x7fbcfc0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/4020048307 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc0c7150 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.989 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 -- 172.21.15.118:0/4020048307 >> 172.21.15.118:0/4020048307 conn(0x7fbcfc0ac2d0 msgr2=0x7fbcfc0ac6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:54.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 -- 172.21.15.118:0/4020048307 shutdown_connections 2024-03-08T20:38:54.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.990+0000 7fbcfbe00640 1 -- 172.21.15.118:0/4020048307 wait complete. 2024-03-08T20:38:54.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.993+0000 7fbcfbe00640 1 Processor -- start 2024-03-08T20:38:54.993 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.994+0000 7fbcfbe00640 1 -- start start 2024-03-08T20:38:54.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc1eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcfc155900 0x7fbcfc0c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.996 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc155d00 con 0x7fbcfc156350 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc06c9f0 con 0x7fbcfc14ee30 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfbe00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc155e80 con 0x7fbcfc155900 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc1eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfb400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc1eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48908/0 (socket says 172.21.15.118:48908) 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfaa00640 1 -- 172.21.15.118:0/393137649 learned_addr learned my addr 172.21.15.118:0/393137649 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:54.997 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.995+0000 7fbcfb400640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44418/0 (socket says 172.21.15.118:44418) 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfa000640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcfc155900 0x7fbcfc0c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 -- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcfc155900 msgr2=0x7fbcfc0c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcfc155900 0x7fbcfc0c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 -- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 msgr2=0x7fbcfc1eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc1eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:54.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 -- 172.21.15.118:0/393137649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc0c4740 con 0x7fbcfc156350 2024-03-08T20:38:54.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.996+0000 7fbcfb400640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4007dc0 tx=0x7fbcf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:54.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.997+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf400edd0 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.997+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc1f7650 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.997+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf4003990 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.997+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4003d40 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:54.998+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc1f7c10 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.000+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbcf401b020 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.000+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc074a40 con 0x7fbcfc156350 2024-03-08T20:38:55.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.000+0000 7fbcf2a00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 0x7fbcdc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.001+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbcf408f060 con 0x7fbcfc156350 2024-03-08T20:38:55.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.002+0000 7fbcfaa00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 0x7fbcdc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.002+0000 7fbcfaa00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 0x7fbcdc06e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcec034040 tx=0x7fbcec03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:55.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.008+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fbcf4058740 con 0x7fbcfc156350 2024-03-08T20:38:55.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.336+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcfc1f83f0 con 0x7fbcdc06bbd0 2024-03-08T20:38:55.336 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.337+0000 7fbcf2a00640 1 -- 172.21.15.118:0/393137649 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbcfc1f83f0 con 0x7fbcdc06bbd0 2024-03-08T20:38:55.336 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 4 to deep-scrub 2024-03-08T20:38:55.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.340+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 msgr2=0x7fbcdc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.340+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 0x7fbcdc06e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbcec034040 tx=0x7fbcec03c040 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.340+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 msgr2=0x7fbcfc0c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.340+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4007dc0 tx=0x7fbcf400e4b0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 shutdown_connections 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fbcdc06bbd0 0x7fbcdc06e090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcfc156350 0x7fbcfc0c2080 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcfc155900 0x7fbcfc0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 --2- 172.21.15.118:0/393137649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcfc14ee30 0x7fbcfc1eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 >> 172.21.15.118:0/393137649 conn(0x7fbcfc0ac2d0 msgr2=0x7fbcfc06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:55.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 shutdown_connections 2024-03-08T20:38:55.342 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.341+0000 7fbcfbe00640 1 -- 172.21.15.118:0/393137649 wait complete. 2024-03-08T20:38:55.365 INFO:tasks.ceph:Scrubbing osd.5 2024-03-08T20:38:55.365 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.651+0000 7f9f29200640 1 Processor -- start 2024-03-08T20:38:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.651+0000 7f9f29200640 1 -- start start 2024-03-08T20:38:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f29200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9f240c86b0 0x7f9f24155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f29200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2406cff0 con 0x7f9f240c5130 2024-03-08T20:38:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f29200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240c5610 con 0x7f9f2414ba20 2024-03-08T20:38:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f29200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240c58f0 con 0x7f9f240c86b0 2024-03-08T20:38:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f21e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9f2414ba20 0x7f9f2406c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:33296/0 (socket says 172.21.15.118:33296) 2024-03-08T20:38:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.654+0000 7f9f21e00640 1 -- 172.21.15.118:0/1907419339 learned_addr learned my addr 172.21.15.118:0/1907419339 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.655+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828914541 0 0) 0x7f9f240c5610 con 0x7f9f2414ba20 2024-03-08T20:38:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.655+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f08003520 con 0x7f9f2414ba20 2024-03-08T20:38:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181283681 0 0) 0x7f9f08003520 con 0x7f9f2414ba20 2024-03-08T20:38:55.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 >> v2:172.21.15.118:3300/0 conn(0x7f9f240c86b0 msgr2=0x7f9f24155920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T20:38:55.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 --2- 172.21.15.118:0/1907419339 >> v2:172.21.15.118:3300/0 conn(0x7f9f240c86b0 0x7f9f24155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 >> v1:172.21.15.118:6789/0 conn(0x7f9f240c5130 legacy=0x7f9f240c71c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T20:38:55.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2406c0e0 con 0x7f9f2414ba20 2024-03-08T20:38:55.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.1 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f9f14001670 con 0x7f9f2414ba20 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.656+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 >> v1:172.21.15.144:6789/0 conn(0x7f9f2414ba20 legacy=0x7f9f2406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08003a00 0x7f9f08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 0x7f9f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f080052e0 0x7f9f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c58f0 con 0x7f9f08003a00 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08014a40 con 0x7f9f080052e0 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08014c40 con 0x7f9f08004800 2024-03-08T20:38:55.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.657+0000 7f9f21400640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 0x7f9f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08003a00 0x7f9f08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f22800640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f080052e0 0x7f9f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21400640 1 -- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f080052e0 msgr2=0x7f9f0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21400640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f080052e0 0x7f9f0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21400640 1 -- 172.21.15.118:0/1907419339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08003a00 msgr2=0x7f9f08003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21400640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08003a00 0x7f9f08003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21400640 1 -- 172.21.15.118:0/1907419339 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08003520 con 0x7f9f08004800 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.658+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08003a00 0x7f9f08003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:55.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.659+0000 7f9f22800640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f080052e0 0x7f9f0800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:55.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.659+0000 7f9f22800640 1 -- 172.21.15.118:0/1907419339 reap_dead start 2024-03-08T20:38:55.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.661+0000 7f9f21400640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 0x7f9f08004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009830 tx=0x7f9f08005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856cd1144074002f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:55.660 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.661+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10037070 con 0x7f9f08004800 2024-03-08T20:38:55.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.662+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10032620 con 0x7f9f08004800 2024-03-08T20:38:55.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.662+0000 7f9f20a00640 1 -- 172.21.15.118:0/1907419339 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f100093b0 con 0x7f9f08004800 2024-03-08T20:38:55.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.663+0000 7f9f29200640 1 -- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 msgr2=0x7f9f08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.663+0000 7f9f29200640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 0x7f9f08004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009830 tx=0x7f9f08005830 comp rx=0 tx=0).stop 2024-03-08T20:38:55.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.665+0000 7f9f29200640 1 -- 172.21.15.118:0/1907419339 shutdown_connections 2024-03-08T20:38:55.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.665+0000 7f9f29200640 1 --2- 172.21.15.118:0/1907419339 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f08004800 0x7f9f08004c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.665+0000 7f9f29200640 1 -- 172.21.15.118:0/1907419339 >> 172.21.15.118:0/1907419339 conn(0x7f9f240ac4e0 msgr2=0x7f9f240ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:55.665 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.665+0000 7f9f29200640 1 -- 172.21.15.118:0/1907419339 shutdown_connections 2024-03-08T20:38:55.667 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.665+0000 7f9f29200640 1 -- 172.21.15.118:0/1907419339 wait complete. 2024-03-08T20:38:55.672 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.673+0000 7f9f29200640 1 Processor -- start 2024-03-08T20:38:55.674 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.674+0000 7f9f29200640 1 -- start start 2024-03-08T20:38:55.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08004800 0x7f9f241f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 0x7f9f240ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f240b02d0 0x7f9f24144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.676 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24155920 con 0x7f9f08004800 2024-03-08T20:38:55.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240be090 con 0x7f9f240ad8c0 2024-03-08T20:38:55.677 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.676+0000 7f9f29200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24155aa0 con 0x7f9f240b02d0 2024-03-08T20:38:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.677+0000 7f9f21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 0x7f9f240ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.677+0000 7f9f22800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f240b02d0 0x7f9f24144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.677+0000 7f9f21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 0x7f9f240ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48932/0 (socket says 172.21.15.118:48932) 2024-03-08T20:38:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.677+0000 7f9f21400640 1 -- 172.21.15.118:0/1920867789 learned_addr learned my addr 172.21.15.118:0/1920867789 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:55.678 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08004800 0x7f9f241f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.679 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21400640 1 -- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f240b02d0 msgr2=0x7f9f24144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f240b02d0 0x7f9f24144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21400640 1 -- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08004800 msgr2=0x7f9f241f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08004800 0x7f9f241f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f21400640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240b0060 con 0x7f9f240ad8c0 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.678+0000 7f9f22800640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f240b02d0 0x7f9f24144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.679+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f08004800 0x7f9f241f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:55.680 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.680+0000 7f9f21400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 0x7f9f240ab5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009920 tx=0x7f9f10004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.681+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10042070 con 0x7f9f240ad8c0 2024-03-08T20:38:55.681 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.681+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1003d640 con 0x7f9f240ad8c0 2024-03-08T20:38:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.681+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10037040 con 0x7f9f240ad8c0 2024-03-08T20:38:55.682 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.682+0000 7f9f29200640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240afd80 con 0x7f9f240ad8c0 2024-03-08T20:38:55.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.682+0000 7f9f29200640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24144350 con 0x7f9f240ad8c0 2024-03-08T20:38:55.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.684+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ef8001030 con 0x7f9f240ad8c0 2024-03-08T20:38:55.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.687+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9f10045070 con 0x7f9f240ad8c0 2024-03-08T20:38:55.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.689+0000 7f9f1a000640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9f0406bca0 0x7f9f0406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.688 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.689+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9f100accd0 con 0x7f9f240ad8c0 2024-03-08T20:38:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.689+0000 7f9f1a000640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7f9f04075740 0x7f9f04077be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.690+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9f0406bca0 0x7f9f0406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.690+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f10039e90 con 0x7f9f04075740 2024-03-08T20:38:55.689 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.690+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f100ad0c0 con 0x7f9f240ad8c0 2024-03-08T20:38:55.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.691+0000 7f9f22800640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7f9f04075740 0x7f9f04077be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:55.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.691+0000 7f9f21e00640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9f0406bca0 0x7f9f0406e160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c14d0 tx=0x7f9f14007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:55.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.692+0000 7f9f22800640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7f9f04075740 0x7f9f04077be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:55.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.693+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== osd.5 v2:172.21.15.144:6800/4103646837 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9f10039e90 con 0x7f9f04075740 2024-03-08T20:38:55.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.722+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 --> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ef8002e30 con 0x7f9f04075740 2024-03-08T20:38:55.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.724+0000 7f9f1a000640 1 -- 172.21.15.118:0/1920867789 <== osd.5 v2:172.21.15.144:6800/4103646837 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ef8002e30 con 0x7f9f04075740 2024-03-08T20:38:55.723 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:55.723 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:55.723 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7f9f04075740 msgr2=0x7f9f04077be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.724 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:6800/4103646837,v1:172.21.15.144:6801/4103646837] conn(0x7f9f04075740 0x7f9f04077be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9f0406bca0 msgr2=0x7f9f0406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f9f0406bca0 0x7f9f0406e160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c14d0 tx=0x7f9f14007040 comp rx=0 tx=0).stop 2024-03-08T20:38:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 msgr2=0x7f9f240ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f0f400640 1 --2- 172.21.15.118:0/1920867789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f240ad8c0 0x7f9f240ab5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009920 tx=0x7f9f10004700 comp rx=0 tx=0).stop 2024-03-08T20:38:55.725 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.725+0000 7f9f22800640 1 -- 172.21.15.118:0/1920867789 reap_dead start 2024-03-08T20:38:55.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.726+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 shutdown_connections 2024-03-08T20:38:55.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.726+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 >> 172.21.15.118:0/1920867789 conn(0x7f9f240ac4e0 msgr2=0x7f9f24154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:55.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.726+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 shutdown_connections 2024-03-08T20:38:55.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.727+0000 7f9f0f400640 1 -- 172.21.15.118:0/1920867789 wait complete. 2024-03-08T20:38:55.751 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-08T20:38:55.998 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.999+0000 7f5464e00640 1 Processor -- start 2024-03-08T20:38:55.999 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:55.999+0000 7f5464e00640 1 -- start start 2024-03-08T20:38:56.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.000+0000 7f5464e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f546014f100 0x7f54600c5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.000+0000 7f5464e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546006c490 con 0x7f5460155a40 2024-03-08T20:38:56.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.000+0000 7f5464e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546006c770 con 0x7f546006bcf0 2024-03-08T20:38:56.000 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.000+0000 7f5464e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5460155ed0 con 0x7f546014f100 2024-03-08T20:38:56.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.001+0000 7f5457e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5460155a40 0x7f54600c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34570/0 (socket says 172.21.15.118:34570) 2024-03-08T20:38:56.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.001+0000 7f5457e00640 1 -- 172.21.15.118:0/3009485523 learned_addr learned my addr 172.21.15.118:0/3009485523 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:56.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.001+0000 7f545de00640 1 --2- 172.21.15.118:0/3009485523 >> v2:172.21.15.118:3300/0 conn(0x7f546014f100 0x7f54600c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.001+0000 7f545de00640 1 -- 172.21.15.118:0/3009485523 >> v1:172.21.15.144:6789/0 conn(0x7f546006bcf0 legacy=0x7f54600ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.001 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.002+0000 7f545de00640 1 -- 172.21.15.118:0/3009485523 >> v1:172.21.15.118:6789/0 conn(0x7f5460155a40 legacy=0x7f54600c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.002+0000 7f545de00640 1 -- 172.21.15.118:0/3009485523 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600c88d0 con 0x7f546014f100 2024-03-08T20:38:56.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.001+0000 7f545d400640 1 -- 172.21.15.118:0/3009485523 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688156831 0 0) 0x7f546006c490 con 0x7f5460155a40 2024-03-08T20:38:56.002 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.003+0000 7f545de00640 1 --2- 172.21.15.118:0/3009485523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f546014f100 0x7f54600c5320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54500097a0 tx=0x7f545002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526b2813287ca9a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.003+0000 7f545d400640 1 -- 172.21.15.118:0/3009485523 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450034070 con 0x7f546014f100 2024-03-08T20:38:56.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.003+0000 7f545d400640 1 -- 172.21.15.118:0/3009485523 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450030610 con 0x7f546014f100 2024-03-08T20:38:56.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.003+0000 7f545d400640 1 -- 172.21.15.118:0/3009485523 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500309e0 con 0x7f546014f100 2024-03-08T20:38:56.003 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 -- 172.21.15.118:0/3009485523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f546014f100 msgr2=0x7f54600c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 --2- 172.21.15.118:0/3009485523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f546014f100 0x7f54600c5320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54500097a0 tx=0x7f545002b960 comp rx=0 tx=0).stop 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 -- 172.21.15.118:0/3009485523 shutdown_connections 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 --2- 172.21.15.118:0/3009485523 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f546014f100 0x7f54600c5320 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 -- 172.21.15.118:0/3009485523 >> 172.21.15.118:0/3009485523 conn(0x7f54600ca780 msgr2=0x7f54600cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 -- 172.21.15.118:0/3009485523 shutdown_connections 2024-03-08T20:38:56.004 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.004+0000 7f5464e00640 1 -- 172.21.15.118:0/3009485523 wait complete. 2024-03-08T20:38:56.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.006+0000 7f5464e00640 1 Processor -- start 2024-03-08T20:38:56.005 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.006+0000 7f5464e00640 1 -- start start 2024-03-08T20:38:56.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546006bcf0 0x7f54601586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.006 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 0x7f54600c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c97e0 con 0x7f5460155a40 2024-03-08T20:38:56.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c8680 con 0x7f546014f100 2024-03-08T20:38:56.007 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.007+0000 7f5464e00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546006c140 con 0x7f546006bcf0 2024-03-08T20:38:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.008+0000 7f545e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.008+0000 7f5457e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 0x7f54600c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.008+0000 7f545e800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44466/0 (socket says 172.21.15.118:44466) 2024-03-08T20:38:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.008+0000 7f545e800640 1 -- 172.21.15.118:0/2106439049 learned_addr learned my addr 172.21.15.118:0/2106439049 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:56.008 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.008+0000 7f545de00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546006bcf0 0x7f54601586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f545e800640 1 -- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546006bcf0 msgr2=0x7f54601586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f545e800640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546006bcf0 0x7f54601586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f545e800640 1 -- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 msgr2=0x7f54600c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f545e800640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 0x7f54600c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f545e800640 1 -- 172.21.15.118:0/2106439049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600c35d0 con 0x7f5460155a40 2024-03-08T20:38:56.009 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.009+0000 7f5457e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 0x7f54600c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:56.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.010+0000 7f545e800640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f545800c730 tx=0x7f545800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.010 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.010+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458003b70 con 0x7f5460155a40 2024-03-08T20:38:56.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.011+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458003d30 con 0x7f5460155a40 2024-03-08T20:38:56.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.011+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458005310 con 0x7f5460155a40 2024-03-08T20:38:56.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.011+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600c32f0 con 0x7f5460155a40 2024-03-08T20:38:56.011 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.011+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54601ef2f0 con 0x7f5460155a40 2024-03-08T20:38:56.012 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.013+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5460074a40 con 0x7f5460155a40 2024-03-08T20:38:56.014 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.015+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f54580054b0 con 0x7f5460155a40 2024-03-08T20:38:56.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.017+0000 7f5456000640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 0x7f543c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.017+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f545808aaf0 con 0x7f5460155a40 2024-03-08T20:38:56.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.020+0000 7f545de00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 0x7f543c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.022+0000 7f545de00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 0x7f543c06e090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5450036000 tx=0x7f545003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.024+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f5458058c20 con 0x7f5460155a40 2024-03-08T20:38:56.350 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.351+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f54600ca330 con 0x7f543c06bbd0 2024-03-08T20:38:56.352 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.352+0000 7f5456000640 1 -- 172.21.15.118:0/2106439049 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54600ca330 con 0x7f543c06bbd0 2024-03-08T20:38:56.353 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 5 to deep-scrub 2024-03-08T20:38:56.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.357+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 msgr2=0x7f543c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.357+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 0x7f543c06e090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5450036000 tx=0x7f545003b040 comp rx=0 tx=0).stop 2024-03-08T20:38:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.357+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 msgr2=0x7f54600c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.357+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f545800c730 tx=0x7f545800cbf0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 shutdown_connections 2024-03-08T20:38:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f543c06bbd0 0x7f543c06e090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5460155a40 0x7f54600c17c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f546014f100 0x7f54600c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 --2- 172.21.15.118:0/2106439049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546006bcf0 0x7f54601586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 >> 172.21.15.118:0/2106439049 conn(0x7f54600ca780 msgr2=0x7f54601536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:56.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.359+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 shutdown_connections 2024-03-08T20:38:56.359 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.360+0000 7f5464e00640 1 -- 172.21.15.118:0/2106439049 wait complete. 2024-03-08T20:38:56.393 INFO:tasks.ceph:Scrubbing osd.6 2024-03-08T20:38:56.393 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:56.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.645+0000 7f8c18000640 1 Processor -- start 2024-03-08T20:38:56.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.645+0000 7f8c18000640 1 -- start start 2024-03-08T20:38:56.645 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c18000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c10152860 0x7f8c100c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c18000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c101550b0 con 0x7f8c100c86d0 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c18000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c10155370 con 0x7f8c100c7bf0 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c18000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10155650 con 0x7f8c10152860 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c14c00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8c100c86d0 0x7f8c1006c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34586/0 (socket says 172.21.15.118:34586) 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c14c00640 1 -- 172.21.15.118:0/184642331 learned_addr learned my addr 172.21.15.118:0/184642331 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:56.646 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.646+0000 7f8c15600640 1 --2- 172.21.15.118:0/184642331 >> v2:172.21.15.144:3300/0 conn(0x7f8c10152860 0x7f8c100c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.647+0000 7f8c15600640 1 -- 172.21.15.118:0/184642331 >> v1:172.21.15.144:6789/0 conn(0x7f8c100c7bf0 legacy=0x7f8c1006cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.647+0000 7f8c0fe00640 1 -- 172.21.15.118:0/184642331 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883318189 0 0) 0x7f8c101550b0 con 0x7f8c100c86d0 2024-03-08T20:38:56.647 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.647+0000 7f8c15600640 1 -- 172.21.15.118:0/184642331 >> v1:172.21.15.118:6789/0 conn(0x7f8c100c86d0 legacy=0x7f8c1006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.647+0000 7f8c15600640 1 -- 172.21.15.118:0/184642331 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10155930 con 0x7f8c10152860 2024-03-08T20:38:56.648 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.649+0000 7f8c15600640 1 --2- 172.21.15.118:0/184642331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c10152860 0x7f8c100c5150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097a0 tx=0x7f8c0402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a20f8d42cde7072 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.649+0000 7f8c0fe00640 1 -- 172.21.15.118:0/184642331 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04035020 con 0x7f8c10152860 2024-03-08T20:38:56.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.649+0000 7f8c0fe00640 1 -- 172.21.15.118:0/184642331 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04031830 con 0x7f8c10152860 2024-03-08T20:38:56.649 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.649+0000 7f8c0fe00640 1 -- 172.21.15.118:0/184642331 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04031c00 con 0x7f8c10152860 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.650+0000 7f8c18000640 1 -- 172.21.15.118:0/184642331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c10152860 msgr2=0x7f8c100c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.650+0000 7f8c18000640 1 --2- 172.21.15.118:0/184642331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c10152860 0x7f8c100c5150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097a0 tx=0x7f8c0402b8d0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.650+0000 7f8c18000640 1 -- 172.21.15.118:0/184642331 shutdown_connections 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.650+0000 7f8c18000640 1 --2- 172.21.15.118:0/184642331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c10152860 0x7f8c100c5150 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.650+0000 7f8c18000640 1 -- 172.21.15.118:0/184642331 >> 172.21.15.118:0/184642331 conn(0x7f8c10072c30 msgr2=0x7f8c100ac380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:56.650 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.651+0000 7f8c18000640 1 -- 172.21.15.118:0/184642331 shutdown_connections 2024-03-08T20:38:56.651 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.651+0000 7f8c18000640 1 -- 172.21.15.118:0/184642331 wait complete. 2024-03-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.652+0000 7f8c18000640 1 Processor -- start 2024-03-08T20:38:56.652 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.653+0000 7f8c18000640 1 -- start start 2024-03-08T20:38:56.653 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 0x7f8c10151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c100c86d0 0x7f8c10146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c10152860 0x7f8c101eb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c8f70 con 0x7f8c100c86d0 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c8df0 con 0x7f8c100c7bf0 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c18000640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c5690 con 0x7f8c10152860 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c15600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 0x7f8c10151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.654 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c15600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 0x7f8c10151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48966/0 (socket says 172.21.15.118:48966) 2024-03-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c15600640 1 -- 172.21.15.118:0/2589111677 learned_addr learned my addr 172.21.15.118:0/2589111677 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c14c00640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c100c86d0 0x7f8c10146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.655 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.654+0000 7f8c16000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c10152860 0x7f8c101eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.656 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.655+0000 7f8c15600640 1 -- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c10152860 msgr2=0x7f8c101eb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.655+0000 7f8c15600640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c10152860 0x7f8c101eb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.655+0000 7f8c15600640 1 -- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c100c86d0 msgr2=0x7f8c10146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.657 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.655+0000 7f8c15600640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c100c86d0 0x7f8c10146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.656+0000 7f8c15600640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100c2370 con 0x7f8c100c7bf0 2024-03-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.656+0000 7f8c14c00640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c100c86d0 0x7f8c10146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T20:38:56.658 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.657+0000 7f8c15600640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 0x7f8c10151120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.657+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04040070 con 0x7f8c100c7bf0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.657+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04039a00 con 0x7f8c100c7bf0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.657+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04035040 con 0x7f8c100c7bf0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.657+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c101eefc0 con 0x7f8c100c7bf0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.658+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c100c2910 con 0x7f8c100c7bf0 2024-03-08T20:38:56.659 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.659+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c10074a40 con 0x7f8c100c7bf0 2024-03-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.660+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8c04038020 con 0x7f8c100c7bf0 2024-03-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.661+0000 7f8c0d600640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8bf006bbd0 0x7f8bf006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.661 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.662+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8c040ace30 con 0x7f8c100c7bf0 2024-03-08T20:38:56.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.662+0000 7f8c0d600640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f8bf00755f0 0x7f8bf0077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.662+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c0404ee50 con 0x7f8bf00755f0 2024-03-08T20:38:56.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.662+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c040ad1e0 con 0x7f8c100c7bf0 2024-03-08T20:38:56.662 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.663+0000 7f8c14c00640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8bf006bbd0 0x7f8bf006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.663+0000 7f8c16000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f8bf00755f0 0x7f8bf0077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.664+0000 7f8c14c00640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8bf006bbd0 0x7f8bf006e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc007f70 tx=0x7f8bfc007f00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.663 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.664+0000 7f8c16000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f8bf00755f0 0x7f8bf0077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.664 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.665+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== osd.6 v2:172.21.15.144:6810/1443686898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8c0404ee50 con 0x7f8bf00755f0 2024-03-08T20:38:56.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.683+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 --> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c1006d960 con 0x7f8bf00755f0 2024-03-08T20:38:56.683 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.684+0000 7f8c0d600640 1 -- 172.21.15.118:0/2589111677 <== osd.6 v2:172.21.15.144:6810/1443686898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c1006d960 con 0x7f8bf00755f0 2024-03-08T20:38:56.684 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:56.684 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:56.684 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:56.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f8bf00755f0 msgr2=0x7f8bf0077a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:6810/1443686898,v1:172.21.15.144:6816/1443686898] conn(0x7f8bf00755f0 0x7f8bf0077a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.685 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8bf006bbd0 msgr2=0x7f8bf006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f8bf006bbd0 0x7f8bf006e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc007f70 tx=0x7f8bfc007f00 comp rx=0 tx=0).stop 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 msgr2=0x7f8c10151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 --2- 172.21.15.118:0/2589111677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c100c7bf0 0x7f8c10151120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c040098c0 tx=0x7f8c040046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c16000640 1 -- 172.21.15.118:0/2589111677 reap_dead start 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 shutdown_connections 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.685+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 >> 172.21.15.118:0/2589111677 conn(0x7f8c10072c30 msgr2=0x7f8c101543b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:56.686 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.686+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 shutdown_connections 2024-03-08T20:38:56.687 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.686+0000 7f8c18000640 1 -- 172.21.15.118:0/2589111677 wait complete. 2024-03-08T20:38:56.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-08T20:38:56.945 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.946+0000 7f19c0200640 1 Processor -- start 2024-03-08T20:38:56.947 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.946+0000 7f19c0200640 1 -- start start 2024-03-08T20:38:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19c0200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19b8155c10 0x7f19b80c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19c0200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b814f680 con 0x7f19b8072090 2024-03-08T20:38:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19c0200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b806faa0 con 0x7f19b814f2a0 2024-03-08T20:38:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19c0200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b8152c30 con 0x7f19b8155c10 2024-03-08T20:38:56.948 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19bd800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f19b814f2a0 0x7f19b8152520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:33318/0 (socket says 172.21.15.118:33318) 2024-03-08T20:38:56.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.948+0000 7f19bd800640 1 -- 172.21.15.118:0/895258507 learned_addr learned my addr 172.21.15.118:0/895258507 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:56.949 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19be200640 1 --2- 172.21.15.118:0/895258507 >> v2:172.21.15.144:3300/0 conn(0x7f19b8155c10 0x7f19b80c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19b7e00640 1 -- 172.21.15.118:0/895258507 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703382015 0 0) 0x7f19b806faa0 con 0x7f19b814f2a0 2024-03-08T20:38:56.950 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19b7e00640 1 -- 172.21.15.118:0/895258507 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003520 con 0x7f19b814f2a0 2024-03-08T20:38:56.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19be200640 1 -- 172.21.15.118:0/895258507 >> v1:172.21.15.144:6789/0 conn(0x7f19b814f2a0 legacy=0x7f19b8152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19be200640 1 -- 172.21.15.118:0/895258507 >> v1:172.21.15.118:6789/0 conn(0x7f19b8072090 legacy=0x7f19b80728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.949+0000 7f19be200640 1 -- 172.21.15.118:0/895258507 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b806fd80 con 0x7f19b8155c10 2024-03-08T20:38:56.951 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.951+0000 7f19be200640 1 --2- 172.21.15.118:0/895258507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b8155c10 0x7f19b80c6370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009d90 tx=0x7f19b002df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a7d57266c0c394 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.952+0000 7f19b7e00640 1 -- 172.21.15.118:0/895258507 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b003b070 con 0x7f19b8155c10 2024-03-08T20:38:56.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.952+0000 7f19b7e00640 1 -- 172.21.15.118:0/895258507 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b002ecc0 con 0x7f19b8155c10 2024-03-08T20:38:56.952 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.952+0000 7f19b7e00640 1 -- 172.21.15.118:0/895258507 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0036640 con 0x7f19b8155c10 2024-03-08T20:38:56.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.953+0000 7f19c0200640 1 -- 172.21.15.118:0/895258507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b8155c10 msgr2=0x7f19b80c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.953+0000 7f19c0200640 1 --2- 172.21.15.118:0/895258507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b8155c10 0x7f19b80c6370 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009d90 tx=0x7f19b002df90 comp rx=0 tx=0).stop 2024-03-08T20:38:56.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.954+0000 7f19c0200640 1 -- 172.21.15.118:0/895258507 shutdown_connections 2024-03-08T20:38:56.954 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.954+0000 7f19c0200640 1 --2- 172.21.15.118:0/895258507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b8155c10 0x7f19b80c6370 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.954+0000 7f19c0200640 1 -- 172.21.15.118:0/895258507 >> 172.21.15.118:0/895258507 conn(0x7f19b806e760 msgr2=0x7f19b80aa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:56.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.954+0000 7f19c0200640 1 -- 172.21.15.118:0/895258507 shutdown_connections 2024-03-08T20:38:56.955 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.955+0000 7f19c0200640 1 -- 172.21.15.118:0/895258507 wait complete. 2024-03-08T20:38:56.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.957+0000 7f19c0200640 1 Processor -- start 2024-03-08T20:38:56.956 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.957+0000 7f19c0200640 1 -- start start 2024-03-08T20:38:56.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.957 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b814f2a0 0x7f19b8149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 0x7f19b80a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8151d20 con 0x7f19b8155c10 2024-03-08T20:38:56.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80c68b0 con 0x7f19b814f2a0 2024-03-08T20:38:56.958 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19c0200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8152000 con 0x7f19b8072090 2024-03-08T20:38:56.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19bd800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19bd800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:36460/0 (socket says 172.21.15.118:36460) 2024-03-08T20:38:56.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19bd800640 1 -- 172.21.15.118:0/157896293 learned_addr learned my addr 172.21.15.118:0/157896293 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:56.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.958+0000 7f19bce00640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b814f2a0 0x7f19b8149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.960 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19be200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 0x7f19b80a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 -- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b814f2a0 msgr2=0x7f19b8149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b814f2a0 0x7f19b8149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 -- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 msgr2=0x7f19b80a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 0x7f19b80a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 -- 172.21.15.118:0/157896293 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80aac40 con 0x7f19b8072090 2024-03-08T20:38:56.961 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19be200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 0x7f19b80a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.959+0000 7f19bd800640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c500 tx=0x7f19ac00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.960+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac017070 con 0x7f19b8072090 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.960+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac005ce0 con 0x7f19b8072090 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.960+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b8153120 con 0x7f19b8072090 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.960+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac007330 con 0x7f19b8072090 2024-03-08T20:38:56.962 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.960+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81536e0 con 0x7f19b8072090 2024-03-08T20:38:56.963 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.964+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b8074a40 con 0x7f19b8072090 2024-03-08T20:38:56.964 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.965+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f19ac01a070 con 0x7f19b8072090 2024-03-08T20:38:56.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.966+0000 7f19b5600640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 0x7f199806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:56.965 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.966+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f19ac08a210 con 0x7f19b8072090 2024-03-08T20:38:56.966 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.966+0000 7f19bce00640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 0x7f199806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:56.967 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.967+0000 7f19bce00640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 0x7f199806e0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19b814c600 tx=0x7f19a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:56.975 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:56.975+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f19ac058360 con 0x7f19b8072090 2024-03-08T20:38:57.340 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.341+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b8155190 con 0x7f199806bc00 2024-03-08T20:38:57.341 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.341+0000 7f19b5600640 1 -- 172.21.15.118:0/157896293 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f19b8155190 con 0x7f199806bc00 2024-03-08T20:38:57.341 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 6 to deep-scrub 2024-03-08T20:38:57.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.345+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 msgr2=0x7f199806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.345+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 0x7f199806e0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19b814c600 tx=0x7f19a4009040 comp rx=0 tx=0).stop 2024-03-08T20:38:57.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 msgr2=0x7f19b81ea7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.345 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c500 tx=0x7f19ac00c9c0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 shutdown_connections 2024-03-08T20:38:57.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f199806bc00 0x7f199806e0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f19b8155c10 0x7f19b80a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19b814f2a0 0x7f19b8149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.346 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 --2- 172.21.15.118:0/157896293 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19b8072090 0x7f19b81ea7f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.346+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 >> 172.21.15.118:0/157896293 conn(0x7f19b806e760 msgr2=0x7f19b80c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:57.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.347+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 shutdown_connections 2024-03-08T20:38:57.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.347+0000 7f19c0200640 1 -- 172.21.15.118:0/157896293 wait complete. 2024-03-08T20:38:57.376 INFO:tasks.ceph:Scrubbing osd.7 2024-03-08T20:38:57.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-08T20:38:57.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.694+0000 7fe1eba00640 1 Processor -- start 2024-03-08T20:38:57.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.696+0000 7fe1eba00640 1 -- start start 2024-03-08T20:38:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.699+0000 7fe1eba00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1e41569a0 0x7fe1e41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.699+0000 7fe1eba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1e406e330 0x7fe1e406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.699+0000 7fe1eba00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e406de50 con 0x7fe1e40c1020 2024-03-08T20:38:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.699+0000 7fe1eba00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c28d0 con 0x7fe1e41569a0 2024-03-08T20:38:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.699+0000 7fe1eba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e4159790 con 0x7fe1e406e330 2024-03-08T20:38:57.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.701+0000 7fe1e9a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1e40c1020 0x7fe1e40c1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.118:33328/0 (socket says 172.21.15.118:33328) 2024-03-08T20:38:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.701+0000 7fe1e9000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe1e41569a0 0x7fe1e41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.701+0000 7fe1e3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1e406e330 0x7fe1e406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.701+0000 7fe1e3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1e406e330 0x7fe1e406e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48978/0 (socket says 172.21.15.118:48978) 2024-03-08T20:38:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.701+0000 7fe1e3e00640 1 -- 172.21.15.118:0/3462873303 learned_addr learned my addr 172.21.15.118:0/3462873303 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.703+0000 7fe1e3400640 1 -- 172.21.15.118:0/3462873303 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825135489 0 0) 0x7fe1e406de50 con 0x7fe1e40c1020 2024-03-08T20:38:57.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.704+0000 7fe1e3400640 1 -- 172.21.15.118:0/3462873303 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1cc003520 con 0x7fe1e40c1020 2024-03-08T20:38:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.704+0000 7fe1e3e00640 1 -- 172.21.15.118:0/3462873303 >> v2:172.21.15.118:3300/0 conn(0x7fe1e41569a0 msgr2=0x7fe1e41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.704+0000 7fe1e3e00640 1 --2- 172.21.15.118:0/3462873303 >> v2:172.21.15.118:3300/0 conn(0x7fe1e41569a0 0x7fe1e41591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.704+0000 7fe1e3e00640 1 -- 172.21.15.118:0/3462873303 >> v1:172.21.15.144:6789/0 conn(0x7fe1e40c1020 legacy=0x7fe1e40c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.705 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.704+0000 7fe1e3e00640 1 -- 172.21.15.118:0/3462873303 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4159a70 con 0x7fe1e406e330 2024-03-08T20:38:57.709 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.710+0000 7fe1e3e00640 1 --2- 172.21.15.118:0/3462873303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e406e330 0x7fe1e406e790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406f050 tx=0x7fe1d002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f829ecfd30680a78 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.711+0000 7fe1e3400640 1 -- 172.21.15.118:0/3462873303 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0034070 con 0x7fe1e406e330 2024-03-08T20:38:57.710 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.711+0000 7fe1e3400640 1 -- 172.21.15.118:0/3462873303 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0030800 con 0x7fe1e406e330 2024-03-08T20:38:57.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.711+0000 7fe1e3400640 1 -- 172.21.15.118:0/3462873303 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0030c10 con 0x7fe1e406e330 2024-03-08T20:38:57.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.714+0000 7fe1eba00640 1 -- 172.21.15.118:0/3462873303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e406e330 msgr2=0x7fe1e406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.714+0000 7fe1eba00640 1 --2- 172.21.15.118:0/3462873303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e406e330 0x7fe1e406e790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406f050 tx=0x7fe1d002b940 comp rx=0 tx=0).stop 2024-03-08T20:38:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.715+0000 7fe1eba00640 1 -- 172.21.15.118:0/3462873303 shutdown_connections 2024-03-08T20:38:57.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.715+0000 7fe1eba00640 1 --2- 172.21.15.118:0/3462873303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e406e330 0x7fe1e406e790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.715+0000 7fe1eba00640 1 --2- 172.21.15.118:0/3462873303 >> v2:172.21.15.118:3300/0 conn(0x7fe1e41569a0 0x7fe1e41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.715+0000 7fe1eba00640 1 -- 172.21.15.118:0/3462873303 >> 172.21.15.118:0/3462873303 conn(0x7fe1e40a8cb0 msgr2=0x7fe1e406ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.717+0000 7fe1eba00640 1 -- 172.21.15.118:0/3462873303 shutdown_connections 2024-03-08T20:38:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.717+0000 7fe1eba00640 1 -- 172.21.15.118:0/3462873303 wait complete. 2024-03-08T20:38:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.719+0000 7fe1eba00640 1 Processor -- start 2024-03-08T20:38:57.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.720+0000 7fe1eba00640 1 -- start start 2024-03-08T20:38:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e406e330 0x7fe1e41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 0x7fe1e41f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e41569a0 0x7fe1e40c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e406ecd0 con 0x7fe1e406e330 2024-03-08T20:38:57.726 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415a030 con 0x7fe1e41569a0 2024-03-08T20:38:57.727 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.726+0000 7fe1eba00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4156d80 con 0x7fe1e40c1020 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.727+0000 7fe1e3e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 0x7fe1e41f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.727+0000 7fe1e9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e41569a0 0x7fe1e40c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.727+0000 7fe1e9000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e406e330 0x7fe1e41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.728+0000 7fe1e3e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 0x7fe1e41f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.118:36464/0 (socket says 172.21.15.118:36464) 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.728+0000 7fe1e3e00640 1 -- 172.21.15.118:0/1694474872 learned_addr learned my addr 172.21.15.118:0/1694474872 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:57.728 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.727+0000 7fe1e9000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e406e330 0x7fe1e41590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:44520/0 (socket says 172.21.15.118:44520) 2024-03-08T20:38:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.729+0000 7fe1e3e00640 1 -- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e41569a0 msgr2=0x7fe1e40c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.729+0000 7fe1e3e00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e41569a0 0x7fe1e40c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.729+0000 7fe1e3e00640 1 -- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e406e330 msgr2=0x7fe1e41590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.729 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.729+0000 7fe1e3e00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe1e406e330 0x7fe1e41590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.730 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.729+0000 7fe1e3e00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4157b10 con 0x7fe1e40c1020 2024-03-08T20:38:57.732 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.732+0000 7fe1e3e00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 0x7fe1e41f7730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00090b0 tx=0x7fe1d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.733+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0034040 con 0x7fe1e40c1020 2024-03-08T20:38:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.734+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0039cb0 con 0x7fe1e40c1020 2024-03-08T20:38:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.734+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0039e60 con 0x7fe1e40c1020 2024-03-08T20:38:57.733 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.734+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e4157830 con 0x7fe1e40c1020 2024-03-08T20:38:57.734 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.734+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40c6290 con 0x7fe1e40c1020 2024-03-08T20:38:57.741 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.742+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1e41574e0 con 0x7fe1e40c1020 2024-03-08T20:38:57.742 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.743+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe1d004a060 con 0x7fe1e40c1020 2024-03-08T20:38:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.744+0000 7fe1e0c00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe1c406bc20 0x7fe1c406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.745+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe1d00acae0 con 0x7fe1e40c1020 2024-03-08T20:38:57.744 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.745+0000 7fe1e0c00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7fe1c40756b0 0x7fe1c4077b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.745+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1d00067f0 con 0x7fe1c40756b0 2024-03-08T20:38:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.745+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d00b12c0 con 0x7fe1e40c1020 2024-03-08T20:38:57.745 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.746+0000 7fe1e9000640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe1c406bc20 0x7fe1c406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.747+0000 7fe1e9a00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7fe1c40756b0 0x7fe1c4077b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:57.746 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.747+0000 7fe1e9000640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe1c406bc20 0x7fe1c406e0e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009b40 tx=0x7fe1d8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:57.747 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.748+0000 7fe1e9a00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7fe1c40756b0 0x7fe1c4077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:57.749 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.749+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== osd.7 v2:172.21.15.144:6824/1313104786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe1d00067f0 con 0x7fe1c40756b0 2024-03-08T20:38:57.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.774+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 --> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1e4074a40 con 0x7fe1c40756b0 2024-03-08T20:38:57.774 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.775+0000 7fe1e0c00640 1 -- 172.21.15.118:0/1694474872 <== osd.7 v2:172.21.15.144:6824/1313104786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe1e4074a40 con 0x7fe1c40756b0 2024-03-08T20:38:57.775 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-08T20:38:57.775 INFO:teuthology.orchestra.run.smithi118.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T20:38:57.775 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7fe1c40756b0 msgr2=0x7fe1c4077b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:6824/1313104786,v1:172.21.15.144:6825/1313104786] conn(0x7fe1c40756b0 0x7fe1c4077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe1c406bc20 msgr2=0x7fe1c406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe1c406bc20 0x7fe1c406e0e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009b40 tx=0x7fe1d8009190 comp rx=0 tx=0).stop 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 msgr2=0x7fe1e41f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.776+0000 7fe1eba00640 1 --2- 172.21.15.118:0/1694474872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1e40c1020 0x7fe1e41f7730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00090b0 tx=0x7fe1d00046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:57.776 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.777+0000 7fe1e9a00640 1 -- 172.21.15.118:0/1694474872 reap_dead start 2024-03-08T20:38:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.777+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 shutdown_connections 2024-03-08T20:38:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.777+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 >> 172.21.15.118:0/1694474872 conn(0x7fe1e40a8cb0 msgr2=0x7fe1e40c15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.777+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 shutdown_connections 2024-03-08T20:38:57.777 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:57.777+0000 7fe1eba00640 1 -- 172.21.15.118:0/1694474872 wait complete. 2024-03-08T20:38:57.798 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-08T20:38:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.083+0000 7fd574a00640 1 Processor -- start 2024-03-08T20:38:58.083 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.083+0000 7fd574a00640 1 -- start start 2024-03-08T20:38:58.084 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.085+0000 7fd574a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd56800edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.085+0000 7fd574a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd56800fcf0 0x7fd5680069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.085+0000 7fd574a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680d7d00 con 0x7fd568050720 2024-03-08T20:38:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.085+0000 7fd574a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680db250 con 0x7fd56800fcf0 2024-03-08T20:38:58.085 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.085+0000 7fd574a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56804ba00 con 0x7fd5680d7920 2024-03-08T20:38:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.086+0000 7fd56e800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd56800edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.086+0000 7fd56de00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd568050720 0x7fd5680062c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:34592/0 (socket says 172.21.15.118:34592) 2024-03-08T20:38:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.086+0000 7fd56f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd56800fcf0 0x7fd5680069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.086 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.086+0000 7fd56de00640 1 -- 172.21.15.118:0/1898874741 learned_addr learned my addr 172.21.15.118:0/1898874741 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:38:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.087+0000 7fd56e800640 1 -- 172.21.15.118:0/1898874741 >> v2:172.21.15.144:3300/0 conn(0x7fd56800fcf0 msgr2=0x7fd5680069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.087+0000 7fd56e800640 1 --2- 172.21.15.118:0/1898874741 >> v2:172.21.15.144:3300/0 conn(0x7fd56800fcf0 0x7fd5680069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.087+0000 7fd56d400640 1 -- 172.21.15.118:0/1898874741 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914271856 0 0) 0x7fd5680d7d00 con 0x7fd568050720 2024-03-08T20:38:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.087+0000 7fd56e800640 1 -- 172.21.15.118:0/1898874741 >> v1:172.21.15.118:6789/0 conn(0x7fd568050720 legacy=0x7fd5680062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.087 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.087+0000 7fd56e800640 1 -- 172.21.15.118:0/1898874741 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56804bce0 con 0x7fd5680d7920 2024-03-08T20:38:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.089+0000 7fd56e800640 1 --2- 172.21.15.118:0/1898874741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd56800edb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5600097a0 tx=0x7fd56002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c64cc69c9d1f5b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.088 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.089+0000 7fd56d400640 1 -- 172.21.15.118:0/1898874741 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560031780 con 0x7fd5680d7920 2024-03-08T20:38:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.089+0000 7fd56d400640 1 -- 172.21.15.118:0/1898874741 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560037070 con 0x7fd5680d7920 2024-03-08T20:38:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.089+0000 7fd56d400640 1 -- 172.21.15.118:0/1898874741 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560031b40 con 0x7fd5680d7920 2024-03-08T20:38:58.089 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.090+0000 7fd574a00640 1 -- 172.21.15.118:0/1898874741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 msgr2=0x7fd56800edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.090+0000 7fd574a00640 1 --2- 172.21.15.118:0/1898874741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd56800edb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5600097a0 tx=0x7fd56002b820 comp rx=0 tx=0).stop 2024-03-08T20:38:58.090 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 -- 172.21.15.118:0/1898874741 shutdown_connections 2024-03-08T20:38:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 --2- 172.21.15.118:0/1898874741 >> v2:172.21.15.144:3300/0 conn(0x7fd56800fcf0 0x7fd5680069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 --2- 172.21.15.118:0/1898874741 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd56800edb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.091 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 -- 172.21.15.118:0/1898874741 >> 172.21.15.118:0/1898874741 conn(0x7fd56804fc00 msgr2=0x7fd568050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:58.092 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 -- 172.21.15.118:0/1898874741 shutdown_connections 2024-03-08T20:38:58.093 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.091+0000 7fd574a00640 1 -- 172.21.15.118:0/1898874741 wait complete. 2024-03-08T20:38:58.094 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.094+0000 7fd574a00640 1 Processor -- start 2024-03-08T20:38:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.096+0000 7fd574a00640 1 -- start start 2024-03-08T20:38:58.098 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd568050720 0x7fd568032a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd568032f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568006f10 con 0x7fd568050720 2024-03-08T20:38:58.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56804c2a0 con 0x7fd56800fcf0 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.097+0000 7fd574a00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680dad20 con 0x7fd5680d7920 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.098+0000 7fd56e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.098+0000 7fd56e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48992/0 (socket says 172.21.15.118:48992) 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.098+0000 7fd56e800640 1 -- 172.21.15.118:0/2511818695 learned_addr learned my addr 172.21.15.118:0/2511818695 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.098+0000 7fd56f200640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd568032f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.098+0000 7fd56e800640 1 -- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 msgr2=0x7fd568032f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.099+0000 7fd56e800640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd568032f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.099+0000 7fd56e800640 1 -- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd568050720 msgr2=0x7fd568032a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.099+0000 7fd56e800640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd568050720 0x7fd568032a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.099+0000 7fd56e800640 1 -- 172.21.15.118:0/2511818695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568033b60 con 0x7fd56800fcf0 2024-03-08T20:38:58.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.104+0000 7fd56e800640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd5600098c0 tx=0x7fd5600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.104+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560031ed0 con 0x7fd56800fcf0 2024-03-08T20:38:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.104+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560032840 con 0x7fd56800fcf0 2024-03-08T20:38:58.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.104+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560032c30 con 0x7fd56800fcf0 2024-03-08T20:38:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.107+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568174f40 con 0x7fd56800fcf0 2024-03-08T20:38:58.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.107+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568175220 con 0x7fd56800fcf0 2024-03-08T20:38:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.112+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568005390 con 0x7fd56800fcf0 2024-03-08T20:38:58.113 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.114+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd56004d3f0 con 0x7fd56800fcf0 2024-03-08T20:38:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.115+0000 7fd566a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 0x7fd55006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.116+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd5600ac930 con 0x7fd56800fcf0 2024-03-08T20:38:58.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.116+0000 7fd56de00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 0x7fd55006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.118+0000 7fd56de00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 0x7fd55006e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd55c007fd0 tx=0x7fd55c007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.121+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fd560040070 con 0x7fd56800fcf0 2024-03-08T20:38:58.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.548+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd568049ec0 con 0x7fd55006bca0 2024-03-08T20:38:58.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.549+0000 7fd566a00640 1 -- 172.21.15.118:0/2511818695 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd568049ec0 con 0x7fd55006bca0 2024-03-08T20:38:58.549 INFO:teuthology.orchestra.run.smithi118.stderr:instructed osd(s) 7 to deep-scrub 2024-03-08T20:38:58.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.552+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 msgr2=0x7fd55006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.552+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 0x7fd55006e160 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd55c007fd0 tx=0x7fd55c007900 comp rx=0 tx=0).stop 2024-03-08T20:38:58.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.552+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 msgr2=0x7fd5680d9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.552 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.552+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd5600098c0 tx=0x7fd5600046c0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 shutdown_connections 2024-03-08T20:38:58.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fd55006bca0 0x7fd55006e160 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd55c007fd0 tx=0x7fd55c007900 comp rx=0 tx=0).stop 2024-03-08T20:38:58.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd5680d7920 0x7fd568032f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.553 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd568050720 0x7fd568032a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 --2- 172.21.15.118:0/2511818695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd56800fcf0 0x7fd5680d9400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.553+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 >> 172.21.15.118:0/2511818695 conn(0x7fd56804fc00 msgr2=0x7fd5680062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:58.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.554+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 shutdown_connections 2024-03-08T20:38:58.554 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.554+0000 7fd574a00640 1 -- 172.21.15.118:0/2511818695 wait complete. 2024-03-08T20:38:58.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:38:58.890 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.891+0000 7fe798800640 1 Processor -- start 2024-03-08T20:38:58.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.891+0000 7fe798800640 1 -- start start 2024-03-08T20:38:58.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.893+0000 7fe798800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.893+0000 7fe798800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe79006b170 0x7fe790159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.893+0000 7fe798800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe790156df0 con 0x7fe79006ad10 2024-03-08T20:38:58.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe798800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79015a340 con 0x7fe79006b170 2024-03-08T20:38:58.893 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe798800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79006ea50 con 0x7fe790156a10 2024-03-08T20:38:58.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe795e00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe796800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe79006b170 0x7fe790159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe796800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe79006b170 0x7fe790159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:48998/0 (socket says 172.21.15.118:48998) 2024-03-08T20:38:58.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.894+0000 7fe796800640 1 -- 172.21.15.118:0/592167302 learned_addr learned my addr 172.21.15.118:0/592167302 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:58.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.895+0000 7fe796800640 1 -- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 msgr2=0x7fe7900c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:38:58.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.895+0000 7fe796800640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.895+0000 7fe796800640 1 -- 172.21.15.118:0/592167302 >> v1:172.21.15.118:6789/0 conn(0x7fe79006ad10 legacy=0x7fe7901596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.895 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.895+0000 7fe796800640 1 -- 172.21.15.118:0/592167302 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79006eca0 con 0x7fe79006b170 2024-03-08T20:38:58.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.895+0000 7fe795e00640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:38:58.896 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.897+0000 7fe796800640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe790159e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009e50 tx=0x7fe78c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412c26d2eea239cb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.897+0000 7fe794a00640 1 -- 172.21.15.118:0/592167302 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c02ca80 con 0x7fe79006b170 2024-03-08T20:38:58.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.897+0000 7fe794a00640 1 -- 172.21.15.118:0/592167302 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c02cc20 con 0x7fe79006b170 2024-03-08T20:38:58.897 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.897+0000 7fe794a00640 1 -- 172.21.15.118:0/592167302 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0343f0 con 0x7fe79006b170 2024-03-08T20:38:58.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.898+0000 7fe798800640 1 -- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 msgr2=0x7fe790159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.898 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.898+0000 7fe798800640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe790159e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009e50 tx=0x7fe78c02bee0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 -- 172.21.15.118:0/592167302 shutdown_connections 2024-03-08T20:38:58.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe790159e00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.899 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 --2- 172.21.15.118:0/592167302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 -- 172.21.15.118:0/592167302 >> 172.21.15.118:0/592167302 conn(0x7fe7900a84c0 msgr2=0x7fe7900a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:58.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 -- 172.21.15.118:0/592167302 shutdown_connections 2024-03-08T20:38:58.900 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.899+0000 7fe798800640 1 -- 172.21.15.118:0/592167302 wait complete. 2024-03-08T20:38:58.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.903+0000 7fe798800640 1 Processor -- start 2024-03-08T20:38:58.904 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.904+0000 7fe798800640 1 -- start start 2024-03-08T20:38:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.906+0000 7fe798800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79006ad10 0x7fe790155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.906+0000 7fe798800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.906+0000 7fe798800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.908+0000 7fe798800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79006e2d0 con 0x7fe79006ad10 2024-03-08T20:38:58.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.908+0000 7fe798800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79006dff0 con 0x7fe79006b170 2024-03-08T20:38:58.908 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.908+0000 7fe798800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79006e5b0 con 0x7fe790156a10 2024-03-08T20:38:58.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.909+0000 7fe795400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.118:49002/0 (socket says 172.21.15.118:49002) 2024-03-08T20:38:58.909 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 -- 172.21.15.118:0/3242405893 learned_addr learned my addr 172.21.15.118:0/3242405893 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:38:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 -- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 msgr2=0x7fe7900aae90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T20:38:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900aae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 -- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79006ad10 msgr2=0x7fe790155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79006ad10 0x7fe790155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:58.910 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.910+0000 7fe795400640 1 -- 172.21.15.118:0/3242405893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900a9c50 con 0x7fe79006b170 2024-03-08T20:38:58.914 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.914+0000 7fe795400640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c400 tx=0x7fe78000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.918+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800052d0 con 0x7fe79006b170 2024-03-08T20:38:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.918+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790071350 con 0x7fe79006b170 2024-03-08T20:38:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.918+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe790155b60 con 0x7fe79006b170 2024-03-08T20:38:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.918+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005490 con 0x7fe79006b170 2024-03-08T20:38:58.918 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.918+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780007260 con 0x7fe79006b170 2024-03-08T20:38:58.919 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.920+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c005290 con 0x7fe79006b170 2024-03-08T20:38:58.924 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.923+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe780007400 con 0x7fe79006b170 2024-03-08T20:38:58.925 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.926+0000 7fe78a000640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 0x7fe77406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:38:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.928+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe78008a360 con 0x7fe79006b170 2024-03-08T20:38:58.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.928+0000 7fe795e00640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 0x7fe77406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:38:58.929 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.929+0000 7fe795e00640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 0x7fe77406e090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe784006fd0 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:38:58.935 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:58.936+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe7800589b0 con 0x7fe79006b170 2024-03-08T20:38:59.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.327+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe76c000bc0 con 0x7fe77406bbd0 2024-03-08T20:38:59.347 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.348+0000 7fe78a000640 1 -- 172.21.15.118:0/3242405893 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336326 (secure 0 0 0) 0x7fe76c000bc0 con 0x7fe77406bbd0 2024-03-08T20:38:59.353 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:38:59.354 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:38:59.356 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 msgr2=0x7fe77406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:59.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 0x7fe77406e090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe784006fd0 tx=0x7fe784008040 comp rx=0 tx=0).stop 2024-03-08T20:38:59.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 msgr2=0x7fe7900aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:38:59.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c400 tx=0x7fe78000c8c0 comp rx=0 tx=0).stop 2024-03-08T20:38:59.357 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 shutdown_connections 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe77406bbd0 0x7fe77406e090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe790156a10 0x7fe7900aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe79006b170 0x7fe7900aa950 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c400 tx=0x7fe78000c8c0 comp rx=0 tx=0).stop 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 --2- 172.21.15.118:0/3242405893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe79006ad10 0x7fe790155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.356+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 >> 172.21.15.118:0/3242405893 conn(0x7fe7900a84c0 msgr2=0x7fe7900c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.358+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 shutdown_connections 2024-03-08T20:38:59.358 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:38:59.358+0000 7fe798800640 1 -- 172.21.15.118:0/3242405893 wait complete. 2024-03-08T20:38:59.393 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-03-08T20:38:57.725791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1667155959,"num_objects":159151,"num_object_clones":0,"num_object_copies":480766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159151,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":354738,"num_write_kb":2320236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277721,"ondisk_log_size":277721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5289060,"kb_used_data":2794980,"kb_used_omap":12,"kb_used_meta":2494003,"kb_avail":749685660,"statfs":{"total":773094113280,"available":767678115840,"internally_reserved":0,"allocated":2862059520,"data_stored":4189356750,"data_compressed":619906340,"data_compressed_allocated":760389632,"data_compressed_original":2089127936,"omap_allocated":12751,"internal_metadata":2553859633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,12,10,4,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20494300,"num_objects":842,"num_object_clones":0,"num_object_copies":1684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":842,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3088,"num_write_kb":949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004893"},"pg_stats":[{"pgid":"2.1f","version":"27'261","reported_seq":292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.343745+0000","last_change":"2024-03-08T20:29:23.241052+0000","last_active":"2024-03-08T20:38:42.343745+0000","last_peered":"2024-03-08T20:38:42.343745+0000","last_clean":"2024-03-08T20:38:42.343745+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:42.343745+0000","last_undegraded":"2024-03-08T20:38:42.343745+0000","last_fullsized":"2024-03-08T20:38:42.343745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'1264","reported_seq":1292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.924412+0000","last_change":"2024-03-08T20:29:24.255457+0000","last_active":"2024-03-08T20:38:43.924412+0000","last_peered":"2024-03-08T20:38:43.924412+0000","last_clean":"2024-03-08T20:38:43.924412+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:38:43.924412+0000","last_undegraded":"2024-03-08T20:38:43.924412+0000","last_fullsized":"2024-03-08T20:38:43.924412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.937749+0000","last_change":"2024-03-08T20:29:28.300967+0000","last_active":"2024-03-08T20:38:43.937749+0000","last_peered":"2024-03-08T20:38:43.937749+0000","last_clean":"2024-03-08T20:38:43.937749+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:38:43.937749+0000","last_undegraded":"2024-03-08T20:38:43.937749+0000","last_fullsized":"2024-03-08T20:38:43.937749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:14:28.215923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'561","reported_seq":591,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.856665+0000","last_change":"2024-03-08T20:29:23.240312+0000","last_active":"2024-03-08T20:38:42.856665+0000","last_peered":"2024-03-08T20:38:42.856665+0000","last_clean":"2024-03-08T20:38:42.856665+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:38:42.856665+0000","last_undegraded":"2024-03-08T20:38:42.856665+0000","last_fullsized":"2024-03-08T20:38:42.856665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'2324","reported_seq":2405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.204769+0000","last_change":"2024-03-08T20:38:54.204874+0000","last_active":"2024-03-08T20:38:54.204769+0000","last_peered":"2024-03-08T20:38:54.204769+0000","last_clean":"2024-03-08T20:38:54.204769+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:54.204769+0000","last_undegraded":"2024-03-08T20:38:54.204769+0000","last_fullsized":"2024-03-08T20:38:54.204769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2324","last_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_deep_scrub":"27'2324","last_deep_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.204663+0000","objects_scrubbed":1123,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.294448+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5216","reported_seq":5237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.694184+0000","last_change":"2024-03-08T20:29:28.284122+0000","last_active":"2024-03-08T20:38:44.694184+0000","last_peered":"2024-03-08T20:38:44.694184+0000","last_clean":"2024-03-08T20:38:44.694184+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:38:44.694184+0000","last_undegraded":"2024-03-08T20:38:44.694184+0000","last_fullsized":"2024-03-08T20:38:44.694184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5216,"log_dups_size":0,"ondisk_log_size":5216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:00.071134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7593,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'523","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.451423+0000","last_change":"2024-03-08T20:29:23.251210+0000","last_active":"2024-03-08T20:38:43.451423+0000","last_peered":"2024-03-08T20:38:43.451423+0000","last_clean":"2024-03-08T20:38:43.451423+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:38:43.451423+0000","last_undegraded":"2024-03-08T20:38:43.451423+0000","last_fullsized":"2024-03-08T20:38:43.451423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.041058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'1292","reported_seq":1319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.058874+0000","last_change":"2024-03-08T20:29:24.255150+0000","last_active":"2024-03-08T20:38:43.058874+0000","last_peered":"2024-03-08T20:38:43.058874+0000","last_clean":"2024-03-08T20:38:43.058874+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:38:43.058874+0000","last_undegraded":"2024-03-08T20:38:43.058874+0000","last_fullsized":"2024-03-08T20:38:43.058874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1292,"log_dups_size":0,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5265","reported_seq":5286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.844158+0000","last_change":"2024-03-08T20:29:28.285238+0000","last_active":"2024-03-08T20:38:44.844158+0000","last_peered":"2024-03-08T20:38:44.844158+0000","last_clean":"2024-03-08T20:38:44.844158+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:38:44.844158+0000","last_undegraded":"2024-03-08T20:38:44.844158+0000","last_fullsized":"2024-03-08T20:38:44.844158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7645,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'311","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.761608+0000","last_change":"2024-03-08T20:29:23.253589+0000","last_active":"2024-03-08T20:38:41.761608+0000","last_peered":"2024-03-08T20:38:41.761608+0000","last_clean":"2024-03-08T20:38:41.761608+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:38:41.761608+0000","last_undegraded":"2024-03-08T20:38:41.761608+0000","last_fullsized":"2024-03-08T20:38:41.761608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:19.712212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1260","reported_seq":1287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489526+0000","last_change":"2024-03-08T20:29:24.258044+0000","last_active":"2024-03-08T20:38:43.489526+0000","last_peered":"2024-03-08T20:38:43.489526+0000","last_clean":"2024-03-08T20:38:43.489526+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:38:43.489526+0000","last_undegraded":"2024-03-08T20:38:43.489526+0000","last_fullsized":"2024-03-08T20:38:43.489526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5155","reported_seq":5176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.618533+0000","last_change":"2024-03-08T20:29:28.279144+0000","last_active":"2024-03-08T20:38:44.618533+0000","last_peered":"2024-03-08T20:38:44.618533+0000","last_clean":"2024-03-08T20:38:44.618533+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:38:44.618533+0000","last_undegraded":"2024-03-08T20:38:44.618533+0000","last_fullsized":"2024-03-08T20:38:44.618533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:26.240714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7522,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1286","reported_seq":1314,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.722986+0000","last_change":"2024-03-08T20:29:24.254758+0000","last_active":"2024-03-08T20:38:44.722986+0000","last_peered":"2024-03-08T20:38:44.722986+0000","last_clean":"2024-03-08T20:38:44.722986+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:38:44.722986+0000","last_undegraded":"2024-03-08T20:38:44.722986+0000","last_fullsized":"2024-03-08T20:38:44.722986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'403","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.607882+0000","last_change":"2024-03-08T20:29:23.252370+0000","last_active":"2024-03-08T20:38:43.607882+0000","last_peered":"2024-03-08T20:38:43.607882+0000","last_clean":"2024-03-08T20:38:43.607882+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:38:43.607882+0000","last_undegraded":"2024-03-08T20:38:43.607882+0000","last_fullsized":"2024-03-08T20:38:43.607882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:15.333930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5284","reported_seq":5306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.882330+0000","last_change":"2024-03-08T20:29:28.278639+0000","last_active":"2024-03-08T20:38:44.882330+0000","last_peered":"2024-03-08T20:38:44.882330+0000","last_clean":"2024-03-08T20:38:44.882330+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:38:44.882330+0000","last_undegraded":"2024-03-08T20:38:44.882330+0000","last_fullsized":"2024-03-08T20:38:44.882330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7680,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'1326","reported_seq":1354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.757829+0000","last_change":"2024-03-08T20:29:24.245182+0000","last_active":"2024-03-08T20:38:43.757829+0000","last_peered":"2024-03-08T20:38:43.757829+0000","last_clean":"2024-03-08T20:38:43.757829+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:38:43.757829+0000","last_undegraded":"2024-03-08T20:38:43.757829+0000","last_fullsized":"2024-03-08T20:38:43.757829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1510","reported_seq":1541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:45.414586+0000","last_change":"2024-03-08T20:29:23.247952+0000","last_active":"2024-03-08T20:38:45.414586+0000","last_peered":"2024-03-08T20:38:45.414586+0000","last_clean":"2024-03-08T20:38:45.414586+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:38:45.414586+0000","last_undegraded":"2024-03-08T20:38:45.414586+0000","last_fullsized":"2024-03-08T20:38:45.414586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5273","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.661378+0000","last_change":"2024-03-08T20:29:28.285061+0000","last_active":"2024-03-08T20:38:44.661378+0000","last_peered":"2024-03-08T20:38:44.661378+0000","last_clean":"2024-03-08T20:38:44.661378+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:38:44.661378+0000","last_undegraded":"2024-03-08T20:38:44.661378+0000","last_fullsized":"2024-03-08T20:38:44.661378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:37.034444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7687,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1330","reported_seq":1358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.827441+0000","last_change":"2024-03-08T20:29:24.245100+0000","last_active":"2024-03-08T20:38:43.827441+0000","last_peered":"2024-03-08T20:38:43.827441+0000","last_clean":"2024-03-08T20:38:43.827441+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:38:43.827441+0000","last_undegraded":"2024-03-08T20:38:43.827441+0000","last_fullsized":"2024-03-08T20:38:43.827441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1181,"num_object_clones":0,"num_object_copies":2362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'441","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.100635+0000","last_change":"2024-03-08T20:29:23.253332+0000","last_active":"2024-03-08T20:38:42.100635+0000","last_peered":"2024-03-08T20:38:42.100635+0000","last_clean":"2024-03-08T20:38:42.100635+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:38:42.100635+0000","last_undegraded":"2024-03-08T20:38:42.100635+0000","last_fullsized":"2024-03-08T20:38:42.100635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5217,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.991801+0000","last_change":"2024-03-08T20:29:28.307623+0000","last_active":"2024-03-08T20:38:43.991801+0000","last_peered":"2024-03-08T20:38:43.991801+0000","last_clean":"2024-03-08T20:38:43.991801+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:38:43.991801+0000","last_undegraded":"2024-03-08T20:38:43.991801+0000","last_fullsized":"2024-03-08T20:38:43.991801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'1324","reported_seq":1352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.688044+0000","last_change":"2024-03-08T20:29:24.241656+0000","last_active":"2024-03-08T20:38:44.688044+0000","last_peered":"2024-03-08T20:38:44.688044+0000","last_clean":"2024-03-08T20:38:44.688044+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:44.688044+0000","last_undegraded":"2024-03-08T20:38:44.688044+0000","last_fullsized":"2024-03-08T20:38:44.688044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1324,"log_dups_size":0,"ondisk_log_size":1324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:14:20.925218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1193,"num_object_clones":0,"num_object_copies":2386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'966","reported_seq":996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.817632+0000","last_change":"2024-03-08T20:29:23.251723+0000","last_active":"2024-03-08T20:38:41.817632+0000","last_peered":"2024-03-08T20:38:41.817632+0000","last_clean":"2024-03-08T20:38:41.817632+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:38:41.817632+0000","last_undegraded":"2024-03-08T20:38:41.817632+0000","last_fullsized":"2024-03-08T20:38:41.817632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":966,"log_dups_size":0,"ondisk_log_size":966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5284","reported_seq":5306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.675267+0000","last_change":"2024-03-08T20:29:28.280278+0000","last_active":"2024-03-08T20:38:44.675267+0000","last_peered":"2024-03-08T20:38:44.675267+0000","last_clean":"2024-03-08T20:38:44.675267+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:38:44.675267+0000","last_undegraded":"2024-03-08T20:38:44.675267+0000","last_fullsized":"2024-03-08T20:38:44.675267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:59.086362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'1294","reported_seq":1323,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.375139+0000","last_change":"2024-03-08T20:29:24.246639+0000","last_active":"2024-03-08T20:38:43.375139+0000","last_peered":"2024-03-08T20:38:43.375139+0000","last_clean":"2024-03-08T20:38:43.375139+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:38:43.375139+0000","last_undegraded":"2024-03-08T20:38:43.375139+0000","last_fullsized":"2024-03-08T20:38:43.375139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'313","reported_seq":343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.028871+0000","last_change":"2024-03-08T20:29:23.255645+0000","last_active":"2024-03-08T20:38:44.028871+0000","last_peered":"2024-03-08T20:38:44.028871+0000","last_clean":"2024-03-08T20:38:44.028871+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:38:44.028871+0000","last_undegraded":"2024-03-08T20:38:44.028871+0000","last_fullsized":"2024-03-08T20:38:44.028871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5236","reported_seq":5258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.825432+0000","last_change":"2024-03-08T20:29:28.302686+0000","last_active":"2024-03-08T20:38:44.825432+0000","last_peered":"2024-03-08T20:38:44.825432+0000","last_clean":"2024-03-08T20:38:44.825432+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:38:44.825432+0000","last_undegraded":"2024-03-08T20:38:44.825432+0000","last_fullsized":"2024-03-08T20:38:44.825432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:13.348929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7619,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'1264","reported_seq":1292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.068385+0000","last_change":"2024-03-08T20:29:24.268890+0000","last_active":"2024-03-08T20:38:44.068385+0000","last_peered":"2024-03-08T20:38:44.068385+0000","last_clean":"2024-03-08T20:38:44.068385+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:38:44.068385+0000","last_undegraded":"2024-03-08T20:38:44.068385+0000","last_fullsized":"2024-03-08T20:38:44.068385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1104,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'789","reported_seq":820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.689044+0000","last_change":"2024-03-08T20:29:23.243392+0000","last_active":"2024-03-08T20:38:42.689044+0000","last_peered":"2024-03-08T20:38:42.689044+0000","last_clean":"2024-03-08T20:38:42.689044+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:42.689044+0000","last_undegraded":"2024-03-08T20:38:42.689044+0000","last_fullsized":"2024-03-08T20:38:42.689044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5227","reported_seq":5250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.896927+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.896927+0000","last_peered":"2024-03-08T20:38:43.896927+0000","last_clean":"2024-03-08T20:38:43.896927+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:38:43.896927+0000","last_undegraded":"2024-03-08T20:38:43.896927+0000","last_fullsized":"2024-03-08T20:38:43.896927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7622,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'1299","reported_seq":1328,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.182805+0000","last_change":"2024-03-08T20:29:24.225994+0000","last_active":"2024-03-08T20:38:43.182805+0000","last_peered":"2024-03-08T20:38:43.182805+0000","last_clean":"2024-03-08T20:38:43.182805+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:38:43.182805+0000","last_undegraded":"2024-03-08T20:38:43.182805+0000","last_fullsized":"2024-03-08T20:38:43.182805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'441","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.194981+0000","last_change":"2024-03-08T20:29:23.250919+0000","last_active":"2024-03-08T20:38:43.194981+0000","last_peered":"2024-03-08T20:38:43.194981+0000","last_clean":"2024-03-08T20:38:43.194981+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:38:43.194981+0000","last_undegraded":"2024-03-08T20:38:43.194981+0000","last_fullsized":"2024-03-08T20:38:43.194981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:27.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.665794+0000","last_change":"2024-03-08T20:30:10.906802+0000","last_active":"2024-03-08T20:38:43.665794+0000","last_peered":"2024-03-08T20:38:43.665794+0000","last_clean":"2024-03-08T20:38:43.665794+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:38:43.665794+0000","last_undegraded":"2024-03-08T20:38:43.665794+0000","last_fullsized":"2024-03-08T20:38:43.665794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1255","reported_seq":1269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.161190+0000","last_change":"2024-03-08T20:30:10.908515+0000","last_active":"2024-03-08T20:38:42.161190+0000","last_peered":"2024-03-08T20:38:42.161190+0000","last_clean":"2024-03-08T20:38:42.161190+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:38:42.161190+0000","last_undegraded":"2024-03-08T20:38:42.161190+0000","last_fullsized":"2024-03-08T20:38:42.161190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2132","reported_seq":2176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.519584+0000","last_change":"2024-03-08T20:38:56.519663+0000","last_active":"2024-03-08T20:38:56.519584+0000","last_peered":"2024-03-08T20:38:56.519584+0000","last_clean":"2024-03-08T20:38:56.519584+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:56.519584+0000","last_undegraded":"2024-03-08T20:38:56.519584+0000","last_fullsized":"2024-03-08T20:38:56.519584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2132","last_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_deep_scrub":"27'2132","last_deep_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.519479+0000","objects_scrubbed":135,"log_size":2132,"log_dups_size":0,"ondisk_log_size":2132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:38:08.647763+0000","scrub_duration":370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5251,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.412689+0000","last_change":"2024-03-08T20:29:28.282265+0000","last_active":"2024-03-08T20:38:43.412689+0000","last_peered":"2024-03-08T20:38:43.412689+0000","last_clean":"2024-03-08T20:38:43.412689+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:38:43.412689+0000","last_undegraded":"2024-03-08T20:38:43.412689+0000","last_fullsized":"2024-03-08T20:38:43.412689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'1252","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.814031+0000","last_change":"2024-03-08T20:29:24.260109+0000","last_active":"2024-03-08T20:38:44.814031+0000","last_peered":"2024-03-08T20:38:44.814031+0000","last_clean":"2024-03-08T20:38:44.814031+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:38:44.814031+0000","last_undegraded":"2024-03-08T20:38:44.814031+0000","last_fullsized":"2024-03-08T20:38:44.814031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:15.113480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'878","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.489620+0000","last_change":"2024-03-08T20:29:23.238044+0000","last_active":"2024-03-08T20:38:43.489620+0000","last_peered":"2024-03-08T20:38:43.489620+0000","last_clean":"2024-03-08T20:38:43.489620+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:43.489620+0000","last_undegraded":"2024-03-08T20:38:43.489620+0000","last_fullsized":"2024-03-08T20:38:43.489620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:38.371982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.815038+0000","last_change":"2024-03-08T20:29:28.292741+0000","last_active":"2024-03-08T20:38:43.815038+0000","last_peered":"2024-03-08T20:38:43.815038+0000","last_clean":"2024-03-08T20:38:43.815038+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:38:43.815038+0000","last_undegraded":"2024-03-08T20:38:43.815038+0000","last_fullsized":"2024-03-08T20:38:43.815038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'1293","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.099879+0000","last_change":"2024-03-08T20:29:24.228751+0000","last_active":"2024-03-08T20:38:43.099879+0000","last_peered":"2024-03-08T20:38:43.099879+0000","last_clean":"2024-03-08T20:38:43.099879+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:38:43.099879+0000","last_undegraded":"2024-03-08T20:38:43.099879+0000","last_fullsized":"2024-03-08T20:38:43.099879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1408","reported_seq":1976,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.857583+0000","last_change":"2024-03-08T20:29:23.240100+0000","last_active":"2024-03-08T20:38:41.857583+0000","last_peered":"2024-03-08T20:38:41.857583+0000","last_clean":"2024-03-08T20:38:41.857583+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:41.857583+0000","last_undegraded":"2024-03-08T20:38:41.857583+0000","last_fullsized":"2024-03-08T20:38:41.857583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5262,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.850399+0000","last_change":"2024-03-08T20:29:28.287107+0000","last_active":"2024-03-08T20:38:43.850399+0000","last_peered":"2024-03-08T20:38:43.850399+0000","last_clean":"2024-03-08T20:38:43.850399+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:38:43.850399+0000","last_undegraded":"2024-03-08T20:38:43.850399+0000","last_fullsized":"2024-03-08T20:38:43.850399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'1231","reported_seq":1260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.160092+0000","last_change":"2024-03-08T20:29:24.246820+0000","last_active":"2024-03-08T20:38:43.160092+0000","last_peered":"2024-03-08T20:38:43.160092+0000","last_clean":"2024-03-08T20:38:43.160092+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:38:43.160092+0000","last_undegraded":"2024-03-08T20:38:43.160092+0000","last_fullsized":"2024-03-08T20:38:43.160092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1231,"log_dups_size":0,"ondisk_log_size":1231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'603","reported_seq":633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.085281+0000","last_change":"2024-03-08T20:29:23.252437+0000","last_active":"2024-03-08T20:38:42.085281+0000","last_peered":"2024-03-08T20:38:42.085281+0000","last_clean":"2024-03-08T20:38:42.085281+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:38:42.085281+0000","last_undegraded":"2024-03-08T20:38:42.085281+0000","last_fullsized":"2024-03-08T20:38:42.085281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.687630+0000","last_change":"2024-03-08T20:29:28.304556+0000","last_active":"2024-03-08T20:38:43.687630+0000","last_peered":"2024-03-08T20:38:43.687630+0000","last_clean":"2024-03-08T20:38:43.687630+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:38:43.687630+0000","last_undegraded":"2024-03-08T20:38:43.687630+0000","last_fullsized":"2024-03-08T20:38:43.687630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'2438","reported_seq":2508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.779075+0000","last_change":"2024-03-08T20:38:55.779145+0000","last_active":"2024-03-08T20:38:55.779075+0000","last_peered":"2024-03-08T20:38:55.779075+0000","last_clean":"2024-03-08T20:38:55.779075+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:55.779075+0000","last_undegraded":"2024-03-08T20:38:55.779075+0000","last_fullsized":"2024-03-08T20:38:55.779075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2438","last_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_deep_scrub":"27'2438","last_deep_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.778847+0000","objects_scrubbed":1188,"log_size":2438,"log_dups_size":0,"ondisk_log_size":2438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:46:58.079791+0000","scrub_duration":1601,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'496","reported_seq":526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.543155+0000","last_change":"2024-03-08T20:29:23.243493+0000","last_active":"2024-03-08T20:38:42.543155+0000","last_peered":"2024-03-08T20:38:42.543155+0000","last_clean":"2024-03-08T20:38:42.543155+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:42.543155+0000","last_undegraded":"2024-03-08T20:38:42.543155+0000","last_fullsized":"2024-03-08T20:38:42.543155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:35:22.321573+0000","last_change":"2024-03-08T20:29:19.005990+0000","last_active":"2024-03-08T20:35:22.321573+0000","last_peered":"2024-03-08T20:35:22.321573+0000","last_clean":"2024-03-08T20:35:22.321573+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:35:22.321573+0000","last_undegraded":"2024-03-08T20:35:22.321573+0000","last_fullsized":"2024-03-08T20:35:22.321573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:17.955089+0000","last_clean_scrub_stamp":"2024-03-08T20:29:17.955089+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:28:01.343102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.569286+0000","last_change":"2024-03-08T20:29:28.301141+0000","last_active":"2024-03-08T20:38:44.569286+0000","last_peered":"2024-03-08T20:38:44.569286+0000","last_clean":"2024-03-08T20:38:44.569286+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:38:44.569286+0000","last_undegraded":"2024-03-08T20:38:44.569286+0000","last_fullsized":"2024-03-08T20:38:44.569286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:51.516245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.341788+0000","last_change":"2024-03-08T20:29:24.265239+0000","last_active":"2024-03-08T20:38:43.341788+0000","last_peered":"2024-03-08T20:38:43.341788+0000","last_clean":"2024-03-08T20:38:43.341788+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:38:43.341788+0000","last_undegraded":"2024-03-08T20:38:43.341788+0000","last_fullsized":"2024-03-08T20:38:43.341788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:19:00.006356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1404","reported_seq":1434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.088642+0000","last_change":"2024-03-08T20:29:23.243468+0000","last_active":"2024-03-08T20:38:43.088642+0000","last_peered":"2024-03-08T20:38:43.088642+0000","last_clean":"2024-03-08T20:38:43.088642+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:43.088642+0000","last_undegraded":"2024-03-08T20:38:43.088642+0000","last_fullsized":"2024-03-08T20:38:43.088642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1404,"log_dups_size":0,"ondisk_log_size":1404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1667,"num_write_kb":30964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":136,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5325","reported_seq":5347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.718237+0000","last_change":"2024-03-08T20:29:28.297880+0000","last_active":"2024-03-08T20:38:44.718237+0000","last_peered":"2024-03-08T20:38:44.718237+0000","last_clean":"2024-03-08T20:38:44.718237+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:38:44.718237+0000","last_undegraded":"2024-03-08T20:38:44.718237+0000","last_fullsized":"2024-03-08T20:38:44.718237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:15.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7695,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1281","reported_seq":1309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422930+0000","last_change":"2024-03-08T20:29:24.246801+0000","last_active":"2024-03-08T20:38:43.422930+0000","last_peered":"2024-03-08T20:38:43.422930+0000","last_clean":"2024-03-08T20:38:43.422930+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:38:43.422930+0000","last_undegraded":"2024-03-08T20:38:43.422930+0000","last_fullsized":"2024-03-08T20:38:43.422930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1508","reported_seq":1539,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.749369+0000","last_change":"2024-03-08T20:29:23.247139+0000","last_active":"2024-03-08T20:38:42.749369+0000","last_peered":"2024-03-08T20:38:42.749369+0000","last_clean":"2024-03-08T20:38:42.749369+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:42.749369+0000","last_undegraded":"2024-03-08T20:38:42.749369+0000","last_fullsized":"2024-03-08T20:38:42.749369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.428784+0000","last_change":"2024-03-08T20:29:28.283755+0000","last_active":"2024-03-08T20:38:43.428784+0000","last_peered":"2024-03-08T20:38:43.428784+0000","last_clean":"2024-03-08T20:38:43.428784+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:38:43.428784+0000","last_undegraded":"2024-03-08T20:38:43.428784+0000","last_fullsized":"2024-03-08T20:38:43.428784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1217","reported_seq":1245,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.290625+0000","last_change":"2024-03-08T20:29:24.250701+0000","last_active":"2024-03-08T20:38:44.290625+0000","last_peered":"2024-03-08T20:38:44.290625+0000","last_clean":"2024-03-08T20:38:44.290625+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:38:44.290625+0000","last_undegraded":"2024-03-08T20:38:44.290625+0000","last_fullsized":"2024-03-08T20:38:44.290625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1217,"log_dups_size":0,"ondisk_log_size":1217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:02.101511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1097,"num_object_clones":0,"num_object_copies":2194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1370","reported_seq":1400,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.084592+0000","last_change":"2024-03-08T20:29:23.238717+0000","last_active":"2024-03-08T20:38:42.084592+0000","last_peered":"2024-03-08T20:38:42.084592+0000","last_clean":"2024-03-08T20:38:42.084592+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:42.084592+0000","last_undegraded":"2024-03-08T20:38:42.084592+0000","last_fullsized":"2024-03-08T20:38:42.084592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1370,"log_dups_size":0,"ondisk_log_size":1370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:52.129527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.731509+0000","last_change":"2024-03-08T20:29:28.301293+0000","last_active":"2024-03-08T20:38:43.731509+0000","last_peered":"2024-03-08T20:38:43.731509+0000","last_clean":"2024-03-08T20:38:43.731509+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:38:43.731509+0000","last_undegraded":"2024-03-08T20:38:43.731509+0000","last_fullsized":"2024-03-08T20:38:43.731509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1317","reported_seq":1345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.996304+0000","last_change":"2024-03-08T20:29:24.261564+0000","last_active":"2024-03-08T20:38:43.996304+0000","last_peered":"2024-03-08T20:38:43.996304+0000","last_clean":"2024-03-08T20:38:43.996304+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:38:43.996304+0000","last_undegraded":"2024-03-08T20:38:43.996304+0000","last_fullsized":"2024-03-08T20:38:43.996304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:08.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'346","reported_seq":376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.138038+0000","last_change":"2024-03-08T20:29:23.240632+0000","last_active":"2024-03-08T20:38:44.138038+0000","last_peered":"2024-03-08T20:38:44.138038+0000","last_clean":"2024-03-08T20:38:44.138038+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:44.138038+0000","last_undegraded":"2024-03-08T20:38:44.138038+0000","last_fullsized":"2024-03-08T20:38:44.138038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:53:02.740510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5314","reported_seq":5337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.832653+0000","last_change":"2024-03-08T20:29:28.285485+0000","last_active":"2024-03-08T20:38:44.832653+0000","last_peered":"2024-03-08T20:38:44.832653+0000","last_clean":"2024-03-08T20:38:44.832653+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:38:44.832653+0000","last_undegraded":"2024-03-08T20:38:44.832653+0000","last_fullsized":"2024-03-08T20:38:44.832653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:22.375614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7713,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1326","reported_seq":1354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.422641+0000","last_change":"2024-03-08T20:29:24.262816+0000","last_active":"2024-03-08T20:38:43.422641+0000","last_peered":"2024-03-08T20:38:43.422641+0000","last_clean":"2024-03-08T20:38:43.422641+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:38:43.422641+0000","last_undegraded":"2024-03-08T20:38:43.422641+0000","last_fullsized":"2024-03-08T20:38:43.422641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'491","reported_seq":521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.869025+0000","last_change":"2024-03-08T20:29:23.236115+0000","last_active":"2024-03-08T20:38:41.869025+0000","last_peered":"2024-03-08T20:38:41.869025+0000","last_clean":"2024-03-08T20:38:41.869025+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:41.869025+0000","last_undegraded":"2024-03-08T20:38:41.869025+0000","last_fullsized":"2024-03-08T20:38:41.869025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.900052+0000","last_change":"2024-03-08T20:29:28.284696+0000","last_active":"2024-03-08T20:38:43.900052+0000","last_peered":"2024-03-08T20:38:43.900052+0000","last_clean":"2024-03-08T20:38:43.900052+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:38:43.900052+0000","last_undegraded":"2024-03-08T20:38:43.900052+0000","last_fullsized":"2024-03-08T20:38:43.900052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'1233","reported_seq":1261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.538182+0000","last_change":"2024-03-08T20:29:24.251832+0000","last_active":"2024-03-08T20:38:44.538182+0000","last_peered":"2024-03-08T20:38:44.538182+0000","last_clean":"2024-03-08T20:38:44.538182+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:38:44.538182+0000","last_undegraded":"2024-03-08T20:38:44.538182+0000","last_fullsized":"2024-03-08T20:38:44.538182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'451","reported_seq":481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.844500+0000","last_change":"2024-03-08T20:29:23.246582+0000","last_active":"2024-03-08T20:38:44.844500+0000","last_peered":"2024-03-08T20:38:44.844500+0000","last_clean":"2024-03-08T20:38:44.844500+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:38:44.844500+0000","last_undegraded":"2024-03-08T20:38:44.844500+0000","last_fullsized":"2024-03-08T20:38:44.844500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:21.394121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":724,"num_write_kb":9846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5312","reported_seq":5333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.068135+0000","last_change":"2024-03-08T20:29:28.307446+0000","last_active":"2024-03-08T20:38:44.068135+0000","last_peered":"2024-03-08T20:38:44.068135+0000","last_clean":"2024-03-08T20:38:44.068135+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:38:44.068135+0000","last_undegraded":"2024-03-08T20:38:44.068135+0000","last_fullsized":"2024-03-08T20:38:44.068135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:59:25.947353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7703,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'1283","reported_seq":1311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.591565+0000","last_change":"2024-03-08T20:29:24.249016+0000","last_active":"2024-03-08T20:38:43.591565+0000","last_peered":"2024-03-08T20:38:43.591565+0000","last_clean":"2024-03-08T20:38:43.591565+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:38:43.591565+0000","last_undegraded":"2024-03-08T20:38:43.591565+0000","last_fullsized":"2024-03-08T20:38:43.591565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1283,"log_dups_size":0,"ondisk_log_size":1283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:07:47.470311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'774","reported_seq":804,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.490604+0000","last_change":"2024-03-08T20:29:23.245561+0000","last_active":"2024-03-08T20:38:43.490604+0000","last_peered":"2024-03-08T20:38:43.490604+0000","last_clean":"2024-03-08T20:38:43.490604+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:38:43.490604+0000","last_undegraded":"2024-03-08T20:38:43.490604+0000","last_fullsized":"2024-03-08T20:38:43.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.937432+0000","last_change":"2024-03-08T20:29:28.299074+0000","last_active":"2024-03-08T20:38:43.937432+0000","last_peered":"2024-03-08T20:38:43.937432+0000","last_clean":"2024-03-08T20:38:43.937432+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:38:43.937432+0000","last_undegraded":"2024-03-08T20:38:43.937432+0000","last_fullsized":"2024-03-08T20:38:43.937432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:46:41.604989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1275","reported_seq":1304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:49.595490+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:49.595490+0000","last_peered":"2024-03-08T20:38:49.595490+0000","last_clean":"2024-03-08T20:38:49.595490+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:38:49.595490+0000","last_undegraded":"2024-03-08T20:38:49.595490+0000","last_fullsized":"2024-03-08T20:38:49.595490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'522","reported_seq":553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:49.595538+0000","last_change":"2024-03-08T20:29:23.245418+0000","last_active":"2024-03-08T20:38:49.595538+0000","last_peered":"2024-03-08T20:38:49.595538+0000","last_clean":"2024-03-08T20:38:49.595538+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:49.595538+0000","last_undegraded":"2024-03-08T20:38:49.595538+0000","last_fullsized":"2024-03-08T20:38:49.595538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.247340+0000","last_change":"2024-03-08T20:29:28.303590+0000","last_active":"2024-03-08T20:38:43.247340+0000","last_peered":"2024-03-08T20:38:43.247340+0000","last_clean":"2024-03-08T20:38:43.247340+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:38:43.247340+0000","last_undegraded":"2024-03-08T20:38:43.247340+0000","last_fullsized":"2024-03-08T20:38:43.247340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:36.296190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'1234","reported_seq":1261,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.436795+0000","last_change":"2024-03-08T20:29:24.248520+0000","last_active":"2024-03-08T20:38:43.436795+0000","last_peered":"2024-03-08T20:38:43.436795+0000","last_clean":"2024-03-08T20:38:43.436795+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:38:43.436795+0000","last_undegraded":"2024-03-08T20:38:43.436795+0000","last_fullsized":"2024-03-08T20:38:43.436795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1234,"log_dups_size":0,"ondisk_log_size":1234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:21.754475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'649","reported_seq":679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:45.405556+0000","last_change":"2024-03-08T20:29:23.241886+0000","last_active":"2024-03-08T20:38:45.405556+0000","last_peered":"2024-03-08T20:38:45.405556+0000","last_clean":"2024-03-08T20:38:45.405556+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:38:45.405556+0000","last_undegraded":"2024-03-08T20:38:45.405556+0000","last_fullsized":"2024-03-08T20:38:45.405556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":922,"num_write_kb":30370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:52.545994+0000","last_change":"2024-03-08T20:29:28.293123+0000","last_active":"2024-03-08T20:38:52.545994+0000","last_peered":"2024-03-08T20:38:52.545994+0000","last_clean":"2024-03-08T20:38:52.545994+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:38:52.545994+0000","last_undegraded":"2024-03-08T20:38:52.545994+0000","last_fullsized":"2024-03-08T20:38:52.545994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'1280","reported_seq":1308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.634322+0000","last_change":"2024-03-08T20:29:24.271385+0000","last_active":"2024-03-08T20:38:44.634322+0000","last_peered":"2024-03-08T20:38:44.634322+0000","last_clean":"2024-03-08T20:38:44.634322+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:38:44.634322+0000","last_undegraded":"2024-03-08T20:38:44.634322+0000","last_fullsized":"2024-03-08T20:38:44.634322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1280,"log_dups_size":0,"ondisk_log_size":1280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'629","reported_seq":659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.734188+0000","last_change":"2024-03-08T20:29:23.242612+0000","last_active":"2024-03-08T20:38:41.734188+0000","last_peered":"2024-03-08T20:38:41.734188+0000","last_clean":"2024-03-08T20:38:41.734188+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:41.734188+0000","last_undegraded":"2024-03-08T20:38:41.734188+0000","last_fullsized":"2024-03-08T20:38:41.734188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5203","reported_seq":5231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.850416+0000","last_change":"2024-03-08T20:30:10.640415+0000","last_active":"2024-03-08T20:38:44.850416+0000","last_peered":"2024-03-08T20:38:44.850416+0000","last_clean":"2024-03-08T20:38:44.850416+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:38:44.850416+0000","last_undegraded":"2024-03-08T20:38:44.850416+0000","last_fullsized":"2024-03-08T20:38:44.850416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5203,"log_dups_size":0,"ondisk_log_size":5203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:19:52.665266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7554,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'1270","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.643600+0000","last_change":"2024-03-08T20:29:24.260571+0000","last_active":"2024-03-08T20:38:43.643600+0000","last_peered":"2024-03-08T20:38:43.643600+0000","last_clean":"2024-03-08T20:38:43.643600+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:38:43.643600+0000","last_undegraded":"2024-03-08T20:38:43.643600+0000","last_fullsized":"2024-03-08T20:38:43.643600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'413","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.559163+0000","last_change":"2024-03-08T20:29:23.241304+0000","last_active":"2024-03-08T20:38:42.559163+0000","last_peered":"2024-03-08T20:38:42.559163+0000","last_clean":"2024-03-08T20:38:42.559163+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:42.559163+0000","last_undegraded":"2024-03-08T20:38:42.559163+0000","last_fullsized":"2024-03-08T20:38:42.559163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:19:59.712172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5124","reported_seq":5146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.232542+0000","last_change":"2024-03-08T20:29:28.278751+0000","last_active":"2024-03-08T20:38:44.232542+0000","last_peered":"2024-03-08T20:38:44.232542+0000","last_clean":"2024-03-08T20:38:44.232542+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:38:44.232542+0000","last_undegraded":"2024-03-08T20:38:44.232542+0000","last_fullsized":"2024-03-08T20:38:44.232542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5124,"log_dups_size":0,"ondisk_log_size":5124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:28:25.213769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7434,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1272","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.046416+0000","last_change":"2024-03-08T20:29:24.266568+0000","last_active":"2024-03-08T20:38:43.046416+0000","last_peered":"2024-03-08T20:38:43.046416+0000","last_clean":"2024-03-08T20:38:43.046416+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:38:43.046416+0000","last_undegraded":"2024-03-08T20:38:43.046416+0000","last_fullsized":"2024-03-08T20:38:43.046416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1240","reported_seq":1269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.772060+0000","last_change":"2024-03-08T20:29:23.241865+0000","last_active":"2024-03-08T20:38:43.772060+0000","last_peered":"2024-03-08T20:38:43.772060+0000","last_clean":"2024-03-08T20:38:43.772060+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:43.772060+0000","last_undegraded":"2024-03-08T20:38:43.772060+0000","last_fullsized":"2024-03-08T20:38:43.772060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1467,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5434","reported_seq":5456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.164334+0000","last_change":"2024-03-08T20:29:28.308462+0000","last_active":"2024-03-08T20:38:44.164334+0000","last_peered":"2024-03-08T20:38:44.164334+0000","last_clean":"2024-03-08T20:38:44.164334+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:44.164334+0000","last_undegraded":"2024-03-08T20:38:44.164334+0000","last_fullsized":"2024-03-08T20:38:44.164334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:41.783700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7911,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5177,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:38:54.586392+0000","last_change":"2024-03-08T20:38:53.636176+0000","last_active":"2024-03-08T20:38:54.586392+0000","last_peered":"2024-03-08T20:38:54.586392+0000","last_clean":"2024-03-08T20:38:54.586392+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:54.586392+0000","last_undegraded":"2024-03-08T20:38:54.586392+0000","last_fullsized":"2024-03-08T20:38:54.586392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1499,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2384","reported_seq":2465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.674442+0000","last_change":"2024-03-08T20:38:54.674541+0000","last_active":"2024-03-08T20:38:54.674442+0000","last_peered":"2024-03-08T20:38:54.674442+0000","last_clean":"2024-03-08T20:38:54.674442+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:54.674442+0000","last_undegraded":"2024-03-08T20:38:54.674442+0000","last_fullsized":"2024-03-08T20:38:54.674442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2384","last_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_deep_scrub":"27'2384","last_deep_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.674332+0000","objects_scrubbed":1145,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.764117+0000","scrub_duration":1469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'505","reported_seq":534,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.913975+0000","last_change":"2024-03-08T20:29:23.248891+0000","last_active":"2024-03-08T20:38:42.913975+0000","last_peered":"2024-03-08T20:38:42.913975+0000","last_clean":"2024-03-08T20:38:42.913975+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:38:42.913975+0000","last_undegraded":"2024-03-08T20:38:42.913975+0000","last_fullsized":"2024-03-08T20:38:42.913975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.053077+0000","last_change":"2024-03-08T20:29:28.295729+0000","last_active":"2024-03-08T20:38:44.053077+0000","last_peered":"2024-03-08T20:38:44.053077+0000","last_clean":"2024-03-08T20:38:44.053077+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:38:44.053077+0000","last_undegraded":"2024-03-08T20:38:44.053077+0000","last_fullsized":"2024-03-08T20:38:44.053077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:12.784481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'1298","reported_seq":1325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.845685+0000","last_change":"2024-03-08T20:29:24.245435+0000","last_active":"2024-03-08T20:38:43.845685+0000","last_peered":"2024-03-08T20:38:43.845685+0000","last_clean":"2024-03-08T20:38:43.845685+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:38:43.845685+0000","last_undegraded":"2024-03-08T20:38:43.845685+0000","last_fullsized":"2024-03-08T20:38:43.845685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1298,"log_dups_size":0,"ondisk_log_size":1298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1166,"num_object_clones":0,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'611","reported_seq":640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:51.752793+0000","last_change":"2024-03-08T20:29:23.242303+0000","last_active":"2024-03-08T20:38:51.752793+0000","last_peered":"2024-03-08T20:38:51.752793+0000","last_clean":"2024-03-08T20:38:51.752793+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:38:51.752793+0000","last_undegraded":"2024-03-08T20:38:51.752793+0000","last_fullsized":"2024-03-08T20:38:51.752793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:50:48.694808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291957,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":876,"num_write_kb":14995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'548","reported_seq":577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.472141+0000","last_change":"2024-03-08T20:29:23.247052+0000","last_active":"2024-03-08T20:38:44.472141+0000","last_peered":"2024-03-08T20:38:44.472141+0000","last_clean":"2024-03-08T20:38:44.472141+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:38:44.472141+0000","last_undegraded":"2024-03-08T20:38:44.472141+0000","last_fullsized":"2024-03-08T20:38:44.472141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:13.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":816,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'1252","reported_seq":1280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.301706+0000","last_change":"2024-03-08T20:29:24.245806+0000","last_active":"2024-03-08T20:38:43.301706+0000","last_peered":"2024-03-08T20:38:43.301706+0000","last_clean":"2024-03-08T20:38:43.301706+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:38:43.301706+0000","last_undegraded":"2024-03-08T20:38:43.301706+0000","last_fullsized":"2024-03-08T20:38:43.301706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5259","reported_seq":5280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.348660+0000","last_change":"2024-03-08T20:29:28.277887+0000","last_active":"2024-03-08T20:38:43.348660+0000","last_peered":"2024-03-08T20:38:43.348660+0000","last_clean":"2024-03-08T20:38:43.348660+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:38:43.348660+0000","last_undegraded":"2024-03-08T20:38:43.348660+0000","last_fullsized":"2024-03-08T20:38:43.348660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:53.337938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'410","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.897852+0000","last_change":"2024-03-08T20:29:23.250700+0000","last_active":"2024-03-08T20:38:42.897852+0000","last_peered":"2024-03-08T20:38:42.897852+0000","last_clean":"2024-03-08T20:38:42.897852+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:38:42.897852+0000","last_undegraded":"2024-03-08T20:38:42.897852+0000","last_fullsized":"2024-03-08T20:38:42.897852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:21.980761+0000","last_clean_scrub_stamp":"2024-03-08T20:29:21.980761+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:16:53.757057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'1289","reported_seq":1316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.602589+0000","last_change":"2024-03-08T20:29:24.242885+0000","last_active":"2024-03-08T20:38:44.602589+0000","last_peered":"2024-03-08T20:38:44.602589+0000","last_clean":"2024-03-08T20:38:44.602589+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:38:44.602589+0000","last_undegraded":"2024-03-08T20:38:44.602589+0000","last_fullsized":"2024-03-08T20:38:44.602589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:20:00.925178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5236","reported_seq":5257,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.501557+0000","last_change":"2024-03-08T20:29:28.283051+0000","last_active":"2024-03-08T20:38:44.501557+0000","last_peered":"2024-03-08T20:38:44.501557+0000","last_clean":"2024-03-08T20:38:44.501557+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:38:44.501557+0000","last_undegraded":"2024-03-08T20:38:44.501557+0000","last_fullsized":"2024-03-08T20:38:44.501557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:35.136849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'1264","reported_seq":1292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.562132+0000","last_change":"2024-03-08T20:29:24.252173+0000","last_active":"2024-03-08T20:38:44.562132+0000","last_peered":"2024-03-08T20:38:44.562132+0000","last_clean":"2024-03-08T20:38:44.562132+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:38:44.562132+0000","last_undegraded":"2024-03-08T20:38:44.562132+0000","last_fullsized":"2024-03-08T20:38:44.562132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1141,"num_object_clones":0,"num_object_copies":2282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'1342","reported_seq":1370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.140197+0000","last_change":"2024-03-08T20:29:24.252484+0000","last_active":"2024-03-08T20:38:42.140197+0000","last_peered":"2024-03-08T20:38:42.140197+0000","last_clean":"2024-03-08T20:38:42.140197+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:38:42.140197+0000","last_undegraded":"2024-03-08T20:38:42.140197+0000","last_fullsized":"2024-03-08T20:38:42.140197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'1258","reported_seq":1286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.669285+0000","last_change":"2024-03-08T20:29:24.247176+0000","last_active":"2024-03-08T20:38:43.669285+0000","last_peered":"2024-03-08T20:38:43.669285+0000","last_clean":"2024-03-08T20:38:43.669285+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:38:43.669285+0000","last_undegraded":"2024-03-08T20:38:43.669285+0000","last_fullsized":"2024-03-08T20:38:43.669285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:40:09.302995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'1329","reported_seq":1358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.305765+0000","last_change":"2024-03-08T20:29:24.253026+0000","last_active":"2024-03-08T20:38:43.305765+0000","last_peered":"2024-03-08T20:38:43.305765+0000","last_clean":"2024-03-08T20:38:43.305765+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:38:43.305765+0000","last_undegraded":"2024-03-08T20:38:43.305765+0000","last_fullsized":"2024-03-08T20:38:43.305765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1329,"log_dups_size":0,"ondisk_log_size":1329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1269","reported_seq":1297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.919309+0000","last_change":"2024-03-08T20:29:24.255706+0000","last_active":"2024-03-08T20:38:43.919309+0000","last_peered":"2024-03-08T20:38:43.919309+0000","last_clean":"2024-03-08T20:38:43.919309+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:43.919309+0000","last_undegraded":"2024-03-08T20:38:43.919309+0000","last_fullsized":"2024-03-08T20:38:43.919309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1269,"log_dups_size":0,"ondisk_log_size":1269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'1266","reported_seq":1295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.066115+0000","last_change":"2024-03-08T20:29:24.247482+0000","last_active":"2024-03-08T20:38:43.066115+0000","last_peered":"2024-03-08T20:38:43.066115+0000","last_clean":"2024-03-08T20:38:43.066115+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:38:43.066115+0000","last_undegraded":"2024-03-08T20:38:43.066115+0000","last_fullsized":"2024-03-08T20:38:43.066115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'1345","reported_seq":1373,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.026042+0000","last_change":"2024-03-08T20:29:24.263297+0000","last_active":"2024-03-08T20:38:44.026042+0000","last_peered":"2024-03-08T20:38:44.026042+0000","last_clean":"2024-03-08T20:38:44.026042+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:38:44.026042+0000","last_undegraded":"2024-03-08T20:38:44.026042+0000","last_fullsized":"2024-03-08T20:38:44.026042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'1301","reported_seq":1329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.981412+0000","last_change":"2024-03-08T20:29:24.252147+0000","last_active":"2024-03-08T20:38:43.981412+0000","last_peered":"2024-03-08T20:38:43.981412+0000","last_clean":"2024-03-08T20:38:43.981412+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:38:43.981412+0000","last_undegraded":"2024-03-08T20:38:43.981412+0000","last_fullsized":"2024-03-08T20:38:43.981412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1301,"log_dups_size":0,"ondisk_log_size":1301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1150,"num_object_clones":0,"num_object_copies":2300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'1271","reported_seq":1299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.272774+0000","last_change":"2024-03-08T20:29:24.251356+0000","last_active":"2024-03-08T20:38:43.272774+0000","last_peered":"2024-03-08T20:38:43.272774+0000","last_clean":"2024-03-08T20:38:43.272774+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:38:43.272774+0000","last_undegraded":"2024-03-08T20:38:43.272774+0000","last_fullsized":"2024-03-08T20:38:43.272774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.058065+0000","last_change":"2024-03-08T20:29:24.252120+0000","last_active":"2024-03-08T20:38:44.058065+0000","last_peered":"2024-03-08T20:38:44.058065+0000","last_clean":"2024-03-08T20:38:44.058065+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:38:44.058065+0000","last_undegraded":"2024-03-08T20:38:44.058065+0000","last_fullsized":"2024-03-08T20:38:44.058065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:02:14.797679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'1294","reported_seq":1322,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.692530+0000","last_change":"2024-03-08T20:29:24.246858+0000","last_active":"2024-03-08T20:38:43.692530+0000","last_peered":"2024-03-08T20:38:43.692530+0000","last_clean":"2024-03-08T20:38:43.692530+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:38:43.692530+0000","last_undegraded":"2024-03-08T20:38:43.692530+0000","last_fullsized":"2024-03-08T20:38:43.692530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:09:56.025200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'1320","reported_seq":1349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.671922+0000","last_change":"2024-03-08T20:29:24.266682+0000","last_active":"2024-03-08T20:38:43.671922+0000","last_peered":"2024-03-08T20:38:43.671922+0000","last_clean":"2024-03-08T20:38:43.671922+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:38:43.671922+0000","last_undegraded":"2024-03-08T20:38:43.671922+0000","last_fullsized":"2024-03-08T20:38:43.671922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'1298","reported_seq":1326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.179495+0000","last_change":"2024-03-08T20:29:24.253033+0000","last_active":"2024-03-08T20:38:44.179495+0000","last_peered":"2024-03-08T20:38:44.179495+0000","last_clean":"2024-03-08T20:38:44.179495+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:38:44.179495+0000","last_undegraded":"2024-03-08T20:38:44.179495+0000","last_fullsized":"2024-03-08T20:38:44.179495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1298,"log_dups_size":0,"ondisk_log_size":1298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:53.213714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'1310","reported_seq":1338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.437003+0000","last_change":"2024-03-08T20:29:24.265300+0000","last_active":"2024-03-08T20:38:43.437003+0000","last_peered":"2024-03-08T20:38:43.437003+0000","last_clean":"2024-03-08T20:38:43.437003+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:38:43.437003+0000","last_undegraded":"2024-03-08T20:38:43.437003+0000","last_fullsized":"2024-03-08T20:38:43.437003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:46:32.250256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'1273","reported_seq":1301,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.290317+0000","last_change":"2024-03-08T20:29:24.253633+0000","last_active":"2024-03-08T20:38:42.290317+0000","last_peered":"2024-03-08T20:38:42.290317+0000","last_clean":"2024-03-08T20:38:42.290317+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:38:42.290317+0000","last_undegraded":"2024-03-08T20:38:42.290317+0000","last_fullsized":"2024-03-08T20:38:42.290317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:24:16.546936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'1324","reported_seq":1337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.215350+0000","last_change":"2024-03-08T20:30:10.906961+0000","last_active":"2024-03-08T20:38:42.215350+0000","last_peered":"2024-03-08T20:38:42.215350+0000","last_clean":"2024-03-08T20:38:42.215350+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:38:42.215350+0000","last_undegraded":"2024-03-08T20:38:42.215350+0000","last_fullsized":"2024-03-08T20:38:42.215350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1324,"log_dups_size":0,"ondisk_log_size":1324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'1255","reported_seq":1268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:41.944808+0000","last_change":"2024-03-08T20:30:10.632389+0000","last_active":"2024-03-08T20:38:41.944808+0000","last_peered":"2024-03-08T20:38:41.944808+0000","last_clean":"2024-03-08T20:38:41.944808+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:38:41.944808+0000","last_undegraded":"2024-03-08T20:38:41.944808+0000","last_fullsized":"2024-03-08T20:38:41.944808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:28:22.194780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'1316","reported_seq":1345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:51.841503+0000","last_change":"2024-03-08T20:29:24.250840+0000","last_active":"2024-03-08T20:38:51.841503+0000","last_peered":"2024-03-08T20:38:51.841503+0000","last_clean":"2024-03-08T20:38:51.841503+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:38:51.841503+0000","last_undegraded":"2024-03-08T20:38:51.841503+0000","last_fullsized":"2024-03-08T20:38:51.841503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1316,"log_dups_size":0,"ondisk_log_size":1316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1245","reported_seq":1274,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:49.595449+0000","last_change":"2024-03-08T20:29:24.244636+0000","last_active":"2024-03-08T20:38:49.595449+0000","last_peered":"2024-03-08T20:38:49.595449+0000","last_clean":"2024-03-08T20:38:49.595449+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:38:49.595449+0000","last_undegraded":"2024-03-08T20:38:49.595449+0000","last_fullsized":"2024-03-08T20:38:49.595449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1245,"log_dups_size":0,"ondisk_log_size":1245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'1262","reported_seq":1289,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.856639+0000","last_change":"2024-03-08T20:29:24.258723+0000","last_active":"2024-03-08T20:38:43.856639+0000","last_peered":"2024-03-08T20:38:43.856639+0000","last_clean":"2024-03-08T20:38:43.856639+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:43.856639+0000","last_undegraded":"2024-03-08T20:38:43.856639+0000","last_fullsized":"2024-03-08T20:38:43.856639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:12:37.302063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'1214","reported_seq":1241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.648628+0000","last_change":"2024-03-08T20:29:24.256385+0000","last_active":"2024-03-08T20:38:44.648628+0000","last_peered":"2024-03-08T20:38:44.648628+0000","last_clean":"2024-03-08T20:38:44.648628+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:38:44.648628+0000","last_undegraded":"2024-03-08T20:38:44.648628+0000","last_fullsized":"2024-03-08T20:38:44.648628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:47:39.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1102,"num_object_clones":0,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1266","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.933894+0000","last_change":"2024-03-08T20:29:24.263913+0000","last_active":"2024-03-08T20:38:43.933894+0000","last_peered":"2024-03-08T20:38:43.933894+0000","last_clean":"2024-03-08T20:38:43.933894+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:38:43.933894+0000","last_undegraded":"2024-03-08T20:38:43.933894+0000","last_fullsized":"2024-03-08T20:38:43.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:27:30.766116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'1285","reported_seq":1312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.047031+0000","last_change":"2024-03-08T20:29:24.251623+0000","last_active":"2024-03-08T20:38:44.047031+0000","last_peered":"2024-03-08T20:38:44.047031+0000","last_clean":"2024-03-08T20:38:44.047031+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:38:44.047031+0000","last_undegraded":"2024-03-08T20:38:44.047031+0000","last_fullsized":"2024-03-08T20:38:44.047031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:18.329680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'1310","reported_seq":1337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.281184+0000","last_change":"2024-03-08T20:29:24.265686+0000","last_active":"2024-03-08T20:38:44.281184+0000","last_peered":"2024-03-08T20:38:44.281184+0000","last_clean":"2024-03-08T20:38:44.281184+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:38:44.281184+0000","last_undegraded":"2024-03-08T20:38:44.281184+0000","last_fullsized":"2024-03-08T20:38:44.281184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:31:28.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1199,"num_object_clones":0,"num_object_copies":2398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'1261","reported_seq":1288,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.844183+0000","last_change":"2024-03-08T20:29:24.259407+0000","last_active":"2024-03-08T20:38:43.844183+0000","last_peered":"2024-03-08T20:38:43.844183+0000","last_clean":"2024-03-08T20:38:43.844183+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:38:43.844183+0000","last_undegraded":"2024-03-08T20:38:43.844183+0000","last_fullsized":"2024-03-08T20:38:43.844183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1261,"log_dups_size":0,"ondisk_log_size":1261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:54.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1133,"num_object_clones":0,"num_object_copies":2266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1240","reported_seq":1267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.418827+0000","last_change":"2024-03-08T20:29:24.267302+0000","last_active":"2024-03-08T20:38:43.418827+0000","last_peered":"2024-03-08T20:38:43.418827+0000","last_clean":"2024-03-08T20:38:43.418827+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:38:43.418827+0000","last_undegraded":"2024-03-08T20:38:43.418827+0000","last_fullsized":"2024-03-08T20:38:43.418827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'1221","reported_seq":1248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.574530+0000","last_change":"2024-03-08T20:29:24.247111+0000","last_active":"2024-03-08T20:38:43.574530+0000","last_peered":"2024-03-08T20:38:43.574530+0000","last_clean":"2024-03-08T20:38:43.574530+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:38:43.574530+0000","last_undegraded":"2024-03-08T20:38:43.574530+0000","last_fullsized":"2024-03-08T20:38:43.574530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:22:02.542414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'1323","reported_seq":1350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:42.971308+0000","last_change":"2024-03-08T20:29:24.242908+0000","last_active":"2024-03-08T20:38:42.971308+0000","last_peered":"2024-03-08T20:38:42.971308+0000","last_clean":"2024-03-08T20:38:42.971308+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:38:42.971308+0000","last_undegraded":"2024-03-08T20:38:42.971308+0000","last_fullsized":"2024-03-08T20:38:42.971308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:56:11.652414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'1270","reported_seq":1298,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.424239+0000","last_change":"2024-03-08T20:29:24.257525+0000","last_active":"2024-03-08T20:38:43.424239+0000","last_peered":"2024-03-08T20:38:43.424239+0000","last_clean":"2024-03-08T20:38:43.424239+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:38:43.424239+0000","last_undegraded":"2024-03-08T20:38:43.424239+0000","last_fullsized":"2024-03-08T20:38:43.424239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:00:32.988510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'1303","reported_seq":1332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:43.013220+0000","last_change":"2024-03-08T20:29:24.237122+0000","last_active":"2024-03-08T20:38:43.013220+0000","last_peered":"2024-03-08T20:38:43.013220+0000","last_clean":"2024-03-08T20:38:43.013220+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:43.013220+0000","last_undegraded":"2024-03-08T20:38:43.013220+0000","last_fullsized":"2024-03-08T20:38:43.013220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2261","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.636981+0000","last_change":"2024-03-08T20:38:56.637013+0000","last_active":"2024-03-08T20:38:56.636981+0000","last_peered":"2024-03-08T20:38:56.636981+0000","last_clean":"2024-03-08T20:38:56.636981+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:56.636981+0000","last_undegraded":"2024-03-08T20:38:56.636981+0000","last_fullsized":"2024-03-08T20:38:56.636981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2261","last_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_deep_scrub":"27'2261","last_deep_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.636912+0000","objects_scrubbed":1103,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:09.348536+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'1203","reported_seq":1231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:44.307197+0000","last_change":"2024-03-08T20:29:24.265925+0000","last_active":"2024-03-08T20:38:44.307197+0000","last_peered":"2024-03-08T20:38:44.307197+0000","last_clean":"2024-03-08T20:38:44.307197+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:38:44.307197+0000","last_undegraded":"2024-03-08T20:38:44.307197+0000","last_fullsized":"2024-03-08T20:38:44.307197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":0,"log_size":1203,"log_dups_size":0,"ondisk_log_size":1203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:54:55.040428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1095,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":243462,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167509,"ondisk_log_size":167509,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73410,"num_object_clones":0,"num_object_copies":146820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86188,"ondisk_log_size":86188,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":177847143,"num_objects":4507,"num_object_clones":0,"num_object_copies":9014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4507,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33303,"num_write_kb":743120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127287296,"data_stored":355694286,"data_compressed":48877398,"data_compressed_allocated":60243968,"data_compressed_original":288710656,"omap_allocated":0,"internal_metadata":0},"log_size":23907,"ondisk_log_size":23907,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582308,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93789532,"statfs":{"total":96636764160,"available":96040480768,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":706476,"kb_used_data":400484,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93665364,"statfs":{"total":96636764160,"available":95913332736,"internally_reserved":0,"allocated":410095616,"data_stored":556618573,"data_compressed":74692817,"data_compressed_allocated":87916544,"data_compressed_original":234618880,"omap_allocated":1594,"internal_metadata":313326022},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":517756,"kb_used_data":251956,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":93854084,"statfs":{"total":96636764160,"available":96106582016,"internally_reserved":0,"allocated":258002944,"data_stored":424137042,"data_compressed":66768074,"data_compressed_allocated":84230144,"data_compressed_original":250540032,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":619676,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":93752164,"statfs":{"total":96636764160,"available":96002215936,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":822588,"kb_used_data":422132,"kb_used_omap":1,"kb_used_meta":400446,"kb_avail":93549252,"statfs":{"total":96636764160,"available":95794434048,"internally_reserved":0,"allocated":432263168,"data_stored":663042369,"data_compressed":104468897,"data_compressed_allocated":131923968,"data_compressed_original":362885120,"omap_allocated":1593,"internal_metadata":410057159},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":573644,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93798196,"statfs":{"total":96636764160,"available":96049352704,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879748,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":428158,"kb_avail":93492092,"statfs":{"total":96636764160,"available":95735902208,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":438434245},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,8,5,3,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":586864,"kb_used_data":307240,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":93784976,"statfs":{"total":96636764160,"available":96035815424,"internally_reserved":0,"allocated":314613760,"data_stored":431273366,"data_compressed":63573338,"data_compressed_allocated":76365824,"data_compressed_original":193212416,"omap_allocated":1594,"internal_metadata":286325190},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,3,5,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11288576,"data_stored":20972158,"data_compressed":2184983,"data_compressed_allocated":2924544,"data_compressed_original":12619776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19099648,"data_stored":43628617,"data_compressed":5410896,"data_compressed_allocated":6983680,"data_compressed_original":31522816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12443648,"data_stored":43041365,"data_compressed":6305634,"data_compressed_allocated":7553024,"data_compressed_original":38158336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:38:59.401 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.401 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.401 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.401 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.402 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.402 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.402 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.402 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.402 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.403 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.404 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.405 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.406 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.407 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-08T20:29:17.955089+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=17, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.408 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.409 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.410 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.411 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.412 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.413 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.414 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-08T20:29:21.980761+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=21, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.415 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.416 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.417 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.418 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.419 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.420 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:38:59.421 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-08T20:39:19.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:39:19.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.627+0000 7f734a400640 1 Processor -- start 2024-03-08T20:39:19.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.627+0000 7f734a400640 1 -- start start 2024-03-08T20:39:19.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f734a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f734414ed50 0x7f73440a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f734a400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7344155670 0x7f734406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f734a400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734406fa50 con 0x7f734406b790 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f734a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7344154e90 con 0x7f734414ed50 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f734a400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734406fcf0 con 0x7f7344155670 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f734414ed50 0x7f73440a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f734414ed50 0x7f73440a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58980/0 (socket says 172.21.15.118:58980) 2024-03-08T20:39:19.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 -- 172.21.15.118:0/3124399936 learned_addr learned my addr 172.21.15.118:0/3124399936 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343e00640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7344155670 0x7f734406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 -- 172.21.15.118:0/3124399936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7344155670 msgr2=0x7f734406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7344155670 0x7f734406ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 -- 172.21.15.118:0/3124399936 >> v1:172.21.15.144:6789/0 conn(0x7f734406b790 legacy=0x7f73440c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.629+0000 7f7343400640 1 -- 172.21.15.118:0/3124399936 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734406ffd0 con 0x7f734414ed50 2024-03-08T20:39:19.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f7343400640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734414ed50 0x7f73440a9310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7334009870 tx=0x7f733402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af49c3bf6a8054d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:19.631 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f7342000640 1 -- 172.21.15.118:0/3124399936 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334035020 con 0x7f734414ed50 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f7342000640 1 -- 172.21.15.118:0/3124399936 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334031640 con 0x7f734414ed50 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f7342000640 1 -- 172.21.15.118:0/3124399936 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733402d040 con 0x7f734414ed50 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 -- 172.21.15.118:0/3124399936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734414ed50 msgr2=0x7f73440a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734414ed50 0x7f73440a9310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7334009870 tx=0x7f733402b8f0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 -- 172.21.15.118:0/3124399936 shutdown_connections 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7344155670 0x7f734406ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 --2- 172.21.15.118:0/3124399936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f734414ed50 0x7f73440a9310 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.631+0000 7f734a400640 1 -- 172.21.15.118:0/3124399936 >> 172.21.15.118:0/3124399936 conn(0x7f734406e790 msgr2=0x7f73440a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:19.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.632+0000 7f734a400640 1 -- 172.21.15.118:0/3124399936 shutdown_connections 2024-03-08T20:39:19.633 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.632+0000 7f734a400640 1 -- 172.21.15.118:0/3124399936 wait complete. 2024-03-08T20:39:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.633+0000 7f734a400640 1 Processor -- start 2024-03-08T20:39:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.633+0000 7f734a400640 1 -- start start 2024-03-08T20:39:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734406b790 0x7f73440722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 0x7f73441434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.634 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734406f600 con 0x7f7344155670 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734406f480 con 0x7f734414ed50 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.634+0000 7f734a400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734406f780 con 0x7f734406b790 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58984/0 (socket says 172.21.15.118:58984) 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 -- 172.21.15.118:0/3712884733 learned_addr learned my addr 172.21.15.118:0/3712884733 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7342a00640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 0x7f73441434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.635 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734406b790 0x7f73440722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 -- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734406b790 msgr2=0x7f73440722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734406b790 0x7f73440722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 -- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 msgr2=0x7f73441434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 0x7f73441434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7343e00640 1 -- 172.21.15.118:0/3712884733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440c6c70 con 0x7f7344155670 2024-03-08T20:39:19.637 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.635+0000 7f7342a00640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 0x7f73441434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f7343e00640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f733c007e90 tx=0x7f733c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c014420 con 0x7f7344155670 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c019070 con 0x7f7344155670 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c014800 con 0x7f7344155670 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73440c5a50 con 0x7f7344155670 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.636+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73440c5cf0 con 0x7f7344155670 2024-03-08T20:39:19.638 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.637+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734404f0f0 con 0x7f7344155670 2024-03-08T20:39:19.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.638+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f733c0149a0 con 0x7f7344155670 2024-03-08T20:39:19.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.639+0000 7f733b400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 0x7f732406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:19.639 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.639+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f733c08b600 con 0x7f7344155670 2024-03-08T20:39:19.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.639+0000 7f7343400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 0x7f732406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:19.640 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.640+0000 7f7343400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 0x7f732406e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7334036000 tx=0x7f733403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:19.644 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.645+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f734404f0f0 con 0x7f7344155670 2024-03-08T20:39:19.894 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.895+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7344074a40 con 0x7f732406bc00 2024-03-08T20:39:19.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.918+0000 7f733b400640 1 -- 172.21.15.118:0/3712884733 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338318 (secure 0 0 0) 0x7f733409a9a0 con 0x7f732406bc00 2024-03-08T20:39:19.922 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:39:19.924 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:39:19.926 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.923+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 msgr2=0x7f732406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.923+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 0x7f732406e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7334036000 tx=0x7f733403c040 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.923+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 msgr2=0x7f7344143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.923+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f733c007e90 tx=0x7f733c00e4b0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 shutdown_connections 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f732406bc00 0x7f732406e0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7344155670 0x7f7344143a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734414ed50 0x7f73441434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 --2- 172.21.15.118:0/3712884733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f734406b790 0x7f73440722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:19.927 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.924+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 >> 172.21.15.118:0/3712884733 conn(0x7f734406e790 msgr2=0x7f7344147c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:19.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.926+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 shutdown_connections 2024-03-08T20:39:19.928 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:19.926+0000 7f734a400640 1 -- 172.21.15.118:0/3712884733 wait complete. 2024-03-08T20:39:19.945 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-03-08T20:39:19.734066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1667285190,"num_objects":159151,"num_object_clones":0,"num_object_copies":480766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159151,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":354794,"num_write_kb":2320395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":45098891,"num_omap_keys":77979,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344555,"ondisk_log_size":344555,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5545936,"kb_used_data":2795216,"kb_used_omap":12,"kb_used_meta":2750643,"kb_avail":749428784,"statfs":{"total":773094113280,"available":767415074816,"internally_reserved":0,"allocated":2862301184,"data_stored":4189596199,"data_compressed":619906340,"data_compressed_allocated":760389632,"data_compressed_original":2089127936,"omap_allocated":12751,"internal_metadata":2816658993},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1,11,14,26,24,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50689,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12014111,"num_omap_keys":20724,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003476"},"pg_stats":[{"pgid":"2.1f","version":"27'363","reported_seq":406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.766104+0000","last_change":"2024-03-08T20:38:54.766174+0000","last_active":"2024-03-08T20:38:54.766104+0000","last_peered":"2024-03-08T20:38:54.766104+0000","last_clean":"2024-03-08T20:38:54.766104+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:54.766104+0000","last_undegraded":"2024-03-08T20:38:54.766104+0000","last_fullsized":"2024-03-08T20:38:54.766104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'363","last_scrub_stamp":"2024-03-08T20:38:54.765994+0000","last_deep_scrub":"27'363","last_deep_scrub_stamp":"2024-03-08T20:38:54.765994+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.765994+0000","objects_scrubbed":107,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:46:57.066939+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":821145,"num_omap_keys":1421,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2352","reported_seq":2434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.882109+0000","last_change":"2024-03-08T20:39:02.882153+0000","last_active":"2024-03-08T20:39:02.882109+0000","last_peered":"2024-03-08T20:39:02.882109+0000","last_clean":"2024-03-08T20:39:02.882109+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:39:02.882109+0000","last_undegraded":"2024-03-08T20:39:02.882109+0000","last_fullsized":"2024-03-08T20:39:02.882109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2352","last_scrub_stamp":"2024-03-08T20:39:02.882013+0000","last_deep_scrub":"27'2352","last_deep_scrub_stamp":"2024-03-08T20:39:02.882013+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.882013+0000","objects_scrubbed":1126,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:05.730968+0000","scrub_duration":3796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.990009+0000","last_change":"2024-03-08T20:39:09.990123+0000","last_active":"2024-03-08T20:39:09.990009+0000","last_peered":"2024-03-08T20:39:09.990009+0000","last_clean":"2024-03-08T20:39:09.990009+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:39:09.990009+0000","last_undegraded":"2024-03-08T20:39:09.990009+0000","last_fullsized":"2024-03-08T20:39:09.990009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5164","last_scrub_stamp":"2024-03-08T20:39:09.989923+0000","last_deep_scrub":"27'5164","last_deep_scrub_stamp":"2024-03-08T20:39:09.989923+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.989923+0000","objects_scrubbed":2491,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:20.032682+0000","scrub_duration":8815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'697","reported_seq":741,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.487282+0000","last_change":"2024-03-08T20:39:02.487376+0000","last_active":"2024-03-08T20:39:02.487282+0000","last_peered":"2024-03-08T20:39:02.487282+0000","last_clean":"2024-03-08T20:39:02.487282+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:39:02.487282+0000","last_undegraded":"2024-03-08T20:39:02.487282+0000","last_fullsized":"2024-03-08T20:39:02.487282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'697","last_scrub_stamp":"2024-03-08T20:39:02.487190+0000","last_deep_scrub":"27'697","last_deep_scrub_stamp":"2024-03-08T20:39:02.487190+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.487190+0000","objects_scrubbed":141,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:17.816123+0000","scrub_duration":343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1564507,"num_omap_keys":2715,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'2324","reported_seq":2405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.204769+0000","last_change":"2024-03-08T20:38:54.204874+0000","last_active":"2024-03-08T20:38:54.204769+0000","last_peered":"2024-03-08T20:38:54.204769+0000","last_clean":"2024-03-08T20:38:54.204769+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:54.204769+0000","last_undegraded":"2024-03-08T20:38:54.204769+0000","last_fullsized":"2024-03-08T20:38:54.204769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2324","last_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_deep_scrub":"27'2324","last_deep_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.204663+0000","objects_scrubbed":1123,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.294448+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5216","reported_seq":5314,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.656647+0000","last_change":"2024-03-08T20:39:05.511901+0000","last_active":"2024-03-08T20:39:14.656647+0000","last_peered":"2024-03-08T20:39:14.656647+0000","last_clean":"2024-03-08T20:39:14.656647+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:39:14.656647+0000","last_undegraded":"2024-03-08T20:39:14.656647+0000","last_fullsized":"2024-03-08T20:39:14.656647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1799,"log_size":5216,"log_dups_size":0,"ondisk_log_size":5216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7593,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'669","reported_seq":714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.158178+0000","last_change":"2024-03-08T20:39:10.158227+0000","last_active":"2024-03-08T20:39:10.158178+0000","last_peered":"2024-03-08T20:39:10.158178+0000","last_clean":"2024-03-08T20:39:10.158178+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:39:10.158178+0000","last_undegraded":"2024-03-08T20:39:10.158178+0000","last_fullsized":"2024-03-08T20:39:10.158178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'669","last_scrub_stamp":"2024-03-08T20:39:10.158078+0000","last_deep_scrub":"27'669","last_deep_scrub_stamp":"2024-03-08T20:39:10.158078+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.158078+0000","objects_scrubbed":151,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:08.223643+0000","scrub_duration":1525,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1841975,"num_omap_keys":3183,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2050","reported_seq":2114,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.562428+0000","last_change":"2024-03-08T20:39:07.459423+0000","last_active":"2024-03-08T20:39:16.562428+0000","last_peered":"2024-03-08T20:39:16.562428+0000","last_clean":"2024-03-08T20:39:16.562428+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:39:16.562428+0000","last_undegraded":"2024-03-08T20:39:16.562428+0000","last_fullsized":"2024-03-08T20:39:16.562428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":799,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5265","reported_seq":5351,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.633698+0000","last_change":"2024-03-08T20:39:07.580730+0000","last_active":"2024-03-08T20:39:14.633698+0000","last_peered":"2024-03-08T20:39:14.633698+0000","last_clean":"2024-03-08T20:39:14.633698+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:39:14.633698+0000","last_undegraded":"2024-03-08T20:39:14.633698+0000","last_fullsized":"2024-03-08T20:39:14.633698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1499,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7645,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'452","reported_seq":496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.145507+0000","last_change":"2024-03-08T20:39:15.145610+0000","last_active":"2024-03-08T20:39:15.145507+0000","last_peered":"2024-03-08T20:39:15.145507+0000","last_clean":"2024-03-08T20:39:15.145507+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:39:15.145507+0000","last_undegraded":"2024-03-08T20:39:15.145507+0000","last_fullsized":"2024-03-08T20:39:15.145507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'452","last_scrub_stamp":"2024-03-08T20:39:15.145404+0000","last_deep_scrub":"27'452","last_deep_scrub_stamp":"2024-03-08T20:39:15.145404+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.145404+0000","objects_scrubbed":141,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:19.596874+0000","scrub_duration":2613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1279988,"num_omap_keys":2212,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'1851","reported_seq":1907,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.675570+0000","last_change":"2024-03-08T20:39:09.743161+0000","last_active":"2024-03-08T20:39:16.675570+0000","last_peered":"2024-03-08T20:39:16.675570+0000","last_clean":"2024-03-08T20:39:16.675570+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:39:16.675570+0000","last_undegraded":"2024-03-08T20:39:16.675570+0000","last_fullsized":"2024-03-08T20:39:16.675570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":599,"log_size":1851,"log_dups_size":0,"ondisk_log_size":1851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5155","reported_seq":5254,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.535491+0000","last_change":"2024-03-08T20:39:03.262673+0000","last_active":"2024-03-08T20:39:14.535491+0000","last_peered":"2024-03-08T20:39:14.535491+0000","last_clean":"2024-03-08T20:39:14.535491+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:39:14.535491+0000","last_undegraded":"2024-03-08T20:39:14.535491+0000","last_fullsized":"2024-03-08T20:39:14.535491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1824,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7522,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'2301","reported_seq":2358,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.675641+0000","last_change":"2024-03-08T20:39:06.673297+0000","last_active":"2024-03-08T20:39:14.675641+0000","last_peered":"2024-03-08T20:39:14.675641+0000","last_clean":"2024-03-08T20:39:14.675641+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:39:14.675641+0000","last_undegraded":"2024-03-08T20:39:14.675641+0000","last_fullsized":"2024-03-08T20:39:14.675641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":1049,"log_size":2301,"log_dups_size":0,"ondisk_log_size":2301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'545","reported_seq":589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.198648+0000","last_change":"2024-03-08T20:39:12.198790+0000","last_active":"2024-03-08T20:39:12.198648+0000","last_peered":"2024-03-08T20:39:12.198648+0000","last_clean":"2024-03-08T20:39:12.198648+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:39:12.198648+0000","last_undegraded":"2024-03-08T20:39:12.198648+0000","last_fullsized":"2024-03-08T20:39:12.198648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'545","last_scrub_stamp":"2024-03-08T20:39:12.196914+0000","last_deep_scrub":"27'545","last_deep_scrub_stamp":"2024-03-08T20:39:12.196914+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.196914+0000","objects_scrubbed":148,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:55.799268+0000","scrub_duration":1662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2521840,"num_omap_keys":4331,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5284","reported_seq":5418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.446889+0000","last_change":"2024-03-08T20:39:10.447041+0000","last_active":"2024-03-08T20:39:10.446889+0000","last_peered":"2024-03-08T20:39:10.446889+0000","last_clean":"2024-03-08T20:39:10.446889+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:39:10.446889+0000","last_undegraded":"2024-03-08T20:39:10.446889+0000","last_fullsized":"2024-03-08T20:39:10.446889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5284","last_scrub_stamp":"2024-03-08T20:39:10.446789+0000","last_deep_scrub":"27'5284","last_deep_scrub_stamp":"2024-03-08T20:39:10.446789+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.446789+0000","objects_scrubbed":2560,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:59.615129+0000","scrub_duration":8168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7680,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'2484","reported_seq":2569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.155625+0000","last_change":"2024-03-08T20:39:13.155692+0000","last_active":"2024-03-08T20:39:13.155625+0000","last_peered":"2024-03-08T20:39:13.155625+0000","last_clean":"2024-03-08T20:39:13.155625+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:39:13.155625+0000","last_undegraded":"2024-03-08T20:39:13.155625+0000","last_fullsized":"2024-03-08T20:39:13.155625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2484","last_scrub_stamp":"2024-03-08T20:39:13.155529+0000","last_deep_scrub":"27'2484","last_deep_scrub_stamp":"2024-03-08T20:39:13.155529+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.155529+0000","objects_scrubbed":1185,"log_size":2484,"log_dups_size":0,"ondisk_log_size":2484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:28.003994+0000","scrub_duration":6894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1641","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.608835+0000","last_change":"2024-03-08T20:39:00.608909+0000","last_active":"2024-03-08T20:39:00.608835+0000","last_peered":"2024-03-08T20:39:00.608835+0000","last_clean":"2024-03-08T20:39:00.608835+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:39:00.608835+0000","last_undegraded":"2024-03-08T20:39:00.608835+0000","last_fullsized":"2024-03-08T20:39:00.608835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1641","last_scrub_stamp":"2024-03-08T20:39:00.608720+0000","last_deep_scrub":"27'1641","last_deep_scrub_stamp":"2024-03-08T20:39:00.608720+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.608720+0000","objects_scrubbed":134,"log_size":1641,"log_dups_size":0,"ondisk_log_size":1641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:57:58.141039+0000","scrub_duration":596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1230536,"num_omap_keys":2134,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5273","reported_seq":5356,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.741791+0000","last_change":"2024-03-08T20:39:06.546689+0000","last_active":"2024-03-08T20:39:14.741791+0000","last_peered":"2024-03-08T20:39:14.741791+0000","last_clean":"2024-03-08T20:39:14.741791+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:39:14.741791+0000","last_undegraded":"2024-03-08T20:39:14.741791+0000","last_fullsized":"2024-03-08T20:39:14.741791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1399,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7687,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'2472","reported_seq":2557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.494345+0000","last_change":"2024-03-08T20:39:12.494410+0000","last_active":"2024-03-08T20:39:12.494345+0000","last_peered":"2024-03-08T20:39:12.494345+0000","last_clean":"2024-03-08T20:39:12.494345+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:39:12.494345+0000","last_undegraded":"2024-03-08T20:39:12.494345+0000","last_fullsized":"2024-03-08T20:39:12.494345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2472","last_scrub_stamp":"2024-03-08T20:39:12.494254+0000","last_deep_scrub":"27'2472","last_deep_scrub_stamp":"2024-03-08T20:39:12.494254+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.494254+0000","objects_scrubbed":1181,"log_size":2472,"log_dups_size":0,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:23.479524+0000","scrub_duration":7290,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1181,"num_object_clones":0,"num_object_copies":2362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'599","reported_seq":644,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.681385+0000","last_change":"2024-03-08T20:39:01.681470+0000","last_active":"2024-03-08T20:39:01.681385+0000","last_peered":"2024-03-08T20:39:01.681385+0000","last_clean":"2024-03-08T20:39:01.681385+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:39:01.681385+0000","last_undegraded":"2024-03-08T20:39:01.681385+0000","last_fullsized":"2024-03-08T20:39:01.681385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'599","last_scrub_stamp":"2024-03-08T20:39:01.681290+0000","last_deep_scrub":"27'599","last_deep_scrub_stamp":"2024-03-08T20:39:01.681290+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.681290+0000","objects_scrubbed":162,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:50.849631+0000","scrub_duration":629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1593318,"num_omap_keys":2762,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5277,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.951121+0000","last_change":"2024-03-08T20:39:10.275646+0000","last_active":"2024-03-08T20:39:16.951121+0000","last_peered":"2024-03-08T20:39:16.951121+0000","last_clean":"2024-03-08T20:39:16.951121+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:39:16.951121+0000","last_undegraded":"2024-03-08T20:39:16.951121+0000","last_fullsized":"2024-03-08T20:39:16.951121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1399,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2478","reported_seq":2563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.478457+0000","last_change":"2024-03-08T20:38:59.478515+0000","last_active":"2024-03-08T20:38:59.478457+0000","last_peered":"2024-03-08T20:38:59.478457+0000","last_clean":"2024-03-08T20:38:59.478457+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:59.478457+0000","last_undegraded":"2024-03-08T20:38:59.478457+0000","last_fullsized":"2024-03-08T20:38:59.478457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2478","last_scrub_stamp":"2024-03-08T20:38:59.478393+0000","last_deep_scrub":"27'2478","last_deep_scrub_stamp":"2024-03-08T20:38:59.478393+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.478393+0000","objects_scrubbed":1193,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:10.906250+0000","scrub_duration":2353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1193,"num_object_clones":0,"num_object_copies":2386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1110","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.527843+0000","last_change":"2024-03-08T20:39:10.527879+0000","last_active":"2024-03-08T20:39:10.527843+0000","last_peered":"2024-03-08T20:39:10.527843+0000","last_clean":"2024-03-08T20:39:10.527843+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:39:10.527843+0000","last_undegraded":"2024-03-08T20:39:10.527843+0000","last_fullsized":"2024-03-08T20:39:10.527843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1110","last_scrub_stamp":"2024-03-08T20:39:10.527760+0000","last_deep_scrub":"27'1110","last_deep_scrub_stamp":"2024-03-08T20:39:10.527760+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.527760+0000","objects_scrubbed":150,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:25.856693+0000","scrub_duration":981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1312584,"num_omap_keys":2276,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5284","reported_seq":5412,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.615925+0000","last_change":"2024-03-08T20:39:04.432526+0000","last_active":"2024-03-08T20:39:14.615925+0000","last_peered":"2024-03-08T20:39:14.615925+0000","last_clean":"2024-03-08T20:39:14.615925+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:39:14.615925+0000","last_undegraded":"2024-03-08T20:39:14.615925+0000","last_fullsized":"2024-03-08T20:39:14.615925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":2524,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 10s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2401","reported_seq":2485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.317181+0000","last_change":"2024-03-08T20:39:02.317227+0000","last_active":"2024-03-08T20:39:02.317181+0000","last_peered":"2024-03-08T20:39:02.317181+0000","last_clean":"2024-03-08T20:39:02.317181+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:39:02.317181+0000","last_undegraded":"2024-03-08T20:39:02.317181+0000","last_fullsized":"2024-03-08T20:39:02.317181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2401","last_scrub_stamp":"2024-03-08T20:39:02.317094+0000","last_deep_scrub":"27'2401","last_deep_scrub_stamp":"2024-03-08T20:39:02.317094+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.317094+0000","objects_scrubbed":1152,"log_size":2401,"log_dups_size":0,"ondisk_log_size":2401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:50.606813+0000","scrub_duration":2692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'435","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.991976+0000","last_change":"2024-03-08T20:39:01.992035+0000","last_active":"2024-03-08T20:39:01.991976+0000","last_peered":"2024-03-08T20:39:01.991976+0000","last_clean":"2024-03-08T20:39:01.991976+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:39:01.991976+0000","last_undegraded":"2024-03-08T20:39:01.991976+0000","last_fullsized":"2024-03-08T20:39:01.991976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'435","last_scrub_stamp":"2024-03-08T20:39:01.991886+0000","last_deep_scrub":"27'435","last_deep_scrub_stamp":"2024-03-08T20:39:01.991886+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.991886+0000","objects_scrubbed":130,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:47:04.292831+0000","scrub_duration":433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":987819,"num_omap_keys":1709,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5236","reported_seq":5288,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.652147+0000","last_change":"2024-03-08T20:39:09.947749+0000","last_active":"2024-03-08T20:39:14.652147+0000","last_peered":"2024-03-08T20:39:14.652147+0000","last_clean":"2024-03-08T20:39:14.652147+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:39:14.652147+0000","last_undegraded":"2024-03-08T20:39:14.652147+0000","last_fullsized":"2024-03-08T20:39:14.652147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":624,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7619,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2359","reported_seq":2441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.601460+0000","last_change":"2024-03-08T20:39:17.601514+0000","last_active":"2024-03-08T20:39:17.601460+0000","last_peered":"2024-03-08T20:39:17.601460+0000","last_clean":"2024-03-08T20:39:17.601460+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:39:17.601460+0000","last_undegraded":"2024-03-08T20:39:17.601460+0000","last_fullsized":"2024-03-08T20:39:17.601460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2359","last_scrub_stamp":"2024-03-08T20:39:17.601371+0000","last_deep_scrub":"27'2359","last_deep_scrub_stamp":"2024-03-08T20:39:17.601371+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.601371+0000","objects_scrubbed":1104,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:09:19.150475+0000","scrub_duration":5959,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1104,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'900","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.419221+0000","last_change":"2024-03-08T20:38:58.419360+0000","last_active":"2024-03-08T20:38:58.419221+0000","last_peered":"2024-03-08T20:38:58.419221+0000","last_clean":"2024-03-08T20:38:58.419221+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:58.419221+0000","last_undegraded":"2024-03-08T20:38:58.419221+0000","last_fullsized":"2024-03-08T20:38:58.419221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'900","last_scrub_stamp":"2024-03-08T20:38:58.419125+0000","last_deep_scrub":"27'900","last_deep_scrub_stamp":"2024-03-08T20:38:58.419125+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.419125+0000","objects_scrubbed":117,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:14:11.704657+0000","scrub_duration":350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":997811,"num_omap_keys":1729,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5227","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:07.854141+0000","last_change":"2024-03-08T20:39:07.854312+0000","last_active":"2024-03-08T20:39:07.854141+0000","last_peered":"2024-03-08T20:39:07.854141+0000","last_clean":"2024-03-08T20:39:07.854141+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:39:07.854141+0000","last_undegraded":"2024-03-08T20:39:07.854141+0000","last_fullsized":"2024-03-08T20:39:07.854141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5227","last_scrub_stamp":"2024-03-08T20:39:07.854037+0000","last_deep_scrub":"27'5227","last_deep_scrub_stamp":"2024-03-08T20:39:07.854037+0000","last_clean_scrub_stamp":"2024-03-08T20:39:07.854037+0000","objects_scrubbed":2545,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:44.614311+0000","scrub_duration":7726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7622,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'2431","reported_seq":2515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.091109+0000","last_change":"2024-03-08T20:39:06.091137+0000","last_active":"2024-03-08T20:39:06.091109+0000","last_peered":"2024-03-08T20:39:06.091109+0000","last_clean":"2024-03-08T20:39:06.091109+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:39:06.091109+0000","last_undegraded":"2024-03-08T20:39:06.091109+0000","last_fullsized":"2024-03-08T20:39:06.091109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2431","last_scrub_stamp":"2024-03-08T20:39:06.091045+0000","last_deep_scrub":"27'2431","last_deep_scrub_stamp":"2024-03-08T20:39:06.091045+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.091045+0000","objects_scrubbed":1176,"log_size":2431,"log_dups_size":0,"ondisk_log_size":2431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:08.940000+0000","scrub_duration":3996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'578","reported_seq":622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.896446+0000","last_change":"2024-03-08T20:39:08.896545+0000","last_active":"2024-03-08T20:39:08.896446+0000","last_peered":"2024-03-08T20:39:08.896446+0000","last_clean":"2024-03-08T20:39:08.896446+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:39:08.896446+0000","last_undegraded":"2024-03-08T20:39:08.896446+0000","last_fullsized":"2024-03-08T20:39:08.896446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'578","last_scrub_stamp":"2024-03-08T20:39:08.896357+0000","last_deep_scrub":"27'578","last_deep_scrub_stamp":"2024-03-08T20:39:08.896357+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.896357+0000","objects_scrubbed":145,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:31:58.912503+0000","scrub_duration":1394,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1639644,"num_omap_keys":2838,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5371,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.589506+0000","last_change":"2024-03-08T20:39:09.309750+0000","last_active":"2024-03-08T20:39:14.589506+0000","last_peered":"2024-03-08T20:39:14.589506+0000","last_clean":"2024-03-08T20:39:14.589506+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:39:14.589506+0000","last_undegraded":"2024-03-08T20:39:14.589506+0000","last_fullsized":"2024-03-08T20:39:14.589506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1074,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'2349","reported_seq":2418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.790629+0000","last_change":"2024-03-08T20:39:09.790709+0000","last_active":"2024-03-08T20:39:09.790629+0000","last_peered":"2024-03-08T20:39:09.790629+0000","last_clean":"2024-03-08T20:39:09.790629+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:39:09.790629+0000","last_undegraded":"2024-03-08T20:39:09.790629+0000","last_fullsized":"2024-03-08T20:39:09.790629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2349","last_scrub_stamp":"2024-03-08T20:39:09.790491+0000","last_deep_scrub":"27'2349","last_deep_scrub_stamp":"2024-03-08T20:39:09.790491+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.790491+0000","objects_scrubbed":1140,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:21.218349+0000","scrub_duration":6430,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2132","reported_seq":2176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.519584+0000","last_change":"2024-03-08T20:38:56.519663+0000","last_active":"2024-03-08T20:38:56.519584+0000","last_peered":"2024-03-08T20:38:56.519584+0000","last_clean":"2024-03-08T20:38:56.519584+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:56.519584+0000","last_undegraded":"2024-03-08T20:38:56.519584+0000","last_fullsized":"2024-03-08T20:38:56.519584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2132","last_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_deep_scrub":"27'2132","last_deep_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.519479+0000","objects_scrubbed":135,"log_size":2132,"log_dups_size":0,"ondisk_log_size":2132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:38:08.647763+0000","scrub_duration":370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5326,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.940053+0000","last_change":"2024-03-08T20:39:06.201492+0000","last_active":"2024-03-08T20:39:16.940053+0000","last_peered":"2024-03-08T20:39:16.940053+0000","last_clean":"2024-03-08T20:39:16.940053+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:39:16.940053+0000","last_undegraded":"2024-03-08T20:39:16.940053+0000","last_fullsized":"2024-03-08T20:39:16.940053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1774,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 11s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'2349","reported_seq":2432,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.869179+0000","last_change":"2024-03-08T20:39:08.869247+0000","last_active":"2024-03-08T20:39:08.869179+0000","last_peered":"2024-03-08T20:39:08.869179+0000","last_clean":"2024-03-08T20:39:08.869179+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:39:08.869179+0000","last_undegraded":"2024-03-08T20:39:08.869179+0000","last_fullsized":"2024-03-08T20:39:08.869179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2349","last_scrub_stamp":"2024-03-08T20:39:08.869082+0000","last_deep_scrub":"27'2349","last_deep_scrub_stamp":"2024-03-08T20:39:08.869082+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.869082+0000","objects_scrubbed":1134,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:14:32.281972+0000","scrub_duration":8648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'1014","reported_seq":1058,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.440907+0000","last_change":"2024-03-08T20:38:57.441007+0000","last_active":"2024-03-08T20:38:57.440907+0000","last_peered":"2024-03-08T20:38:57.440907+0000","last_clean":"2024-03-08T20:38:57.440907+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:57.440907+0000","last_undegraded":"2024-03-08T20:38:57.440907+0000","last_fullsized":"2024-03-08T20:38:57.440907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1014","last_scrub_stamp":"2024-03-08T20:38:57.440808+0000","last_deep_scrub":"27'1014","last_deep_scrub_stamp":"2024-03-08T20:38:57.440808+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.440808+0000","objects_scrubbed":147,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.757906+0000","scrub_duration":223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1260121,"num_omap_keys":2182,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.860579+0000","last_change":"2024-03-08T20:39:15.860628+0000","last_active":"2024-03-08T20:39:15.860579+0000","last_peered":"2024-03-08T20:39:15.860579+0000","last_clean":"2024-03-08T20:39:15.860579+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:39:15.860579+0000","last_undegraded":"2024-03-08T20:39:15.860579+0000","last_fullsized":"2024-03-08T20:39:15.860579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5224","last_scrub_stamp":"2024-03-08T20:39:15.860470+0000","last_deep_scrub":"27'5224","last_deep_scrub_stamp":"2024-03-08T20:39:15.860470+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.860470+0000","objects_scrubbed":2525,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:25.903230+0000","scrub_duration":7536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'2422","reported_seq":2506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:07.815802+0000","last_change":"2024-03-08T20:39:07.815897+0000","last_active":"2024-03-08T20:39:07.815802+0000","last_peered":"2024-03-08T20:39:07.815802+0000","last_clean":"2024-03-08T20:39:07.815802+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:39:07.815802+0000","last_undegraded":"2024-03-08T20:39:07.815802+0000","last_fullsized":"2024-03-08T20:39:07.815802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2422","last_scrub_stamp":"2024-03-08T20:39:07.815730+0000","last_deep_scrub":"27'2422","last_deep_scrub_stamp":"2024-03-08T20:39:07.815730+0000","last_clean_scrub_stamp":"2024-03-08T20:39:07.815730+0000","objects_scrubbed":1174,"log_size":2422,"log_dups_size":0,"ondisk_log_size":2422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:51.418083+0000","scrub_duration":4671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1538","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.547957+0000","last_change":"2024-03-08T20:38:56.548011+0000","last_active":"2024-03-08T20:38:56.547957+0000","last_peered":"2024-03-08T20:38:56.547957+0000","last_clean":"2024-03-08T20:38:56.547957+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:56.547957+0000","last_undegraded":"2024-03-08T20:38:56.547957+0000","last_fullsized":"2024-03-08T20:38:56.547957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1538","last_scrub_stamp":"2024-03-08T20:38:56.547886+0000","last_deep_scrub":"27'1538","last_deep_scrub_stamp":"2024-03-08T20:38:56.547886+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.547886+0000","objects_scrubbed":137,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:23:30.357392+0000","scrub_duration":295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1236571,"num_omap_keys":2143,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.656983+0000","last_change":"2024-03-08T20:39:15.657162+0000","last_active":"2024-03-08T20:39:15.656983+0000","last_peered":"2024-03-08T20:39:15.656983+0000","last_clean":"2024-03-08T20:39:15.656983+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:39:15.656983+0000","last_undegraded":"2024-03-08T20:39:15.656983+0000","last_fullsized":"2024-03-08T20:39:15.656983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5239","last_scrub_stamp":"2024-03-08T20:39:15.656887+0000","last_deep_scrub":"27'5239","last_deep_scrub_stamp":"2024-03-08T20:39:15.656887+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.656887+0000","objects_scrubbed":2498,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:04.545424+0000","scrub_duration":8344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2287","reported_seq":2369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.870083+0000","last_change":"2024-03-08T20:39:05.870145+0000","last_active":"2024-03-08T20:39:05.870083+0000","last_peered":"2024-03-08T20:39:05.870083+0000","last_clean":"2024-03-08T20:39:05.870083+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:39:05.870083+0000","last_undegraded":"2024-03-08T20:39:05.870083+0000","last_fullsized":"2024-03-08T20:39:05.870083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2287","last_scrub_stamp":"2024-03-08T20:39:05.869991+0000","last_deep_scrub":"27'2287","last_deep_scrub_stamp":"2024-03-08T20:39:05.869991+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.869991+0000","objects_scrubbed":1105,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:08.718947+0000","scrub_duration":5216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'744","reported_seq":788,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.314917+0000","last_change":"2024-03-08T20:39:12.315010+0000","last_active":"2024-03-08T20:39:12.314917+0000","last_peered":"2024-03-08T20:39:12.314917+0000","last_clean":"2024-03-08T20:39:12.314917+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:39:12.314917+0000","last_undegraded":"2024-03-08T20:39:12.314917+0000","last_fullsized":"2024-03-08T20:39:12.314917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'744","last_scrub_stamp":"2024-03-08T20:39:12.314837+0000","last_deep_scrub":"27'744","last_deep_scrub_stamp":"2024-03-08T20:39:12.314837+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.314837+0000","objects_scrubbed":141,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:12.359425+0000","scrub_duration":791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1964707,"num_omap_keys":3373,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5514,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.678051+0000","last_change":"2024-03-08T20:39:08.129320+0000","last_active":"2024-03-08T20:39:14.678051+0000","last_peered":"2024-03-08T20:39:14.678051+0000","last_clean":"2024-03-08T20:39:14.678051+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:39:14.678051+0000","last_undegraded":"2024-03-08T20:39:14.678051+0000","last_fullsized":"2024-03-08T20:39:14.678051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1824,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'2438","reported_seq":2508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.779075+0000","last_change":"2024-03-08T20:38:55.779145+0000","last_active":"2024-03-08T20:38:55.779075+0000","last_peered":"2024-03-08T20:38:55.779075+0000","last_clean":"2024-03-08T20:38:55.779075+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:55.779075+0000","last_undegraded":"2024-03-08T20:38:55.779075+0000","last_fullsized":"2024-03-08T20:38:55.779075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2438","last_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_deep_scrub":"27'2438","last_deep_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.778847+0000","objects_scrubbed":1188,"log_size":2438,"log_dups_size":0,"ondisk_log_size":2438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:46:58.079791+0000","scrub_duration":1601,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'653","reported_seq":698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.610744+0000","last_change":"2024-03-08T20:38:59.610839+0000","last_active":"2024-03-08T20:38:59.610744+0000","last_peered":"2024-03-08T20:38:59.610744+0000","last_clean":"2024-03-08T20:38:59.610744+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:59.610744+0000","last_undegraded":"2024-03-08T20:38:59.610744+0000","last_fullsized":"2024-03-08T20:38:59.610744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'653","last_scrub_stamp":"2024-03-08T20:38:59.610642+0000","last_deep_scrub":"27'653","last_deep_scrub_stamp":"2024-03-08T20:38:59.610642+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.610642+0000","objects_scrubbed":165,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:27.893260+0000","scrub_duration":323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1298062,"num_omap_keys":2248,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.568990+0000","last_change":"2024-03-08T20:39:06.569047+0000","last_active":"2024-03-08T20:39:06.568990+0000","last_peered":"2024-03-08T20:39:06.568990+0000","last_clean":"2024-03-08T20:39:06.568990+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:39:06.568990+0000","last_undegraded":"2024-03-08T20:39:06.568990+0000","last_fullsized":"2024-03-08T20:39:06.568990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-08T20:39:06.568896+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-08T20:39:06.568896+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.568896+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:58:04.101215+0000","scrub_duration":108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5208,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.573707+0000","last_change":"2024-03-08T20:39:12.108567+0000","last_active":"2024-03-08T20:39:14.573707+0000","last_peered":"2024-03-08T20:39:14.573707+0000","last_clean":"2024-03-08T20:39:14.573707+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:39:14.573707+0000","last_undegraded":"2024-03-08T20:39:14.573707+0000","last_fullsized":"2024-03-08T20:39:14.573707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":474,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2409","reported_seq":2492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.230902+0000","last_change":"2024-03-08T20:39:17.230997+0000","last_active":"2024-03-08T20:39:17.230902+0000","last_peered":"2024-03-08T20:39:17.230902+0000","last_clean":"2024-03-08T20:39:17.230902+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:39:17.230902+0000","last_undegraded":"2024-03-08T20:39:17.230902+0000","last_fullsized":"2024-03-08T20:39:17.230902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2409","last_scrub_stamp":"2024-03-08T20:39:17.230797+0000","last_deep_scrub":"27'2409","last_deep_scrub_stamp":"2024-03-08T20:39:17.230797+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.230797+0000","objects_scrubbed":1144,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:04:55.556155+0000","scrub_duration":11763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1535","reported_seq":1579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.613505+0000","last_change":"2024-03-08T20:38:57.613592+0000","last_active":"2024-03-08T20:38:57.613505+0000","last_peered":"2024-03-08T20:38:57.613505+0000","last_clean":"2024-03-08T20:38:57.613505+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:57.613505+0000","last_undegraded":"2024-03-08T20:38:57.613505+0000","last_fullsized":"2024-03-08T20:38:57.613505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1535","last_scrub_stamp":"2024-03-08T20:38:57.613417+0000","last_deep_scrub":"27'1535","last_deep_scrub_stamp":"2024-03-08T20:38:57.613417+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.613417+0000","objects_scrubbed":140,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:24:04.955836+0000","scrub_duration":334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1667,"num_write_kb":30964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":136,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1361429,"num_omap_keys":2359,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5325","reported_seq":5381,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.502866+0000","last_change":"2024-03-08T20:39:10.750469+0000","last_active":"2024-03-08T20:39:14.502866+0000","last_peered":"2024-03-08T20:39:14.502866+0000","last_clean":"2024-03-08T20:39:14.502866+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:39:14.502866+0000","last_undegraded":"2024-03-08T20:39:14.502866+0000","last_fullsized":"2024-03-08T20:39:14.502866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":724,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7695,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'2393","reported_seq":2477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.118998+0000","last_change":"2024-03-08T20:39:08.119049+0000","last_active":"2024-03-08T20:39:08.118998+0000","last_peered":"2024-03-08T20:39:08.118998+0000","last_clean":"2024-03-08T20:39:08.118998+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:39:08.118998+0000","last_undegraded":"2024-03-08T20:39:08.118998+0000","last_fullsized":"2024-03-08T20:39:08.118998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2393","last_scrub_stamp":"2024-03-08T20:39:08.118910+0000","last_deep_scrub":"27'2393","last_deep_scrub_stamp":"2024-03-08T20:39:08.118910+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.118910+0000","objects_scrubbed":1152,"log_size":2393,"log_dups_size":0,"ondisk_log_size":2393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:23.447843+0000","scrub_duration":5841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1644","reported_seq":1688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.517726+0000","last_change":"2024-03-08T20:38:59.517842+0000","last_active":"2024-03-08T20:38:59.517726+0000","last_peered":"2024-03-08T20:38:59.517726+0000","last_clean":"2024-03-08T20:38:59.517726+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:59.517726+0000","last_undegraded":"2024-03-08T20:38:59.517726+0000","last_fullsized":"2024-03-08T20:38:59.517726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1644","last_scrub_stamp":"2024-03-08T20:38:59.517631+0000","last_deep_scrub":"27'1644","last_deep_scrub_stamp":"2024-03-08T20:38:59.517631+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.517631+0000","objects_scrubbed":144,"log_size":1644,"log_dups_size":0,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:15.588122+0000","scrub_duration":469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1718618,"num_omap_keys":2960,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5472,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.634262+0000","last_change":"2024-03-08T20:39:05.914066+0000","last_active":"2024-03-08T20:39:14.634262+0000","last_peered":"2024-03-08T20:39:14.634262+0000","last_clean":"2024-03-08T20:39:14.634262+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:39:14.634262+0000","last_undegraded":"2024-03-08T20:39:14.634262+0000","last_fullsized":"2024-03-08T20:39:14.634262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1549,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 8s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'1866","reported_seq":1925,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.508577+0000","last_change":"2024-03-08T20:39:14.542604+0000","last_active":"2024-03-08T20:39:19.508577+0000","last_peered":"2024-03-08T20:39:19.508577+0000","last_clean":"2024-03-08T20:39:19.508577+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:39:19.508577+0000","last_undegraded":"2024-03-08T20:39:19.508577+0000","last_fullsized":"2024-03-08T20:39:19.508577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":649,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1097,"num_object_clones":0,"num_object_copies":2194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1493","reported_seq":1537,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.495664+0000","last_change":"2024-03-08T20:38:55.495728+0000","last_active":"2024-03-08T20:38:55.495664+0000","last_peered":"2024-03-08T20:38:55.495664+0000","last_clean":"2024-03-08T20:38:55.495664+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:55.495664+0000","last_undegraded":"2024-03-08T20:38:55.495664+0000","last_fullsized":"2024-03-08T20:38:55.495664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1493","last_scrub_stamp":"2024-03-08T20:38:55.495557+0000","last_deep_scrub":"27'1493","last_deep_scrub_stamp":"2024-03-08T20:38:55.495557+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.495557+0000","objects_scrubbed":130,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:35:22.234642+0000","scrub_duration":217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":771215,"num_omap_keys":1334,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5367,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.421062+0000","last_change":"2024-03-08T20:39:12.263504+0000","last_active":"2024-03-08T20:39:16.421062+0000","last_peered":"2024-03-08T20:39:16.421062+0000","last_clean":"2024-03-08T20:39:16.421062+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:39:16.421062+0000","last_undegraded":"2024-03-08T20:39:16.421062+0000","last_fullsized":"2024-03-08T20:39:16.421062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":524,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'1941","reported_seq":1974,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.488604+0000","last_change":"2024-03-08T20:39:15.613948+0000","last_active":"2024-03-08T20:39:19.488604+0000","last_peered":"2024-03-08T20:39:19.488604+0000","last_clean":"2024-03-08T20:39:19.488604+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:39:19.488604+0000","last_undegraded":"2024-03-08T20:39:19.488604+0000","last_fullsized":"2024-03-08T20:39:19.488604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":624,"log_size":1941,"log_dups_size":0,"ondisk_log_size":1941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'488","reported_seq":533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.329279+0000","last_change":"2024-03-08T20:38:56.329318+0000","last_active":"2024-03-08T20:38:56.329279+0000","last_peered":"2024-03-08T20:38:56.329279+0000","last_clean":"2024-03-08T20:38:56.329279+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:56.329279+0000","last_undegraded":"2024-03-08T20:38:56.329279+0000","last_fullsized":"2024-03-08T20:38:56.329279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'488","last_scrub_stamp":"2024-03-08T20:38:56.329183+0000","last_deep_scrub":"27'488","last_deep_scrub_stamp":"2024-03-08T20:38:56.329183+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.329183+0000","objects_scrubbed":153,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:24.354098+0000","scrub_duration":216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1479451,"num_omap_keys":2563,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5314","reported_seq":5378,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.524252+0000","last_change":"2024-03-08T20:39:08.730538+0000","last_active":"2024-03-08T20:39:14.524252+0000","last_peered":"2024-03-08T20:39:14.524252+0000","last_clean":"2024-03-08T20:39:14.524252+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:39:14.524252+0000","last_undegraded":"2024-03-08T20:39:14.524252+0000","last_fullsized":"2024-03-08T20:39:14.524252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":899,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7713,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'1725","reported_seq":1773,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.517216+0000","last_change":"2024-03-08T20:39:16.723659+0000","last_active":"2024-03-08T20:39:19.517216+0000","last_peered":"2024-03-08T20:39:19.517216+0000","last_clean":"2024-03-08T20:39:19.517216+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:39:19.517216+0000","last_undegraded":"2024-03-08T20:39:19.517216+0000","last_fullsized":"2024-03-08T20:39:19.517216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":399,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'642","reported_seq":687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.540425+0000","last_change":"2024-03-08T20:38:54.540497+0000","last_active":"2024-03-08T20:38:54.540425+0000","last_peered":"2024-03-08T20:38:54.540425+0000","last_clean":"2024-03-08T20:38:54.540425+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:54.540425+0000","last_undegraded":"2024-03-08T20:38:54.540425+0000","last_fullsized":"2024-03-08T20:38:54.540425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'642","last_scrub_stamp":"2024-03-08T20:38:54.540334+0000","last_deep_scrub":"27'642","last_deep_scrub_stamp":"2024-03-08T20:38:54.540334+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.540334+0000","objects_scrubbed":160,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:03.998460+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1925943,"num_omap_keys":3340,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5309,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.651691+0000","last_change":"2024-03-08T20:39:07.106809+0000","last_active":"2024-03-08T20:39:14.651691+0000","last_peered":"2024-03-08T20:39:14.651691+0000","last_clean":"2024-03-08T20:39:14.651691+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:39:14.651691+0000","last_undegraded":"2024-03-08T20:39:14.651691+0000","last_fullsized":"2024-03-08T20:39:14.651691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":2224,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2326","reported_seq":2409,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:11.598864+0000","last_change":"2024-03-08T20:39:11.598914+0000","last_active":"2024-03-08T20:39:11.598864+0000","last_peered":"2024-03-08T20:39:11.598864+0000","last_clean":"2024-03-08T20:39:11.598864+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:39:11.598864+0000","last_undegraded":"2024-03-08T20:39:11.598864+0000","last_fullsized":"2024-03-08T20:39:11.598864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2326","last_scrub_stamp":"2024-03-08T20:39:11.598729+0000","last_deep_scrub":"27'2326","last_deep_scrub_stamp":"2024-03-08T20:39:11.598729+0000","last_clean_scrub_stamp":"2024-03-08T20:39:11.598729+0000","objects_scrubbed":1128,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.888448+0000","scrub_duration":8078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'580","reported_seq":624,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.000077+0000","last_change":"2024-03-08T20:39:00.000162+0000","last_active":"2024-03-08T20:39:00.000077+0000","last_peered":"2024-03-08T20:39:00.000077+0000","last_clean":"2024-03-08T20:39:00.000077+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:39:00.000077+0000","last_undegraded":"2024-03-08T20:39:00.000077+0000","last_fullsized":"2024-03-08T20:39:00.000077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'580","last_scrub_stamp":"2024-03-08T20:38:59.999962+0000","last_deep_scrub":"27'580","last_deep_scrub_stamp":"2024-03-08T20:38:59.999962+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.999962+0000","objects_scrubbed":136,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:03:16.690722+0000","scrub_duration":415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":724,"num_write_kb":9846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1363985,"num_omap_keys":2365,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5312","reported_seq":5446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.966466+0000","last_change":"2024-03-08T20:39:01.966614+0000","last_active":"2024-03-08T20:39:01.966466+0000","last_peered":"2024-03-08T20:39:01.966466+0000","last_clean":"2024-03-08T20:39:01.966466+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:39:01.966466+0000","last_undegraded":"2024-03-08T20:39:01.966466+0000","last_fullsized":"2024-03-08T20:39:01.966466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5312","last_scrub_stamp":"2024-03-08T20:39:01.966346+0000","last_deep_scrub":"27'5312","last_deep_scrub_stamp":"2024-03-08T20:39:01.966346+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.966346+0000","objects_scrubbed":2598,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:01:27.714445+0000","scrub_duration":3877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7703,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'2398","reported_seq":2481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:03.666473+0000","last_change":"2024-03-08T20:39:03.666530+0000","last_active":"2024-03-08T20:39:03.666473+0000","last_peered":"2024-03-08T20:39:03.666473+0000","last_clean":"2024-03-08T20:39:03.666473+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:39:03.666473+0000","last_undegraded":"2024-03-08T20:39:03.666473+0000","last_fullsized":"2024-03-08T20:39:03.666473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2398","last_scrub_stamp":"2024-03-08T20:39:03.666385+0000","last_deep_scrub":"27'2398","last_deep_scrub_stamp":"2024-03-08T20:39:03.666385+0000","last_clean_scrub_stamp":"2024-03-08T20:39:03.666385+0000","objects_scrubbed":1157,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:31.949003+0000","scrub_duration":4527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'912","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.661818+0000","last_change":"2024-03-08T20:39:00.661923+0000","last_active":"2024-03-08T20:39:00.661818+0000","last_peered":"2024-03-08T20:39:00.661818+0000","last_clean":"2024-03-08T20:39:00.661818+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:39:00.661818+0000","last_undegraded":"2024-03-08T20:39:00.661818+0000","last_fullsized":"2024-03-08T20:39:00.661818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'912","last_scrub_stamp":"2024-03-08T20:39:00.661727+0000","last_deep_scrub":"27'912","last_deep_scrub_stamp":"2024-03-08T20:39:00.661727+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.661727+0000","objects_scrubbed":145,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:14:13.947259+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1196733,"num_omap_keys":2075,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5233,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.163021+0000","last_change":"2024-03-08T20:39:14.705144+0000","last_active":"2024-03-08T20:39:19.163021+0000","last_peered":"2024-03-08T20:39:19.163021+0000","last_clean":"2024-03-08T20:39:19.163021+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:39:19.163021+0000","last_undegraded":"2024-03-08T20:39:19.163021+0000","last_fullsized":"2024-03-08T20:39:19.163021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":2224,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 4s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2376","reported_seq":2459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:11.755747+0000","last_change":"2024-03-08T20:39:11.755841+0000","last_active":"2024-03-08T20:39:11.755747+0000","last_peered":"2024-03-08T20:39:11.755747+0000","last_clean":"2024-03-08T20:39:11.755747+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:39:11.755747+0000","last_undegraded":"2024-03-08T20:39:11.755747+0000","last_fullsized":"2024-03-08T20:39:11.755747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2376","last_scrub_stamp":"2024-03-08T20:39:11.755656+0000","last_deep_scrub":"27'2376","last_deep_scrub_stamp":"2024-03-08T20:39:11.755656+0000","last_clean_scrub_stamp":"2024-03-08T20:39:11.755656+0000","objects_scrubbed":1139,"log_size":2376,"log_dups_size":0,"ondisk_log_size":2376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:07.890029+0000","scrub_duration":8031,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'668","reported_seq":713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.778958+0000","last_change":"2024-03-08T20:38:55.779011+0000","last_active":"2024-03-08T20:38:55.778958+0000","last_peered":"2024-03-08T20:38:55.778958+0000","last_clean":"2024-03-08T20:38:55.778958+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:55.778958+0000","last_undegraded":"2024-03-08T20:38:55.778958+0000","last_fullsized":"2024-03-08T20:38:55.778958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'668","last_scrub_stamp":"2024-03-08T20:38:55.778852+0000","last_deep_scrub":"27'668","last_deep_scrub_stamp":"2024-03-08T20:38:55.778852+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.778852+0000","objects_scrubbed":153,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:51:24.026071+0000","scrub_duration":144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1288611,"num_omap_keys":2225,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5153,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.220164+0000","last_change":"2024-03-08T20:39:13.498397+0000","last_active":"2024-03-08T20:39:16.220164+0000","last_peered":"2024-03-08T20:39:16.220164+0000","last_clean":"2024-03-08T20:39:16.220164+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:39:16.220164+0000","last_undegraded":"2024-03-08T20:39:16.220164+0000","last_fullsized":"2024-03-08T20:39:16.220164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":399,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'2298","reported_seq":2378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.206005+0000","last_change":"2024-03-08T20:39:13.206097+0000","last_active":"2024-03-08T20:39:13.206005+0000","last_peered":"2024-03-08T20:39:13.206005+0000","last_clean":"2024-03-08T20:39:13.206005+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:39:13.206005+0000","last_undegraded":"2024-03-08T20:39:13.206005+0000","last_fullsized":"2024-03-08T20:39:13.206005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2298","last_scrub_stamp":"2024-03-08T20:39:13.205911+0000","last_deep_scrub":"27'2298","last_deep_scrub_stamp":"2024-03-08T20:39:13.205911+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.205911+0000","objects_scrubbed":1092,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:09.340284+0000","scrub_duration":8931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'780","reported_seq":824,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.992398+0000","last_change":"2024-03-08T20:38:58.992398+0000","last_active":"2024-03-08T20:38:58.992398+0000","last_peered":"2024-03-08T20:38:58.992398+0000","last_clean":"2024-03-08T20:38:58.992398+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:38:58.992398+0000","last_undegraded":"2024-03-08T20:38:58.992398+0000","last_fullsized":"2024-03-08T20:38:58.992398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-03-08T20:38:58.992179+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-03-08T20:38:58.992179+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.992179+0000","objects_scrubbed":140,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:32:19.378066+0000","scrub_duration":424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":923,"num_write_kb":30371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185463,"num_omap_keys":2047,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.766077+0000","last_change":"2024-03-08T20:39:16.766152+0000","last_active":"2024-03-08T20:39:16.766077+0000","last_peered":"2024-03-08T20:39:16.766077+0000","last_clean":"2024-03-08T20:39:16.766077+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:39:16.766077+0000","last_undegraded":"2024-03-08T20:39:16.766077+0000","last_fullsized":"2024-03-08T20:39:16.766077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5177","last_scrub_stamp":"2024-03-08T20:39:16.765961+0000","last_deep_scrub":"27'5177","last_deep_scrub_stamp":"2024-03-08T20:39:16.765961+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.765961+0000","objects_scrubbed":2514,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:49.464651+0000","scrub_duration":7455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'2395","reported_seq":2478,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.416252+0000","last_change":"2024-03-08T20:39:06.416313+0000","last_active":"2024-03-08T20:39:06.416252+0000","last_peered":"2024-03-08T20:39:06.416252+0000","last_clean":"2024-03-08T20:39:06.416252+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:39:06.416252+0000","last_undegraded":"2024-03-08T20:39:06.416252+0000","last_fullsized":"2024-03-08T20:39:06.416252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2395","last_scrub_stamp":"2024-03-08T20:39:06.416152+0000","last_deep_scrub":"27'2395","last_deep_scrub_stamp":"2024-03-08T20:39:06.416152+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.416152+0000","objects_scrubbed":1156,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:03:28.636154+0000","scrub_duration":5159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'755","reported_seq":799,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.252405+0000","last_change":"2024-03-08T20:38:57.252405+0000","last_active":"2024-03-08T20:38:57.252405+0000","last_peered":"2024-03-08T20:38:57.252405+0000","last_clean":"2024-03-08T20:38:57.252405+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:57.252405+0000","last_undegraded":"2024-03-08T20:38:57.252405+0000","last_fullsized":"2024-03-08T20:38:57.252405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'755","last_scrub_stamp":"2024-03-08T20:38:57.252261+0000","last_deep_scrub":"27'755","last_deep_scrub_stamp":"2024-03-08T20:38:57.252261+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.252261+0000","objects_scrubbed":132,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:25.534879+0000","scrub_duration":141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1471544,"num_omap_keys":2538,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5203","reported_seq":5258,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.620732+0000","last_change":"2024-03-08T20:39:11.034737+0000","last_active":"2024-03-08T20:39:14.620732+0000","last_peered":"2024-03-08T20:39:14.620732+0000","last_clean":"2024-03-08T20:39:14.620732+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:39:14.620732+0000","last_undegraded":"2024-03-08T20:39:14.620732+0000","last_fullsized":"2024-03-08T20:39:14.620732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":524,"log_size":5203,"log_dups_size":0,"ondisk_log_size":5203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 3s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7554,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'2341","reported_seq":2422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.305359+0000","last_change":"2024-03-08T20:39:09.305439+0000","last_active":"2024-03-08T20:39:09.305359+0000","last_peered":"2024-03-08T20:39:09.305359+0000","last_clean":"2024-03-08T20:39:09.305359+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:39:09.305359+0000","last_undegraded":"2024-03-08T20:39:09.305359+0000","last_fullsized":"2024-03-08T20:39:09.305359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:09.305271+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:09.305271+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.305271+0000","objects_scrubbed":1114,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:09.349859+0000","scrub_duration":6599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'554","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.421844+0000","last_change":"2024-03-08T20:38:58.421844+0000","last_active":"2024-03-08T20:38:58.421844+0000","last_peered":"2024-03-08T20:38:58.421844+0000","last_clean":"2024-03-08T20:38:58.421844+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:58.421844+0000","last_undegraded":"2024-03-08T20:38:58.421844+0000","last_fullsized":"2024-03-08T20:38:58.421844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'554","last_scrub_stamp":"2024-03-08T20:38:58.421590+0000","last_deep_scrub":"27'554","last_deep_scrub_stamp":"2024-03-08T20:38:58.421590+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.421590+0000","objects_scrubbed":148,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:11.133214+0000","scrub_duration":170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1435363,"num_omap_keys":2487,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5124","reported_seq":5227,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.099965+0000","last_change":"2024-03-08T20:39:12.653773+0000","last_active":"2024-03-08T20:39:19.099965+0000","last_peered":"2024-03-08T20:39:19.099965+0000","last_clean":"2024-03-08T20:39:19.099965+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:39:19.099965+0000","last_undegraded":"2024-03-08T20:39:19.099965+0000","last_fullsized":"2024-03-08T20:39:19.099965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1899,"log_size":5124,"log_dups_size":0,"ondisk_log_size":5124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7434,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'1921","reported_seq":1979,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.711819+0000","last_change":"2024-03-08T20:39:10.966314+0000","last_active":"2024-03-08T20:39:16.711819+0000","last_peered":"2024-03-08T20:39:16.711819+0000","last_clean":"2024-03-08T20:39:16.711819+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:39:16.711819+0000","last_undegraded":"2024-03-08T20:39:16.711819+0000","last_fullsized":"2024-03-08T20:39:16.711819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":649,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1352","reported_seq":1395,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.774540+0000","last_change":"2024-03-08T20:38:57.774540+0000","last_active":"2024-03-08T20:38:57.774540+0000","last_peered":"2024-03-08T20:38:57.774540+0000","last_clean":"2024-03-08T20:38:57.774540+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:57.774540+0000","last_undegraded":"2024-03-08T20:38:57.774540+0000","last_fullsized":"2024-03-08T20:38:57.774540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1352","last_scrub_stamp":"2024-03-08T20:38:57.774390+0000","last_deep_scrub":"27'1352","last_deep_scrub_stamp":"2024-03-08T20:38:57.774390+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.774390+0000","objects_scrubbed":120,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.108781+0000","scrub_duration":191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1467,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":775690,"num_omap_keys":1342,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5434","reported_seq":5571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.037935+0000","last_change":"2024-03-08T20:38:58.037984+0000","last_active":"2024-03-08T20:38:58.037935+0000","last_peered":"2024-03-08T20:38:58.037935+0000","last_clean":"2024-03-08T20:38:58.037935+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:58.037935+0000","last_undegraded":"2024-03-08T20:38:58.037935+0000","last_fullsized":"2024-03-08T20:38:58.037935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5434","last_scrub_stamp":"2024-03-08T20:38:58.037833+0000","last_deep_scrub":"27'5434","last_deep_scrub_stamp":"2024-03-08T20:38:58.037833+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.037833+0000","objects_scrubbed":2652,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:58:45.132851+0000","scrub_duration":2010,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7911,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5221,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.234658+0000","last_change":"2024-03-08T20:38:55.234696+0000","last_active":"2024-03-08T20:38:55.234658+0000","last_peered":"2024-03-08T20:38:55.234658+0000","last_clean":"2024-03-08T20:38:55.234658+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:55.234658+0000","last_undegraded":"2024-03-08T20:38:55.234658+0000","last_fullsized":"2024-03-08T20:38:55.234658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5083","last_scrub_stamp":"2024-03-08T20:38:55.234573+0000","last_deep_scrub":"27'5083","last_deep_scrub_stamp":"2024-03-08T20:38:55.234573+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.234573+0000","objects_scrubbed":2481,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:38:07.362857+0000","scrub_duration":1597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2384","reported_seq":2466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.674541+0000","last_change":"2024-03-08T20:38:54.674541+0000","last_active":"2024-03-08T20:38:54.674541+0000","last_peered":"2024-03-08T20:38:54.674541+0000","last_clean":"2024-03-08T20:38:54.674541+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:54.674541+0000","last_undegraded":"2024-03-08T20:38:54.674541+0000","last_fullsized":"2024-03-08T20:38:54.674541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2384","last_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_deep_scrub":"27'2384","last_deep_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.674332+0000","objects_scrubbed":1145,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.764117+0000","scrub_duration":1469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'649","reported_seq":694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.761369+0000","last_change":"2024-03-08T20:39:01.761369+0000","last_active":"2024-03-08T20:39:01.761369+0000","last_peered":"2024-03-08T20:39:01.761369+0000","last_clean":"2024-03-08T20:39:01.761369+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:39:01.761369+0000","last_undegraded":"2024-03-08T20:39:01.761369+0000","last_fullsized":"2024-03-08T20:39:01.761369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'649","last_scrub_stamp":"2024-03-08T20:39:01.761201+0000","last_deep_scrub":"27'649","last_deep_scrub_stamp":"2024-03-08T20:39:01.761201+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.761201+0000","objects_scrubbed":153,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:17.831692+0000","scrub_duration":458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2269944,"num_omap_keys":3912,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5136,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.675586+0000","last_change":"2024-03-08T20:39:09.736758+0000","last_active":"2024-03-08T20:39:14.675586+0000","last_peered":"2024-03-08T20:39:14.675586+0000","last_clean":"2024-03-08T20:39:14.675586+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:39:14.675586+0000","last_undegraded":"2024-03-08T20:39:14.675586+0000","last_fullsized":"2024-03-08T20:39:14.675586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1199,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'2441","reported_seq":2524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.633851+0000","last_change":"2024-03-08T20:39:13.633937+0000","last_active":"2024-03-08T20:39:13.633851+0000","last_peered":"2024-03-08T20:39:13.633851+0000","last_clean":"2024-03-08T20:39:13.633851+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:39:13.633851+0000","last_undegraded":"2024-03-08T20:39:13.633851+0000","last_fullsized":"2024-03-08T20:39:13.633851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2441","last_scrub_stamp":"2024-03-08T20:39:13.633745+0000","last_deep_scrub":"27'2441","last_deep_scrub_stamp":"2024-03-08T20:39:13.633745+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.633745+0000","objects_scrubbed":1166,"log_size":2441,"log_dups_size":0,"ondisk_log_size":2441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:40.689507+0000","scrub_duration":6270,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1166,"num_object_clones":0,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'794","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.850350+0000","last_change":"2024-03-08T20:39:03.616732+0000","last_active":"2024-03-08T20:39:16.850350+0000","last_peered":"2024-03-08T20:39:16.850350+0000","last_clean":"2024-03-08T20:39:16.850350+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:39:16.850350+0000","last_undegraded":"2024-03-08T20:39:16.850350+0000","last_fullsized":"2024-03-08T20:39:16.850350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'771","last_scrub_stamp":"2024-03-08T20:39:03.616527+0000","last_deep_scrub":"27'771","last_deep_scrub_stamp":"2024-03-08T20:39:03.616527+0000","last_clean_scrub_stamp":"2024-03-08T20:39:03.616527+0000","objects_scrubbed":136,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:23:46.970355+0000","scrub_duration":452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5421188,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":931,"num_write_kb":15153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1345872,"num_omap_keys":2324,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'676","reported_seq":719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.026404+0000","last_change":"2024-03-08T20:39:01.026490+0000","last_active":"2024-03-08T20:39:01.026404+0000","last_peered":"2024-03-08T20:39:01.026404+0000","last_clean":"2024-03-08T20:39:01.026404+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:39:01.026404+0000","last_undegraded":"2024-03-08T20:39:01.026404+0000","last_fullsized":"2024-03-08T20:39:01.026404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'676","last_scrub_stamp":"2024-03-08T20:39:01.024707+0000","last_deep_scrub":"27'676","last_deep_scrub_stamp":"2024-03-08T20:39:01.024707+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.024707+0000","objects_scrubbed":138,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:12.452565+0000","scrub_duration":487,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":816,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1479493,"num_omap_keys":2563,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2322","reported_seq":2403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.632207+0000","last_change":"2024-03-08T20:39:02.632282+0000","last_active":"2024-03-08T20:39:02.632207+0000","last_peered":"2024-03-08T20:39:02.632207+0000","last_clean":"2024-03-08T20:39:02.632207+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:39:02.632207+0000","last_undegraded":"2024-03-08T20:39:02.632207+0000","last_fullsized":"2024-03-08T20:39:02.632207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2322","last_scrub_stamp":"2024-03-08T20:39:02.632113+0000","last_deep_scrub":"27'2322","last_deep_scrub_stamp":"2024-03-08T20:39:02.632113+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.632113+0000","objects_scrubbed":1112,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:51.800453+0000","scrub_duration":3981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5259","reported_seq":5393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.363458+0000","last_change":"2024-03-08T20:39:06.363568+0000","last_active":"2024-03-08T20:39:06.363458+0000","last_peered":"2024-03-08T20:39:06.363458+0000","last_clean":"2024-03-08T20:39:06.363458+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:39:06.363458+0000","last_undegraded":"2024-03-08T20:39:06.363458+0000","last_fullsized":"2024-03-08T20:39:06.363458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5259","last_scrub_stamp":"2024-03-08T20:39:06.363366+0000","last_deep_scrub":"27'5259","last_deep_scrub_stamp":"2024-03-08T20:39:06.363366+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.363366+0000","objects_scrubbed":2588,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:03:23.054126+0000","scrub_duration":6021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'529","reported_seq":572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:04.836485+0000","last_change":"2024-03-08T20:39:04.836550+0000","last_active":"2024-03-08T20:39:04.836485+0000","last_peered":"2024-03-08T20:39:04.836485+0000","last_clean":"2024-03-08T20:39:04.836485+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:39:04.836485+0000","last_undegraded":"2024-03-08T20:39:04.836485+0000","last_fullsized":"2024-03-08T20:39:04.836485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'529","last_scrub_stamp":"2024-03-08T20:39:04.832928+0000","last_deep_scrub":"27'529","last_deep_scrub_stamp":"2024-03-08T20:39:04.832928+0000","last_clean_scrub_stamp":"2024-03-08T20:39:04.832928+0000","objects_scrubbed":128,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:04.877516+0000","scrub_duration":630,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1453373,"num_omap_keys":2511,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2406","reported_seq":2489,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.228406+0000","last_change":"2024-03-08T20:39:01.228519+0000","last_active":"2024-03-08T20:39:01.228406+0000","last_peered":"2024-03-08T20:39:01.228406+0000","last_clean":"2024-03-08T20:39:01.228406+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:39:01.228406+0000","last_undegraded":"2024-03-08T20:39:01.228406+0000","last_fullsized":"2024-03-08T20:39:01.228406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2406","last_scrub_stamp":"2024-03-08T20:39:01.228306+0000","last_deep_scrub":"27'2406","last_deep_scrub_stamp":"2024-03-08T20:39:01.228306+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.228306+0000","objects_scrubbed":1170,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:47:03.529251+0000","scrub_duration":3115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5236","reported_seq":5332,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:19.090222+0000","last_change":"2024-03-08T20:39:13.657300+0000","last_active":"2024-03-08T20:39:19.090222+0000","last_peered":"2024-03-08T20:39:19.090222+0000","last_clean":"2024-03-08T20:39:19.090222+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:39:19.090222+0000","last_undegraded":"2024-03-08T20:39:19.090222+0000","last_fullsized":"2024-03-08T20:39:19.090222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:27.239701+0000","last_clean_scrub_stamp":"2024-03-08T20:29:27.239701+0000","objects_scrubbed":1749,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'2377","reported_seq":2460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.130179+0000","last_change":"2024-03-08T20:39:13.130260+0000","last_active":"2024-03-08T20:39:13.130179+0000","last_peered":"2024-03-08T20:39:13.130179+0000","last_clean":"2024-03-08T20:39:13.130179+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:39:13.130179+0000","last_undegraded":"2024-03-08T20:39:13.130179+0000","last_fullsized":"2024-03-08T20:39:13.130179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2377","last_scrub_stamp":"2024-03-08T20:39:13.130083+0000","last_deep_scrub":"27'2377","last_deep_scrub_stamp":"2024-03-08T20:39:13.130083+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.130083+0000","objects_scrubbed":1141,"log_size":2377,"log_dups_size":0,"ondisk_log_size":2377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:01:38.878182+0000","scrub_duration":8592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1141,"num_object_clones":0,"num_object_copies":2282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'2484","reported_seq":2568,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.142085+0000","last_change":"2024-03-08T20:39:01.142181+0000","last_active":"2024-03-08T20:39:01.142085+0000","last_peered":"2024-03-08T20:39:01.142085+0000","last_clean":"2024-03-08T20:39:01.142085+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:39:01.142085+0000","last_undegraded":"2024-03-08T20:39:01.142085+0000","last_fullsized":"2024-03-08T20:39:01.142085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2484","last_scrub_stamp":"2024-03-08T20:39:01.141975+0000","last_deep_scrub":"27'2484","last_deep_scrub_stamp":"2024-03-08T20:39:01.141975+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.141975+0000","objects_scrubbed":1195,"log_size":2484,"log_dups_size":0,"ondisk_log_size":2484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:59:10.039200+0000","scrub_duration":2861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'2339","reported_seq":2421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.485292+0000","last_change":"2024-03-08T20:39:16.485394+0000","last_active":"2024-03-08T20:39:16.485292+0000","last_peered":"2024-03-08T20:39:16.485292+0000","last_clean":"2024-03-08T20:39:16.485292+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:39:16.485292+0000","last_undegraded":"2024-03-08T20:39:16.485292+0000","last_fullsized":"2024-03-08T20:39:16.485292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2339","last_scrub_stamp":"2024-03-08T20:39:16.482809+0000","last_deep_scrub":"27'2339","last_deep_scrub_stamp":"2024-03-08T20:39:16.482809+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.482809+0000","objects_scrubbed":1119,"log_size":2339,"log_dups_size":0,"ondisk_log_size":2339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:20.934279+0000","scrub_duration":11193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2464","reported_seq":2548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.872931+0000","last_change":"2024-03-08T20:39:08.873024+0000","last_active":"2024-03-08T20:39:08.872931+0000","last_peered":"2024-03-08T20:39:08.872931+0000","last_clean":"2024-03-08T20:39:08.872931+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:39:08.872931+0000","last_undegraded":"2024-03-08T20:39:08.872931+0000","last_fullsized":"2024-03-08T20:39:08.872931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2464","last_scrub_stamp":"2024-03-08T20:39:08.872843+0000","last_deep_scrub":"27'2464","last_deep_scrub_stamp":"2024-03-08T20:39:08.872843+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.872843+0000","objects_scrubbed":1172,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:52.475196+0000","scrub_duration":7126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2369","reported_seq":2452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.993697+0000","last_change":"2024-03-08T20:38:58.993783+0000","last_active":"2024-03-08T20:38:58.993697+0000","last_peered":"2024-03-08T20:38:58.993697+0000","last_clean":"2024-03-08T20:38:58.993697+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:58.993697+0000","last_undegraded":"2024-03-08T20:38:58.993697+0000","last_fullsized":"2024-03-08T20:38:58.993697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2369","last_scrub_stamp":"2024-03-08T20:38:58.993603+0000","last_deep_scrub":"27'2369","last_deep_scrub_stamp":"2024-03-08T20:38:58.993603+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.993603+0000","objects_scrubbed":1139,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:14:22.406493+0000","scrub_duration":1940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'2341","reported_seq":2424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.827207+0000","last_change":"2024-03-08T20:39:10.827280+0000","last_active":"2024-03-08T20:39:10.827207+0000","last_peered":"2024-03-08T20:39:10.827207+0000","last_clean":"2024-03-08T20:39:10.827207+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:39:10.827207+0000","last_undegraded":"2024-03-08T20:39:10.827207+0000","last_fullsized":"2024-03-08T20:39:10.827207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:10.827096+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:10.827096+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.827096+0000","objects_scrubbed":1137,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:47.587369+0000","scrub_duration":6723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'2194","reported_seq":2263,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.630026+0000","last_change":"2024-03-08T20:39:07.684244+0000","last_active":"2024-03-08T20:39:14.630026+0000","last_peered":"2024-03-08T20:39:14.630026+0000","last_clean":"2024-03-08T20:39:14.630026+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:39:14.630026+0000","last_undegraded":"2024-03-08T20:39:14.630026+0000","last_fullsized":"2024-03-08T20:39:14.630026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":899,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 6s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'2430","reported_seq":2514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.511249+0000","last_change":"2024-03-08T20:39:16.511292+0000","last_active":"2024-03-08T20:39:16.511249+0000","last_peered":"2024-03-08T20:39:16.511249+0000","last_clean":"2024-03-08T20:39:16.511249+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:39:16.511249+0000","last_undegraded":"2024-03-08T20:39:16.511249+0000","last_fullsized":"2024-03-08T20:39:16.511249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2430","last_scrub_stamp":"2024-03-08T20:39:16.511148+0000","last_deep_scrub":"27'2430","last_deep_scrub_stamp":"2024-03-08T20:39:16.511148+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.511148+0000","objects_scrubbed":1150,"log_size":2430,"log_dups_size":0,"ondisk_log_size":2430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:47:43.506755+0000","scrub_duration":6908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1150,"num_object_clones":0,"num_object_copies":2300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'2322","reported_seq":2399,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.429835+0000","last_change":"2024-03-08T20:39:06.402251+0000","last_active":"2024-03-08T20:39:16.429835+0000","last_peered":"2024-03-08T20:39:16.429835+0000","last_clean":"2024-03-08T20:39:16.429835+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:39:16.429835+0000","last_undegraded":"2024-03-08T20:39:16.429835+0000","last_fullsized":"2024-03-08T20:39:16.429835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":1099,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 10s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'2392","reported_seq":2475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.699530+0000","last_change":"2024-03-08T20:39:17.699605+0000","last_active":"2024-03-08T20:39:17.699530+0000","last_peered":"2024-03-08T20:39:17.699530+0000","last_clean":"2024-03-08T20:39:17.699530+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:39:17.699530+0000","last_undegraded":"2024-03-08T20:39:17.699530+0000","last_fullsized":"2024-03-08T20:39:17.699530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2392","last_scrub_stamp":"2024-03-08T20:39:17.699427+0000","last_deep_scrub":"27'2392","last_deep_scrub_stamp":"2024-03-08T20:39:17.699427+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.699427+0000","objects_scrubbed":1137,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:58.184224+0000","scrub_duration":9244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'2419","reported_seq":2503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.873997+0000","last_change":"2024-03-08T20:39:13.874102+0000","last_active":"2024-03-08T20:39:13.873997+0000","last_peered":"2024-03-08T20:39:13.873997+0000","last_clean":"2024-03-08T20:39:13.873997+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:39:13.873997+0000","last_undegraded":"2024-03-08T20:39:13.873997+0000","last_fullsized":"2024-03-08T20:39:13.873997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2419","last_scrub_stamp":"2024-03-08T20:39:13.873127+0000","last_deep_scrub":"27'2419","last_deep_scrub_stamp":"2024-03-08T20:39:13.873127+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.873127+0000","objects_scrubbed":1171,"log_size":2419,"log_dups_size":0,"ondisk_log_size":2419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:10.007500+0000","scrub_duration":10591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2433","reported_seq":2516,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.850340+0000","last_change":"2024-03-08T20:39:13.850439+0000","last_active":"2024-03-08T20:39:13.850340+0000","last_peered":"2024-03-08T20:39:13.850340+0000","last_clean":"2024-03-08T20:39:13.850340+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:39:13.850340+0000","last_undegraded":"2024-03-08T20:39:13.850340+0000","last_fullsized":"2024-03-08T20:39:13.850340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2433","last_scrub_stamp":"2024-03-08T20:39:13.850223+0000","last_deep_scrub":"27'2433","last_deep_scrub_stamp":"2024-03-08T20:39:13.850223+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.850223+0000","objects_scrubbed":1146,"log_size":2433,"log_dups_size":0,"ondisk_log_size":2433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:50.610497+0000","scrub_duration":8992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2415","reported_seq":2499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:14.164723+0000","last_change":"2024-03-08T20:39:14.164777+0000","last_active":"2024-03-08T20:39:14.164723+0000","last_peered":"2024-03-08T20:39:14.164723+0000","last_clean":"2024-03-08T20:39:14.164723+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:39:14.164723+0000","last_undegraded":"2024-03-08T20:39:14.164723+0000","last_fullsized":"2024-03-08T20:39:14.164723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2415","last_scrub_stamp":"2024-03-08T20:39:14.164624+0000","last_deep_scrub":"27'2415","last_deep_scrub_stamp":"2024-03-08T20:39:14.164624+0000","last_clean_scrub_stamp":"2024-03-08T20:39:14.164624+0000","objects_scrubbed":1154,"log_size":2415,"log_dups_size":0,"ondisk_log_size":2415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:12.230189+0000","scrub_duration":8616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2437","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.698813+0000","last_change":"2024-03-08T20:39:10.698988+0000","last_active":"2024-03-08T20:39:10.698813+0000","last_peered":"2024-03-08T20:39:10.698813+0000","last_clean":"2024-03-08T20:39:10.698813+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:39:10.698813+0000","last_undegraded":"2024-03-08T20:39:10.698813+0000","last_fullsized":"2024-03-08T20:39:10.698813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2437","last_scrub_stamp":"2024-03-08T20:39:10.698719+0000","last_deep_scrub":"27'2437","last_deep_scrub_stamp":"2024-03-08T20:39:10.698719+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.698719+0000","objects_scrubbed":1170,"log_size":2437,"log_dups_size":0,"ondisk_log_size":2437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:36:44.098676+0000","scrub_duration":7472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2341","reported_seq":2422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.727996+0000","last_change":"2024-03-08T20:39:02.728061+0000","last_active":"2024-03-08T20:39:02.727996+0000","last_peered":"2024-03-08T20:39:02.727996+0000","last_clean":"2024-03-08T20:39:02.727996+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:39:02.727996+0000","last_undegraded":"2024-03-08T20:39:02.727996+0000","last_fullsized":"2024-03-08T20:39:02.727996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:02.727924+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:02.727924+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.727924+0000","objects_scrubbed":1122,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:38.062315+0000","scrub_duration":3420,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2462","reported_seq":2532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.537539+0000","last_change":"2024-03-08T20:39:09.537632+0000","last_active":"2024-03-08T20:39:09.537539+0000","last_peered":"2024-03-08T20:39:09.537539+0000","last_clean":"2024-03-08T20:39:09.537539+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:39:09.537539+0000","last_undegraded":"2024-03-08T20:39:09.537539+0000","last_fullsized":"2024-03-08T20:39:09.537539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2462","last_scrub_stamp":"2024-03-08T20:39:09.537452+0000","last_deep_scrub":"27'2462","last_deep_scrub_stamp":"2024-03-08T20:39:09.537452+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.537452+0000","objects_scrubbed":1194,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:54:16.287873+0000","scrub_duration":7186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'2335","reported_seq":2402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.972763+0000","last_change":"2024-03-08T20:39:05.972854+0000","last_active":"2024-03-08T20:39:05.972763+0000","last_peered":"2024-03-08T20:39:05.972763+0000","last_clean":"2024-03-08T20:39:05.972763+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:39:05.972763+0000","last_undegraded":"2024-03-08T20:39:05.972763+0000","last_fullsized":"2024-03-08T20:39:05.972763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2335","last_scrub_stamp":"2024-03-08T20:39:05.972675+0000","last_deep_scrub":"27'2335","last_deep_scrub_stamp":"2024-03-08T20:39:05.972675+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.972675+0000","objects_scrubbed":1117,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:08:16.175071+0000","scrub_duration":4633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'2464","reported_seq":2549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.611195+0000","last_change":"2024-03-08T20:39:12.611272+0000","last_active":"2024-03-08T20:39:12.611195+0000","last_peered":"2024-03-08T20:39:12.611195+0000","last_clean":"2024-03-08T20:39:12.611195+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:39:12.611195+0000","last_undegraded":"2024-03-08T20:39:12.611195+0000","last_fullsized":"2024-03-08T20:39:12.611195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2464","last_scrub_stamp":"2024-03-08T20:39:12.611095+0000","last_deep_scrub":"27'2464","last_deep_scrub_stamp":"2024-03-08T20:39:12.611095+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.611095+0000","objects_scrubbed":1186,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:44:09.942230+0000","scrub_duration":7417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2318","reported_seq":2399,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.246652+0000","last_change":"2024-03-08T20:39:00.246742+0000","last_active":"2024-03-08T20:39:00.246652+0000","last_peered":"2024-03-08T20:39:00.246652+0000","last_clean":"2024-03-08T20:39:00.246652+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:39:00.246652+0000","last_undegraded":"2024-03-08T20:39:00.246652+0000","last_fullsized":"2024-03-08T20:39:00.246652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2318","last_scrub_stamp":"2024-03-08T20:39:00.246558+0000","last_deep_scrub":"27'2318","last_deep_scrub_stamp":"2024-03-08T20:39:00.246558+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.246558+0000","objects_scrubbed":1121,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:58:47.341576+0000","scrub_duration":2641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'2348","reported_seq":2430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.470330+0000","last_change":"2024-03-08T20:38:56.470330+0000","last_active":"2024-03-08T20:38:56.470330+0000","last_peered":"2024-03-08T20:38:56.470330+0000","last_clean":"2024-03-08T20:38:56.470330+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:56.470330+0000","last_undegraded":"2024-03-08T20:38:56.470330+0000","last_fullsized":"2024-03-08T20:38:56.470330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2348","last_scrub_stamp":"2024-03-08T20:38:56.470121+0000","last_deep_scrub":"27'2348","last_deep_scrub_stamp":"2024-03-08T20:38:56.470121+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.470121+0000","objects_scrubbed":1138,"log_size":2348,"log_dups_size":0,"ondisk_log_size":2348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:03:18.690122+0000","scrub_duration":1493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2269","reported_seq":2350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.156009+0000","last_change":"2024-03-08T20:39:02.156056+0000","last_active":"2024-03-08T20:39:02.156009+0000","last_peered":"2024-03-08T20:39:02.156009+0000","last_clean":"2024-03-08T20:39:02.156009+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:39:02.156009+0000","last_undegraded":"2024-03-08T20:39:02.156009+0000","last_fullsized":"2024-03-08T20:39:02.156009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2269","last_scrub_stamp":"2024-03-08T20:39:02.155906+0000","last_deep_scrub":"27'2269","last_deep_scrub_stamp":"2024-03-08T20:39:02.155906+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.155906+0000","objects_scrubbed":1102,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:14.867530+0000","scrub_duration":3018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1102,"num_object_clones":0,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'1860","reported_seq":1916,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:14.493171+0000","last_change":"2024-03-08T20:39:08.661931+0000","last_active":"2024-03-08T20:39:14.493171+0000","last_peered":"2024-03-08T20:39:14.493171+0000","last_clean":"2024-03-08T20:39:14.493171+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:39:14.493171+0000","last_undegraded":"2024-03-08T20:39:14.493171+0000","last_fullsized":"2024-03-08T20:39:14.493171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":599,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'2384","reported_seq":2466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.762093+0000","last_change":"2024-03-08T20:39:06.762177+0000","last_active":"2024-03-08T20:39:06.762093+0000","last_peered":"2024-03-08T20:39:06.762093+0000","last_clean":"2024-03-08T20:39:06.762093+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:39:06.762093+0000","last_undegraded":"2024-03-08T20:39:06.762093+0000","last_fullsized":"2024-03-08T20:39:06.762093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2384","last_scrub_stamp":"2024-03-08T20:39:06.761989+0000","last_deep_scrub":"27'2384","last_deep_scrub_stamp":"2024-03-08T20:39:06.761989+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.761989+0000","objects_scrubbed":1139,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:17:44.467334+0000","scrub_duration":4226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'2479","reported_seq":2563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.724335+0000","last_change":"2024-03-08T20:39:10.724443+0000","last_active":"2024-03-08T20:39:10.724335+0000","last_peered":"2024-03-08T20:39:10.724335+0000","last_clean":"2024-03-08T20:39:10.724335+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:39:10.724335+0000","last_undegraded":"2024-03-08T20:39:10.724335+0000","last_fullsized":"2024-03-08T20:39:10.724335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2479","last_scrub_stamp":"2024-03-08T20:39:10.724241+0000","last_deep_scrub":"27'2479","last_deep_scrub_stamp":"2024-03-08T20:39:10.724241+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.724241+0000","objects_scrubbed":1199,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:23:54.078069+0000","scrub_duration":8534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1199,"num_object_clones":0,"num_object_copies":2398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'2387","reported_seq":2469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.817067+0000","last_change":"2024-03-08T20:39:18.817131+0000","last_active":"2024-03-08T20:39:18.817067+0000","last_peered":"2024-03-08T20:39:18.817067+0000","last_clean":"2024-03-08T20:39:18.817067+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:39:18.817067+0000","last_undegraded":"2024-03-08T20:39:18.817067+0000","last_fullsized":"2024-03-08T20:39:18.817067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2387","last_scrub_stamp":"2024-03-08T20:39:18.816963+0000","last_deep_scrub":"27'2387","last_deep_scrub_stamp":"2024-03-08T20:39:18.816963+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.816963+0000","objects_scrubbed":1133,"log_size":2387,"log_dups_size":0,"ondisk_log_size":2387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:10:11.560670+0000","scrub_duration":8177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1133,"num_object_clones":0,"num_object_copies":2266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2308","reported_seq":2389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.526265+0000","last_change":"2024-03-08T20:39:05.533492+0000","last_active":"2024-03-08T20:39:05.526265+0000","last_peered":"2024-03-08T20:39:05.526265+0000","last_clean":"2024-03-08T20:39:05.526265+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:39:05.526265+0000","last_undegraded":"2024-03-08T20:39:05.526265+0000","last_fullsized":"2024-03-08T20:39:05.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2308","last_scrub_stamp":"2024-03-08T20:39:05.522116+0000","last_deep_scrub":"27'2308","last_deep_scrub_stamp":"2024-03-08T20:39:05.522116+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.522116+0000","objects_scrubbed":1112,"log_size":2308,"log_dups_size":0,"ondisk_log_size":2308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:14:09.966547+0000","scrub_duration":5348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2317","reported_seq":2399,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.859596+0000","last_change":"2024-03-08T20:39:15.859645+0000","last_active":"2024-03-08T20:39:15.859596+0000","last_peered":"2024-03-08T20:39:15.859596+0000","last_clean":"2024-03-08T20:39:15.859596+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:39:15.859596+0000","last_undegraded":"2024-03-08T20:39:15.859596+0000","last_fullsized":"2024-03-08T20:39:15.859596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-03-08T20:39:15.859507+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-03-08T20:39:15.859507+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.859507+0000","objects_scrubbed":1129,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:44:13.190643+0000","scrub_duration":11597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'2496","reported_seq":2579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.872659+0000","last_change":"2024-03-08T20:39:18.872761+0000","last_active":"2024-03-08T20:39:18.872659+0000","last_peered":"2024-03-08T20:39:18.872659+0000","last_clean":"2024-03-08T20:39:18.872659+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:39:18.872659+0000","last_undegraded":"2024-03-08T20:39:18.872659+0000","last_fullsized":"2024-03-08T20:39:18.872659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2496","last_scrub_stamp":"2024-03-08T20:39:18.872545+0000","last_deep_scrub":"27'2496","last_deep_scrub_stamp":"2024-03-08T20:39:18.872545+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.872545+0000","objects_scrubbed":1173,"log_size":2496,"log_dups_size":0,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:29.857816+0000","scrub_duration":5355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2378","reported_seq":2451,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-08T20:39:16.630166+0000","last_change":"2024-03-08T20:39:08.661661+0000","last_active":"2024-03-08T20:39:16.630166+0000","last_peered":"2024-03-08T20:39:16.630166+0000","last_clean":"2024-03-08T20:39:16.630166+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:39:16.630166+0000","last_undegraded":"2024-03-08T20:39:16.630166+0000","last_fullsized":"2024-03-08T20:39:16.630166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T20:29:23.193767+0000","last_clean_scrub_stamp":"2024-03-08T20:29:23.193767+0000","objects_scrubbed":1124,"log_size":2378,"log_dups_size":0,"ondisk_log_size":2378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 7s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2431","reported_seq":2515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.390690+0000","last_change":"2024-03-08T20:38:58.390763+0000","last_active":"2024-03-08T20:38:58.390690+0000","last_peered":"2024-03-08T20:38:58.390690+0000","last_clean":"2024-03-08T20:38:58.390690+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:58.390690+0000","last_undegraded":"2024-03-08T20:38:58.390690+0000","last_fullsized":"2024-03-08T20:38:58.390690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2431","last_scrub_stamp":"2024-03-08T20:38:58.390583+0000","last_deep_scrub":"27'2431","last_deep_scrub_stamp":"2024-03-08T20:38:58.390583+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.390583+0000","objects_scrubbed":1184,"log_size":2431,"log_dups_size":0,"ondisk_log_size":2431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:17:36.095928+0000","scrub_duration":1742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2261","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.636981+0000","last_change":"2024-03-08T20:38:56.637013+0000","last_active":"2024-03-08T20:38:56.636981+0000","last_peered":"2024-03-08T20:38:56.636981+0000","last_clean":"2024-03-08T20:38:56.636981+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:56.636981+0000","last_undegraded":"2024-03-08T20:38:56.636981+0000","last_fullsized":"2024-03-08T20:38:56.636981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2261","last_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_deep_scrub":"27'2261","last_deep_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.636912+0000","objects_scrubbed":1103,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:09.348536+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2262","reported_seq":2343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.389063+0000","last_change":"2024-03-08T20:39:06.389138+0000","last_active":"2024-03-08T20:39:06.389063+0000","last_peered":"2024-03-08T20:39:06.389063+0000","last_clean":"2024-03-08T20:39:06.389063+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:39:06.389063+0000","last_undegraded":"2024-03-08T20:39:06.389063+0000","last_fullsized":"2024-03-08T20:39:06.389063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2262","last_scrub_stamp":"2024-03-08T20:39:06.388989+0000","last_deep_scrub":"27'2262","last_deep_scrub_stamp":"2024-03-08T20:39:06.388989+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.388989+0000","objects_scrubbed":1095,"log_size":2262,"log_dups_size":0,"ondisk_log_size":2262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:22.459480+0000","scrub_duration":5232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1095,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":243462,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167509,"ondisk_log_size":167509,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73410,"num_object_clones":0,"num_object_copies":146820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148806,"ondisk_log_size":148806,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":177976374,"num_objects":4507,"num_object_clones":0,"num_object_copies":9014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4507,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33359,"num_write_kb":743279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":45098891,"num_omap_keys":77979,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127528960,"data_stored":355933735,"data_compressed":48877398,"data_compressed_allocated":60243968,"data_compressed_original":288710656,"omap_allocated":0,"internal_metadata":0},"log_size":28121,"ondisk_log_size":28121,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600356,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93771484,"statfs":{"total":96636764160,"available":96021999616,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,9,12,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742616,"kb_used_data":400592,"kb_used_omap":1,"kb_used_meta":342014,"kb_avail":93629224,"statfs":{"total":96636764160,"available":95876325376,"internally_reserved":0,"allocated":410206208,"data_stored":556728791,"data_compressed":74692817,"data_compressed_allocated":87916544,"data_compressed_original":234618880,"omap_allocated":1594,"internal_metadata":350222790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,6,15,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549692,"kb_used_data":251956,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":93822148,"statfs":{"total":96636764160,"available":96073879552,"internally_reserved":0,"allocated":258002944,"data_stored":424137042,"data_compressed":66768074,"data_compressed_allocated":84230144,"data_compressed_original":250540032,"omap_allocated":1595,"internal_metadata":304871877},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2,2,17,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659932,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":93711908,"statfs":{"total":96636764160,"available":95960993792,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864316,"kb_used_data":422260,"kb_used_omap":1,"kb_used_meta":442046,"kb_avail":93507524,"statfs":{"total":96636764160,"available":95751704576,"internally_reserved":0,"allocated":432394240,"data_stored":663171600,"data_compressed":104468897,"data_compressed_allocated":131923968,"data_compressed_original":362885120,"omap_allocated":1593,"internal_metadata":452655559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":595788,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93776052,"statfs":{"total":96636764160,"available":96026677248,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":897796,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":446206,"kb_avail":93474044,"statfs":{"total":96636764160,"available":95717421056,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":456915397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":635440,"kb_used_data":307240,"kb_used_omap":1,"kb_used_meta":328190,"kb_avail":93736400,"statfs":{"total":96636764160,"available":95986073600,"internally_reserved":0,"allocated":314613760,"data_stored":431273366,"data_compressed":63573338,"data_compressed_allocated":76365824,"data_compressed_original":193212416,"omap_allocated":1594,"internal_metadata":336067014},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11288576,"data_stored":20972158,"data_compressed":2184983,"data_compressed_allocated":2924544,"data_compressed_original":12619776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":43757848,"data_compressed":5410896,"data_compressed_allocated":6983680,"data_compressed_original":31522816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12554240,"data_stored":43151583,"data_compressed":6305634,"data_compressed_allocated":7553024,"data_compressed_original":38158336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:39:19.958 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.958 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.959 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.959 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.959 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.960 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.960 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.961 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.961 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.961 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.962 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.962 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.963 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.963 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.964 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.964 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.964 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.965 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.965 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.965 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.966 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.966 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.967 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.967 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.967 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.968 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.968 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.969 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.969 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-08T20:29:27.239701+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=27, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.970 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.970 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.971 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.972 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-08T20:29:23.193767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=29, tm_sec=23, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=20, tm_min=38, tm_sec=50, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T20:39:19.972 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-08T20:39:39.973 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T20:39:40.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.191+0000 7efbfda00640 1 Processor -- start 2024-03-08T20:39:40.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.192+0000 7efbfda00640 1 -- start start 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.193+0000 7efbfda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efbf806af80 0x7efbf806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.193+0000 7efbfda00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80aa980 con 0x7efbf81505e0 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.193+0000 7efbfda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80aac60 con 0x7efbf806ebd0 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.193+0000 7efbfda00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80aaf40 con 0x7efbf806af80 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf7400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efbf81505e0 0x7efbf8152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33674/0 (socket says 172.21.15.118:33674) 2024-03-08T20:39:40.193 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf7400640 1 -- 172.21.15.118:0/3583171429 learned_addr learned my addr 172.21.15.118:0/3583171429 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:39:40.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf6a00640 1 --2- 172.21.15.118:0/3583171429 >> v2:172.21.15.144:3300/0 conn(0x7efbf806af80 0x7efbf806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543567481 0 0) 0x7efbf80aa980 con 0x7efbf81505e0 2024-03-08T20:39:40.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbdc003520 con 0x7efbf81505e0 2024-03-08T20:39:40.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476215331 0 0) 0x7efbdc003520 con 0x7efbf81505e0 2024-03-08T20:39:40.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 >> v2:172.21.15.144:3300/0 conn(0x7efbf806af80 msgr2=0x7efbf806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 --2- 172.21.15.118:0/3583171429 >> v2:172.21.15.144:3300/0 conn(0x7efbf806af80 0x7efbf806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 >> v1:172.21.15.144:6789/0 conn(0x7efbf806ebd0 legacy=0x7efbf814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80ab220 con 0x7efbf81505e0 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7efbf00019f0 con 0x7efbf81505e0 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 >> v1:172.21.15.118:6789/0 conn(0x7efbf81505e0 legacy=0x7efbf8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.194+0000 7efbf5600640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbdc003a00 0x7efbdc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf5600640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbdc004800 0x7efbdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.198 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf5600640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80aaf40 con 0x7efbdc005210 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc00c160 con 0x7efbdc004800 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbdc00c360 con 0x7efbdc003a00 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf6a00640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbdc003a00 0x7efbdc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 -- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbdc003a00 msgr2=0x7efbdc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbdc003a00 0x7efbdc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 -- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbdc004800 msgr2=0x7efbdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbdc004800 0x7efbdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.195+0000 7efbf7400640 1 -- 172.21.15.118:0/3583171429 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc003520 con 0x7efbdc005210 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.196+0000 7efbf7400640 1 -- 172.21.15.118:0/3583171429 reap_dead start 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.196+0000 7efbf7400640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbdc00b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efbf000a740 tx=0x7efbdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999b6e23704c69de server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000a390 con 0x7efbdc005210 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0034650 con 0x7efbdc005210 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbf5600640 1 -- 172.21.15.118:0/3583171429 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0034a40 con 0x7efbdc005210 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 -- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 msgr2=0x7efbdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.200 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbdc00b9c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efbf000a740 tx=0x7efbdc005830 comp rx=0 tx=0).stop 2024-03-08T20:39:40.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 -- 172.21.15.118:0/3583171429 shutdown_connections 2024-03-08T20:39:40.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 --2- 172.21.15.118:0/3583171429 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbdc00b9c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 -- 172.21.15.118:0/3583171429 >> 172.21.15.118:0/3583171429 conn(0x7efbf80a84c0 msgr2=0x7efbf80a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:40.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 -- 172.21.15.118:0/3583171429 shutdown_connections 2024-03-08T20:39:40.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.197+0000 7efbfda00640 1 -- 172.21.15.118:0/3583171429 wait complete. 2024-03-08T20:39:40.203 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.199+0000 7efbfda00640 1 Processor -- start 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.199+0000 7efbfda00640 1 -- start start 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 0x7efbf8147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbf80bfd80 0x7efbf81480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf806b4e0 con 0x7efbdc005210 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf806b360 con 0x7efbf80bfd80 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbfda00640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf806e690 con 0x7efbf80bf920 2024-03-08T20:39:40.204 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbf6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47670/0 (socket says 172.21.15.118:47670) 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.200+0000 7efbf6a00640 1 -- 172.21.15.118:0/96078530 learned_addr learned my addr 172.21.15.118:0/96078530 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6000640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 0x7efbf8147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 -- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 msgr2=0x7efbf8147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf7400640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbf80bfd80 0x7efbf81480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 0x7efbf8147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 -- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbf80bfd80 msgr2=0x7efbf81480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbf80bfd80 0x7efbf81480e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.205 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 -- 172.21.15.118:0/96078530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80bef80 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6000640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 0x7efbf8147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbf6a00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efbe8010890 tx=0x7efbe8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800f040 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe800eb00 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe801c400 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf80c0240 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.201+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80bb900 con 0x7efbdc005210 2024-03-08T20:39:40.206 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.203+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf80c0990 con 0x7efbdc005210 2024-03-08T20:39:40.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.204+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efbe801c5a0 con 0x7efbdc005210 2024-03-08T20:39:40.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.204+0000 7efbeea00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 0x7efbd806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.205+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efbe808b480 con 0x7efbdc005210 2024-03-08T20:39:40.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.205+0000 7efbf6000640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 0x7efbd806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.207 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.205+0000 7efbf6000640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 0x7efbd806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efbf80c5fb0 tx=0x7efbe4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.209 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.209+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7efbe8018030 con 0x7efbdc005210 2024-03-08T20:39:40.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.403+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 --> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efbf8074a40 con 0x7efbd806bbd0 2024-03-08T20:39:40.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:39:40.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:39:40.431 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.432+0000 7efbeea00640 1 -- 172.21.15.118:0/96078530 <== mgr.4110 v2:172.21.15.118:6832/3268310629 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339235 (secure 0 0 0) 0x7efbf8074a40 con 0x7efbd806bbd0 2024-03-08T20:39:40.436 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:39:40.438 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 msgr2=0x7efbd806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 0x7efbd806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efbf80c5fb0 tx=0x7efbe4009040 comp rx=0 tx=0).stop 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 msgr2=0x7efbf80bea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efbe8010890 tx=0x7efbe8010d50 comp rx=0 tx=0).stop 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 shutdown_connections 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7efbd806bbd0 0x7efbd806e090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbf80bfd80 0x7efbf81480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.440 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbf80bf920 0x7efbf8147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.437+0000 7efbfda00640 1 --2- 172.21.15.118:0/96078530 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efbdc005210 0x7efbf80bea40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.438+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 >> 172.21.15.118:0/96078530 conn(0x7efbf80a84c0 msgr2=0x7efbf80a9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:40.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.438+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 shutdown_connections 2024-03-08T20:39:40.441 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.438+0000 7efbfda00640 1 -- 172.21.15.118:0/96078530 wait complete. 2024-03-08T20:39:40.455 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-03-08T20:39:39.742639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1667293385,"num_objects":159151,"num_object_clones":0,"num_object_copies":480766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159151,"num_whiteouts":0,"num_read":792,"num_read_kb":1702,"num_write":354798,"num_write_kb":2320405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":45098891,"num_omap_keys":77979,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348821,"ondisk_log_size":348821,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5552948,"kb_used_data":2795252,"kb_used_omap":12,"kb_used_meta":2757619,"kb_avail":749421772,"statfs":{"total":773094113280,"available":767407894528,"internally_reserved":0,"allocated":2862338048,"data_stored":4189631602,"data_compressed":619906340,"data_compressed_allocated":760389632,"data_compressed_original":2089127936,"omap_allocated":12751,"internal_metadata":2823802417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8195,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005329"},"pg_stats":[{"pgid":"2.1f","version":"27'363","reported_seq":406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.766104+0000","last_change":"2024-03-08T20:38:54.766174+0000","last_active":"2024-03-08T20:38:54.766104+0000","last_peered":"2024-03-08T20:38:54.766104+0000","last_clean":"2024-03-08T20:38:54.766104+0000","last_became_active":"2024-03-08T20:29:23.240749+0000","last_became_peered":"2024-03-08T20:29:23.240749+0000","last_unstale":"2024-03-08T20:38:54.766104+0000","last_undegraded":"2024-03-08T20:38:54.766104+0000","last_fullsized":"2024-03-08T20:38:54.766104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'363","last_scrub_stamp":"2024-03-08T20:38:54.765994+0000","last_deep_scrub":"27'363","last_deep_scrub_stamp":"2024-03-08T20:38:54.765994+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.765994+0000","objects_scrubbed":107,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:46:57.066939+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":107,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":475,"num_write_kb":13271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":105,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":821145,"num_omap_keys":1421,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2352","reported_seq":2435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.882153+0000","last_change":"2024-03-08T20:39:02.882153+0000","last_active":"2024-03-08T20:39:02.882153+0000","last_peered":"2024-03-08T20:39:02.882153+0000","last_clean":"2024-03-08T20:39:02.882153+0000","last_became_active":"2024-03-08T20:29:24.255183+0000","last_became_peered":"2024-03-08T20:29:24.255183+0000","last_unstale":"2024-03-08T20:39:02.882153+0000","last_undegraded":"2024-03-08T20:39:02.882153+0000","last_fullsized":"2024-03-08T20:39:02.882153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2352","last_scrub_stamp":"2024-03-08T20:39:02.882013+0000","last_deep_scrub":"27'2352","last_deep_scrub_stamp":"2024-03-08T20:39:02.882013+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.882013+0000","objects_scrubbed":1126,"log_size":2352,"log_dups_size":0,"ondisk_log_size":2352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:05.730968+0000","scrub_duration":3796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1126,"num_object_clones":0,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1126,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'5164","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.990009+0000","last_change":"2024-03-08T20:39:09.990123+0000","last_active":"2024-03-08T20:39:09.990009+0000","last_peered":"2024-03-08T20:39:09.990009+0000","last_clean":"2024-03-08T20:39:09.990009+0000","last_became_active":"2024-03-08T20:29:28.300437+0000","last_became_peered":"2024-03-08T20:29:28.300437+0000","last_unstale":"2024-03-08T20:39:09.990009+0000","last_undegraded":"2024-03-08T20:39:09.990009+0000","last_fullsized":"2024-03-08T20:39:09.990009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5164","last_scrub_stamp":"2024-03-08T20:39:09.989923+0000","last_deep_scrub":"27'5164","last_deep_scrub_stamp":"2024-03-08T20:39:09.989923+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.989923+0000","objects_scrubbed":2491,"log_size":5164,"log_dups_size":0,"ondisk_log_size":5164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:20.032682+0000","scrub_duration":8815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43610673,"num_objects":2491,"num_object_clones":0,"num_object_copies":9964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7490,"num_write_kb":46190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'697","reported_seq":742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.487376+0000","last_change":"2024-03-08T20:39:02.487376+0000","last_active":"2024-03-08T20:39:02.487376+0000","last_peered":"2024-03-08T20:39:02.487376+0000","last_clean":"2024-03-08T20:39:02.487376+0000","last_became_active":"2024-03-08T20:29:23.239368+0000","last_became_peered":"2024-03-08T20:29:23.239368+0000","last_unstale":"2024-03-08T20:39:02.487376+0000","last_undegraded":"2024-03-08T20:39:02.487376+0000","last_fullsized":"2024-03-08T20:39:02.487376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'697","last_scrub_stamp":"2024-03-08T20:39:02.487190+0000","last_deep_scrub":"27'697","last_deep_scrub_stamp":"2024-03-08T20:39:02.487190+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.487190+0000","objects_scrubbed":141,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:17.816123+0000","scrub_duration":343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":838,"num_write_kb":30475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1564507,"num_omap_keys":2715,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'2324","reported_seq":2405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.204769+0000","last_change":"2024-03-08T20:38:54.204874+0000","last_active":"2024-03-08T20:38:54.204769+0000","last_peered":"2024-03-08T20:38:54.204769+0000","last_clean":"2024-03-08T20:38:54.204769+0000","last_became_active":"2024-03-08T20:29:24.253844+0000","last_became_peered":"2024-03-08T20:29:24.253844+0000","last_unstale":"2024-03-08T20:38:54.204769+0000","last_undegraded":"2024-03-08T20:38:54.204769+0000","last_fullsized":"2024-03-08T20:38:54.204769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2324","last_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_deep_scrub":"27'2324","last_deep_scrub_stamp":"2024-03-08T20:38:54.204663+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.204663+0000","objects_scrubbed":1123,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.294448+0000","scrub_duration":1585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1123,"num_object_clones":0,"num_object_copies":2246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'5216","reported_seq":5348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.686512+0000","last_change":"2024-03-08T20:39:17.686621+0000","last_active":"2024-03-08T20:39:17.686512+0000","last_peered":"2024-03-08T20:39:17.686512+0000","last_clean":"2024-03-08T20:39:17.686512+0000","last_became_active":"2024-03-08T20:29:28.279986+0000","last_became_peered":"2024-03-08T20:29:28.279986+0000","last_unstale":"2024-03-08T20:39:17.686512+0000","last_undegraded":"2024-03-08T20:39:17.686512+0000","last_fullsized":"2024-03-08T20:39:17.686512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5216","last_scrub_stamp":"2024-03-08T20:39:17.686420+0000","last_deep_scrub":"27'5216","last_deep_scrub_stamp":"2024-03-08T20:39:17.686420+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.686420+0000","objects_scrubbed":2535,"log_size":5216,"log_dups_size":0,"ondisk_log_size":5216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:20.535375+0000","scrub_duration":12173,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49975102,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7593,"num_write_kb":52477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'669","reported_seq":714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.158178+0000","last_change":"2024-03-08T20:39:10.158227+0000","last_active":"2024-03-08T20:39:10.158178+0000","last_peered":"2024-03-08T20:39:10.158178+0000","last_clean":"2024-03-08T20:39:10.158178+0000","last_became_active":"2024-03-08T20:29:23.250606+0000","last_became_peered":"2024-03-08T20:29:23.250606+0000","last_unstale":"2024-03-08T20:39:10.158178+0000","last_undegraded":"2024-03-08T20:39:10.158178+0000","last_fullsized":"2024-03-08T20:39:10.158178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'669","last_scrub_stamp":"2024-03-08T20:39:10.158078+0000","last_deep_scrub":"27'669","last_deep_scrub_stamp":"2024-03-08T20:39:10.158078+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.158078+0000","objects_scrubbed":151,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:08.223643+0000","scrub_duration":1525,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":809,"num_write_kb":34823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":150,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1841975,"num_omap_keys":3183,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'2443","reported_seq":2526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.371201+0000","last_change":"2024-03-08T20:39:19.371311+0000","last_active":"2024-03-08T20:39:19.371201+0000","last_peered":"2024-03-08T20:39:19.371201+0000","last_clean":"2024-03-08T20:39:19.371201+0000","last_became_active":"2024-03-08T20:29:24.254471+0000","last_became_peered":"2024-03-08T20:29:24.254471+0000","last_unstale":"2024-03-08T20:39:19.371201+0000","last_undegraded":"2024-03-08T20:39:19.371201+0000","last_fullsized":"2024-03-08T20:39:19.371201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2443","last_scrub_stamp":"2024-03-08T20:39:19.371084+0000","last_deep_scrub":"27'2443","last_deep_scrub_stamp":"2024-03-08T20:39:19.371084+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.371084+0000","objects_scrubbed":1167,"log_size":2443,"log_dups_size":0,"ondisk_log_size":2443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:52.069774+0000","scrub_duration":11910,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1167,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5265","reported_seq":5397,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.117265+0000","last_change":"2024-03-08T20:39:19.117331+0000","last_active":"2024-03-08T20:39:19.117265+0000","last_peered":"2024-03-08T20:39:19.117265+0000","last_clean":"2024-03-08T20:39:19.117265+0000","last_became_active":"2024-03-08T20:29:28.284577+0000","last_became_peered":"2024-03-08T20:29:28.284577+0000","last_unstale":"2024-03-08T20:39:19.117265+0000","last_undegraded":"2024-03-08T20:39:19.117265+0000","last_fullsized":"2024-03-08T20:39:19.117265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5265","last_scrub_stamp":"2024-03-08T20:39:19.116533+0000","last_deep_scrub":"27'5265","last_deep_scrub_stamp":"2024-03-08T20:39:19.116533+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.116533+0000","objects_scrubbed":2526,"log_size":5265,"log_dups_size":0,"ondisk_log_size":5265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:06:02.718886+0000","scrub_duration":11517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48958774,"num_objects":2526,"num_object_clones":0,"num_object_copies":10104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7645,"num_write_kb":51787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'452","reported_seq":496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.145507+0000","last_change":"2024-03-08T20:39:15.145610+0000","last_active":"2024-03-08T20:39:15.145507+0000","last_peered":"2024-03-08T20:39:15.145507+0000","last_clean":"2024-03-08T20:39:15.145507+0000","last_became_active":"2024-03-08T20:29:23.253089+0000","last_became_peered":"2024-03-08T20:29:23.253089+0000","last_unstale":"2024-03-08T20:39:15.145507+0000","last_undegraded":"2024-03-08T20:39:15.145507+0000","last_fullsized":"2024-03-08T20:39:15.145507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'452","last_scrub_stamp":"2024-03-08T20:39:15.145404+0000","last_deep_scrub":"27'452","last_deep_scrub_stamp":"2024-03-08T20:39:15.145404+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.145404+0000","objects_scrubbed":141,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:19.596874+0000","scrub_duration":2613,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":583,"num_write_kb":18030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1279988,"num_omap_keys":2212,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2380","reported_seq":2462,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.381837+0000","last_change":"2024-03-08T20:39:20.381892+0000","last_active":"2024-03-08T20:39:20.381837+0000","last_peered":"2024-03-08T20:39:20.381837+0000","last_clean":"2024-03-08T20:39:20.381837+0000","last_became_active":"2024-03-08T20:29:24.257773+0000","last_became_peered":"2024-03-08T20:29:24.257773+0000","last_unstale":"2024-03-08T20:39:20.381837+0000","last_undegraded":"2024-03-08T20:39:20.381837+0000","last_fullsized":"2024-03-08T20:39:20.381837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2380","last_scrub_stamp":"2024-03-08T20:39:20.381729+0000","last_deep_scrub":"27'2380","last_deep_scrub_stamp":"2024-03-08T20:39:20.381729+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.381729+0000","objects_scrubbed":1128,"log_size":2380,"log_dups_size":0,"ondisk_log_size":2380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:01:30.785764+0000","scrub_duration":10612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5155","reported_seq":5287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.077837+0000","last_change":"2024-03-08T20:39:18.077961+0000","last_active":"2024-03-08T20:39:18.077837+0000","last_peered":"2024-03-08T20:39:18.077837+0000","last_clean":"2024-03-08T20:39:18.077837+0000","last_became_active":"2024-03-08T20:29:28.278581+0000","last_became_peered":"2024-03-08T20:29:28.278581+0000","last_unstale":"2024-03-08T20:39:18.077837+0000","last_undegraded":"2024-03-08T20:39:18.077837+0000","last_fullsized":"2024-03-08T20:39:18.077837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5155","last_scrub_stamp":"2024-03-08T20:39:18.069188+0000","last_deep_scrub":"27'5155","last_deep_scrub_stamp":"2024-03-08T20:39:18.069188+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.069188+0000","objects_scrubbed":2534,"log_size":5155,"log_dups_size":0,"ondisk_log_size":5155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":15,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:24:01.423017+0000","scrub_duration":14805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44827205,"num_objects":2534,"num_object_clones":0,"num_object_copies":10136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2534,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7522,"num_write_kb":47331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'2391","reported_seq":2474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.627931+0000","last_change":"2024-03-08T20:39:15.628009+0000","last_active":"2024-03-08T20:39:15.627931+0000","last_peered":"2024-03-08T20:39:15.627931+0000","last_clean":"2024-03-08T20:39:15.627931+0000","last_became_active":"2024-03-08T20:29:24.254459+0000","last_became_peered":"2024-03-08T20:29:24.254459+0000","last_unstale":"2024-03-08T20:39:15.627931+0000","last_undegraded":"2024-03-08T20:39:15.627931+0000","last_fullsized":"2024-03-08T20:39:15.627931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2391","last_scrub_stamp":"2024-03-08T20:39:15.627834+0000","last_deep_scrub":"27'2391","last_deep_scrub_stamp":"2024-03-08T20:39:15.627834+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.627834+0000","objects_scrubbed":1139,"log_size":2391,"log_dups_size":0,"ondisk_log_size":2391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:30.956767+0000","scrub_duration":8949,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'545","reported_seq":589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.198648+0000","last_change":"2024-03-08T20:39:12.198790+0000","last_active":"2024-03-08T20:39:12.198648+0000","last_peered":"2024-03-08T20:39:12.198648+0000","last_clean":"2024-03-08T20:39:12.198648+0000","last_became_active":"2024-03-08T20:29:23.250446+0000","last_became_peered":"2024-03-08T20:29:23.250446+0000","last_unstale":"2024-03-08T20:39:12.198648+0000","last_undegraded":"2024-03-08T20:39:12.198648+0000","last_fullsized":"2024-03-08T20:39:12.198648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'545","last_scrub_stamp":"2024-03-08T20:39:12.196914+0000","last_deep_scrub":"27'545","last_deep_scrub_stamp":"2024-03-08T20:39:12.196914+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.196914+0000","objects_scrubbed":148,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:55.799268+0000","scrub_duration":1662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":692,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2521840,"num_omap_keys":4331,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'5284","reported_seq":5418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.446889+0000","last_change":"2024-03-08T20:39:10.447041+0000","last_active":"2024-03-08T20:39:10.446889+0000","last_peered":"2024-03-08T20:39:10.446889+0000","last_clean":"2024-03-08T20:39:10.446889+0000","last_became_active":"2024-03-08T20:29:28.278196+0000","last_became_peered":"2024-03-08T20:29:28.278196+0000","last_unstale":"2024-03-08T20:39:10.446889+0000","last_undegraded":"2024-03-08T20:39:10.446889+0000","last_fullsized":"2024-03-08T20:39:10.446889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5284","last_scrub_stamp":"2024-03-08T20:39:10.446789+0000","last_deep_scrub":"27'5284","last_deep_scrub_stamp":"2024-03-08T20:39:10.446789+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.446789+0000","objects_scrubbed":2560,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:59.615129+0000","scrub_duration":8168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55290298,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7680,"num_write_kb":57877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'2484","reported_seq":2569,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.155625+0000","last_change":"2024-03-08T20:39:13.155692+0000","last_active":"2024-03-08T20:39:13.155625+0000","last_peered":"2024-03-08T20:39:13.155625+0000","last_clean":"2024-03-08T20:39:13.155625+0000","last_became_active":"2024-03-08T20:29:24.244849+0000","last_became_peered":"2024-03-08T20:29:24.244849+0000","last_unstale":"2024-03-08T20:39:13.155625+0000","last_undegraded":"2024-03-08T20:39:13.155625+0000","last_fullsized":"2024-03-08T20:39:13.155625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2484","last_scrub_stamp":"2024-03-08T20:39:13.155529+0000","last_deep_scrub":"27'2484","last_deep_scrub_stamp":"2024-03-08T20:39:13.155529+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.155529+0000","objects_scrubbed":1185,"log_size":2484,"log_dups_size":0,"ondisk_log_size":2484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:28.003994+0000","scrub_duration":6894,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1185,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1185,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1641","reported_seq":1685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.608835+0000","last_change":"2024-03-08T20:39:00.608909+0000","last_active":"2024-03-08T20:39:00.608835+0000","last_peered":"2024-03-08T20:39:00.608835+0000","last_clean":"2024-03-08T20:39:00.608835+0000","last_became_active":"2024-03-08T20:29:23.247412+0000","last_became_peered":"2024-03-08T20:29:23.247412+0000","last_unstale":"2024-03-08T20:39:00.608835+0000","last_undegraded":"2024-03-08T20:39:00.608835+0000","last_fullsized":"2024-03-08T20:39:00.608835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1641","last_scrub_stamp":"2024-03-08T20:39:00.608720+0000","last_deep_scrub":"27'1641","last_deep_scrub_stamp":"2024-03-08T20:39:00.608720+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.608720+0000","objects_scrubbed":134,"log_size":1641,"log_dups_size":0,"ondisk_log_size":1641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:57:58.141039+0000","scrub_duration":596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":134,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":1777,"num_write_kb":31095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1230536,"num_omap_keys":2134,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'5273","reported_seq":5407,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.105523+0000","last_change":"2024-03-08T20:39:19.105591+0000","last_active":"2024-03-08T20:39:19.105523+0000","last_peered":"2024-03-08T20:39:19.105523+0000","last_clean":"2024-03-08T20:39:19.105523+0000","last_became_active":"2024-03-08T20:29:28.284532+0000","last_became_peered":"2024-03-08T20:29:28.284532+0000","last_unstale":"2024-03-08T20:39:19.105523+0000","last_undegraded":"2024-03-08T20:39:19.105523+0000","last_fullsized":"2024-03-08T20:39:19.105523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5273","last_scrub_stamp":"2024-03-08T20:39:19.105422+0000","last_deep_scrub":"27'5273","last_deep_scrub_stamp":"2024-03-08T20:39:19.105422+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.105422+0000","objects_scrubbed":2554,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:04:42.340264+0000","scrub_duration":12528,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48708071,"num_objects":2554,"num_object_clones":0,"num_object_copies":10216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7687,"num_write_kb":51751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'2472","reported_seq":2557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.494345+0000","last_change":"2024-03-08T20:39:12.494410+0000","last_active":"2024-03-08T20:39:12.494345+0000","last_peered":"2024-03-08T20:39:12.494345+0000","last_clean":"2024-03-08T20:39:12.494345+0000","last_became_active":"2024-03-08T20:29:24.240348+0000","last_became_peered":"2024-03-08T20:29:24.240348+0000","last_unstale":"2024-03-08T20:39:12.494345+0000","last_undegraded":"2024-03-08T20:39:12.494345+0000","last_fullsized":"2024-03-08T20:39:12.494345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2472","last_scrub_stamp":"2024-03-08T20:39:12.494254+0000","last_deep_scrub":"27'2472","last_deep_scrub_stamp":"2024-03-08T20:39:12.494254+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.494254+0000","objects_scrubbed":1181,"log_size":2472,"log_dups_size":0,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:23.479524+0000","scrub_duration":7290,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1181,"num_object_clones":0,"num_object_copies":2362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'599","reported_seq":644,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.681385+0000","last_change":"2024-03-08T20:39:01.681470+0000","last_active":"2024-03-08T20:39:01.681385+0000","last_peered":"2024-03-08T20:39:01.681385+0000","last_clean":"2024-03-08T20:39:01.681385+0000","last_became_active":"2024-03-08T20:29:23.253105+0000","last_became_peered":"2024-03-08T20:29:23.253105+0000","last_unstale":"2024-03-08T20:39:01.681385+0000","last_undegraded":"2024-03-08T20:39:01.681385+0000","last_fullsized":"2024-03-08T20:39:01.681385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'599","last_scrub_stamp":"2024-03-08T20:39:01.681290+0000","last_deep_scrub":"27'599","last_deep_scrub_stamp":"2024-03-08T20:39:01.681290+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.681290+0000","objects_scrubbed":162,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:50.849631+0000","scrub_duration":629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":762,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":161,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1593318,"num_omap_keys":2762,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5194","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.155271+0000","last_change":"2024-03-08T20:39:20.155333+0000","last_active":"2024-03-08T20:39:20.155271+0000","last_peered":"2024-03-08T20:39:20.155271+0000","last_clean":"2024-03-08T20:39:20.155271+0000","last_became_active":"2024-03-08T20:29:28.306990+0000","last_became_peered":"2024-03-08T20:29:28.306990+0000","last_unstale":"2024-03-08T20:39:20.155271+0000","last_undegraded":"2024-03-08T20:39:20.155271+0000","last_fullsized":"2024-03-08T20:39:20.155271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5194","last_scrub_stamp":"2024-03-08T20:39:20.155095+0000","last_deep_scrub":"27'5194","last_deep_scrub_stamp":"2024-03-08T20:39:20.155095+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.155095+0000","objects_scrubbed":2530,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:31.140366+0000","scrub_duration":9880,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46550516,"num_objects":2530,"num_object_clones":0,"num_object_copies":10120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2530,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":48796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'2478","reported_seq":2563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.478457+0000","last_change":"2024-03-08T20:38:59.478515+0000","last_active":"2024-03-08T20:38:59.478457+0000","last_peered":"2024-03-08T20:38:59.478457+0000","last_clean":"2024-03-08T20:38:59.478457+0000","last_became_active":"2024-03-08T20:29:24.241020+0000","last_became_peered":"2024-03-08T20:29:24.241020+0000","last_unstale":"2024-03-08T20:38:59.478457+0000","last_undegraded":"2024-03-08T20:38:59.478457+0000","last_fullsized":"2024-03-08T20:38:59.478457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2478","last_scrub_stamp":"2024-03-08T20:38:59.478393+0000","last_deep_scrub":"27'2478","last_deep_scrub_stamp":"2024-03-08T20:38:59.478393+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.478393+0000","objects_scrubbed":1193,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:10.906250+0000","scrub_duration":2353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1193,"num_object_clones":0,"num_object_copies":2386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1193,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1110","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.527843+0000","last_change":"2024-03-08T20:39:10.527879+0000","last_active":"2024-03-08T20:39:10.527843+0000","last_peered":"2024-03-08T20:39:10.527843+0000","last_clean":"2024-03-08T20:39:10.527843+0000","last_became_active":"2024-03-08T20:29:23.251433+0000","last_became_peered":"2024-03-08T20:29:23.251433+0000","last_unstale":"2024-03-08T20:39:10.527843+0000","last_undegraded":"2024-03-08T20:39:10.527843+0000","last_fullsized":"2024-03-08T20:39:10.527843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1110","last_scrub_stamp":"2024-03-08T20:39:10.527760+0000","last_deep_scrub":"27'1110","last_deep_scrub_stamp":"2024-03-08T20:39:10.527760+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.527760+0000","objects_scrubbed":150,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:25.856693+0000","scrub_duration":981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":150,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1259,"num_write_kb":14162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":149,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1312584,"num_omap_keys":2276,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'5284","reported_seq":5418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:14.905578+0000","last_change":"2024-03-08T20:39:14.905669+0000","last_active":"2024-03-08T20:39:14.905578+0000","last_peered":"2024-03-08T20:39:14.905578+0000","last_clean":"2024-03-08T20:39:14.905578+0000","last_became_active":"2024-03-08T20:29:28.279775+0000","last_became_peered":"2024-03-08T20:29:28.279775+0000","last_unstale":"2024-03-08T20:39:14.905578+0000","last_undegraded":"2024-03-08T20:39:14.905578+0000","last_fullsized":"2024-03-08T20:39:14.905578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5284","last_scrub_stamp":"2024-03-08T20:39:14.902991+0000","last_deep_scrub":"27'5284","last_deep_scrub_stamp":"2024-03-08T20:39:14.902991+0000","last_clean_scrub_stamp":"2024-03-08T20:39:14.902991+0000","objects_scrubbed":2556,"log_size":5284,"log_dups_size":0,"ondisk_log_size":5284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:30.231924+0000","scrub_duration":10469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45529582,"num_objects":2556,"num_object_clones":0,"num_object_copies":10224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2556,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":48465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'2401","reported_seq":2485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.317181+0000","last_change":"2024-03-08T20:39:02.317227+0000","last_active":"2024-03-08T20:39:02.317181+0000","last_peered":"2024-03-08T20:39:02.317181+0000","last_clean":"2024-03-08T20:39:02.317181+0000","last_became_active":"2024-03-08T20:29:24.246072+0000","last_became_peered":"2024-03-08T20:29:24.246072+0000","last_unstale":"2024-03-08T20:39:02.317181+0000","last_undegraded":"2024-03-08T20:39:02.317181+0000","last_fullsized":"2024-03-08T20:39:02.317181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2401","last_scrub_stamp":"2024-03-08T20:39:02.317094+0000","last_deep_scrub":"27'2401","last_deep_scrub_stamp":"2024-03-08T20:39:02.317094+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.317094+0000","objects_scrubbed":1152,"log_size":2401,"log_dups_size":0,"ondisk_log_size":2401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:50.606813+0000","scrub_duration":2692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'435","reported_seq":479,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.991976+0000","last_change":"2024-03-08T20:39:01.992035+0000","last_active":"2024-03-08T20:39:01.991976+0000","last_peered":"2024-03-08T20:39:01.991976+0000","last_clean":"2024-03-08T20:39:01.991976+0000","last_became_active":"2024-03-08T20:29:23.255374+0000","last_became_peered":"2024-03-08T20:29:23.255374+0000","last_unstale":"2024-03-08T20:39:01.991976+0000","last_undegraded":"2024-03-08T20:39:01.991976+0000","last_fullsized":"2024-03-08T20:39:01.991976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'435","last_scrub_stamp":"2024-03-08T20:39:01.991886+0000","last_deep_scrub":"27'435","last_deep_scrub_stamp":"2024-03-08T20:39:01.991886+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.991886+0000","objects_scrubbed":130,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:47:04.292831+0000","scrub_duration":433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":565,"num_write_kb":13380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":129,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":987819,"num_omap_keys":1709,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'5236","reported_seq":5368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.469655+0000","last_change":"2024-03-08T20:39:21.469710+0000","last_active":"2024-03-08T20:39:21.469655+0000","last_peered":"2024-03-08T20:39:21.469655+0000","last_clean":"2024-03-08T20:39:21.469655+0000","last_became_active":"2024-03-08T20:29:28.302107+0000","last_became_peered":"2024-03-08T20:29:28.302107+0000","last_unstale":"2024-03-08T20:39:21.469655+0000","last_undegraded":"2024-03-08T20:39:21.469655+0000","last_fullsized":"2024-03-08T20:39:21.469655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5236","last_scrub_stamp":"2024-03-08T20:39:21.469582+0000","last_deep_scrub":"27'5236","last_deep_scrub_stamp":"2024-03-08T20:39:21.469582+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.469582+0000","objects_scrubbed":2521,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:36:16.499773+0000","scrub_duration":11521,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40125482,"num_objects":2521,"num_object_clones":0,"num_object_copies":10084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7619,"num_write_kb":42918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'2359","reported_seq":2441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.601460+0000","last_change":"2024-03-08T20:39:17.601514+0000","last_active":"2024-03-08T20:39:17.601460+0000","last_peered":"2024-03-08T20:39:17.601460+0000","last_clean":"2024-03-08T20:39:17.601460+0000","last_became_active":"2024-03-08T20:29:24.268535+0000","last_became_peered":"2024-03-08T20:29:24.268535+0000","last_unstale":"2024-03-08T20:39:17.601460+0000","last_undegraded":"2024-03-08T20:39:17.601460+0000","last_fullsized":"2024-03-08T20:39:17.601460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2359","last_scrub_stamp":"2024-03-08T20:39:17.601371+0000","last_deep_scrub":"27'2359","last_deep_scrub_stamp":"2024-03-08T20:39:17.601371+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.601371+0000","objects_scrubbed":1104,"log_size":2359,"log_dups_size":0,"ondisk_log_size":2359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:09:19.150475+0000","scrub_duration":5959,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1104,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'900","reported_seq":943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.419221+0000","last_change":"2024-03-08T20:38:58.419360+0000","last_active":"2024-03-08T20:38:58.419221+0000","last_peered":"2024-03-08T20:38:58.419221+0000","last_clean":"2024-03-08T20:38:58.419221+0000","last_became_active":"2024-03-08T20:29:23.243138+0000","last_became_peered":"2024-03-08T20:29:23.243138+0000","last_unstale":"2024-03-08T20:38:58.419221+0000","last_undegraded":"2024-03-08T20:38:58.419221+0000","last_fullsized":"2024-03-08T20:38:58.419221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'900","last_scrub_stamp":"2024-03-08T20:38:58.419125+0000","last_deep_scrub":"27'900","last_deep_scrub_stamp":"2024-03-08T20:38:58.419125+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.419125+0000","objects_scrubbed":117,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:14:11.704657+0000","scrub_duration":350,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":117,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":1741,"num_write_kb":23749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":116,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":997811,"num_omap_keys":1729,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5227","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:07.854141+0000","last_change":"2024-03-08T20:39:07.854312+0000","last_active":"2024-03-08T20:39:07.854141+0000","last_peered":"2024-03-08T20:39:07.854141+0000","last_clean":"2024-03-08T20:39:07.854141+0000","last_became_active":"2024-03-08T20:29:28.300649+0000","last_became_peered":"2024-03-08T20:29:28.300649+0000","last_unstale":"2024-03-08T20:39:07.854141+0000","last_undegraded":"2024-03-08T20:39:07.854141+0000","last_fullsized":"2024-03-08T20:39:07.854141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5227","last_scrub_stamp":"2024-03-08T20:39:07.854037+0000","last_deep_scrub":"27'5227","last_deep_scrub_stamp":"2024-03-08T20:39:07.854037+0000","last_clean_scrub_stamp":"2024-03-08T20:39:07.854037+0000","objects_scrubbed":2545,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:44.614311+0000","scrub_duration":7726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42140489,"num_objects":2545,"num_object_clones":0,"num_object_copies":10180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2545,"num_whiteouts":0,"num_read":1,"num_read_kb":585,"num_write":7622,"num_write_kb":44700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'2431","reported_seq":2515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.091109+0000","last_change":"2024-03-08T20:39:06.091137+0000","last_active":"2024-03-08T20:39:06.091109+0000","last_peered":"2024-03-08T20:39:06.091109+0000","last_clean":"2024-03-08T20:39:06.091109+0000","last_became_active":"2024-03-08T20:29:24.224430+0000","last_became_peered":"2024-03-08T20:29:24.224430+0000","last_unstale":"2024-03-08T20:39:06.091109+0000","last_undegraded":"2024-03-08T20:39:06.091109+0000","last_fullsized":"2024-03-08T20:39:06.091109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2431","last_scrub_stamp":"2024-03-08T20:39:06.091045+0000","last_deep_scrub":"27'2431","last_deep_scrub_stamp":"2024-03-08T20:39:06.091045+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.091045+0000","objects_scrubbed":1176,"log_size":2431,"log_dups_size":0,"ondisk_log_size":2431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:08.940000+0000","scrub_duration":3996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1176,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'578","reported_seq":622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.896446+0000","last_change":"2024-03-08T20:39:08.896545+0000","last_active":"2024-03-08T20:39:08.896446+0000","last_peered":"2024-03-08T20:39:08.896446+0000","last_clean":"2024-03-08T20:39:08.896446+0000","last_became_active":"2024-03-08T20:29:23.250567+0000","last_became_peered":"2024-03-08T20:29:23.250567+0000","last_unstale":"2024-03-08T20:39:08.896446+0000","last_undegraded":"2024-03-08T20:39:08.896446+0000","last_fullsized":"2024-03-08T20:39:08.896446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'578","last_scrub_stamp":"2024-03-08T20:39:08.896357+0000","last_deep_scrub":"27'578","last_deep_scrub_stamp":"2024-03-08T20:39:08.896357+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.896357+0000","objects_scrubbed":145,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:31:58.912503+0000","scrub_duration":1394,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":725,"num_write_kb":22293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1639644,"num_omap_keys":2838,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'5294","reported_seq":5435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.380592+0000","last_change":"2024-03-08T20:39:19.380628+0000","last_active":"2024-03-08T20:39:19.380592+0000","last_peered":"2024-03-08T20:39:19.380592+0000","last_clean":"2024-03-08T20:39:19.380592+0000","last_became_active":"2024-03-08T20:30:10.905535+0000","last_became_peered":"2024-03-08T20:30:10.905535+0000","last_unstale":"2024-03-08T20:39:19.380592+0000","last_undegraded":"2024-03-08T20:39:19.380592+0000","last_fullsized":"2024-03-08T20:39:19.380592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5294","last_scrub_stamp":"2024-03-08T20:39:19.380510+0000","last_deep_scrub":"27'5294","last_deep_scrub_stamp":"2024-03-08T20:39:19.380510+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.380510+0000","objects_scrubbed":2561,"log_size":5294,"log_dups_size":0,"ondisk_log_size":5294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:39:08.145779+0000","scrub_duration":10049,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43683680,"num_objects":2561,"num_object_clones":0,"num_object_copies":10244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7685,"num_write_kb":46492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'2349","reported_seq":2418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.790629+0000","last_change":"2024-03-08T20:39:09.790709+0000","last_active":"2024-03-08T20:39:09.790629+0000","last_peered":"2024-03-08T20:39:09.790629+0000","last_clean":"2024-03-08T20:39:09.790629+0000","last_became_active":"2024-03-08T20:30:10.905906+0000","last_became_peered":"2024-03-08T20:30:10.905906+0000","last_unstale":"2024-03-08T20:39:09.790629+0000","last_undegraded":"2024-03-08T20:39:09.790629+0000","last_fullsized":"2024-03-08T20:39:09.790629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2349","last_scrub_stamp":"2024-03-08T20:39:09.790491+0000","last_deep_scrub":"27'2349","last_deep_scrub_stamp":"2024-03-08T20:39:09.790491+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.790491+0000","objects_scrubbed":1140,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:21.218349+0000","scrub_duration":6430,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1140,"num_object_clones":0,"num_object_copies":2280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'2132","reported_seq":2176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.519584+0000","last_change":"2024-03-08T20:38:56.519663+0000","last_active":"2024-03-08T20:38:56.519584+0000","last_peered":"2024-03-08T20:38:56.519584+0000","last_clean":"2024-03-08T20:38:56.519584+0000","last_became_active":"2024-03-08T20:29:23.231673+0000","last_became_peered":"2024-03-08T20:29:23.231673+0000","last_unstale":"2024-03-08T20:38:56.519584+0000","last_undegraded":"2024-03-08T20:38:56.519584+0000","last_fullsized":"2024-03-08T20:38:56.519584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2132","last_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_deep_scrub":"27'2132","last_deep_scrub_stamp":"2024-03-08T20:38:56.519479+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.519479+0000","objects_scrubbed":135,"log_size":2132,"log_dups_size":0,"ondisk_log_size":2132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:38:08.647763+0000","scrub_duration":370,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":135,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":135,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2268,"num_write_kb":18883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1025536,"num_omap_keys":1778,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5227","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.087734+0000","last_change":"2024-03-08T20:39:19.087772+0000","last_active":"2024-03-08T20:39:19.087734+0000","last_peered":"2024-03-08T20:39:19.087734+0000","last_clean":"2024-03-08T20:39:19.087734+0000","last_became_active":"2024-03-08T20:29:28.281855+0000","last_became_peered":"2024-03-08T20:29:28.281855+0000","last_unstale":"2024-03-08T20:39:19.087734+0000","last_undegraded":"2024-03-08T20:39:19.087734+0000","last_fullsized":"2024-03-08T20:39:19.087734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5227","last_scrub_stamp":"2024-03-08T20:39:19.087650+0000","last_deep_scrub":"27'5227","last_deep_scrub_stamp":"2024-03-08T20:39:19.087650+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.087650+0000","objects_scrubbed":2535,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:04:57.413007+0000","scrub_duration":12886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50545974,"num_objects":2535,"num_object_clones":0,"num_object_copies":10140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2535,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7600,"num_write_kb":53102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'2349","reported_seq":2432,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.869179+0000","last_change":"2024-03-08T20:39:08.869247+0000","last_active":"2024-03-08T20:39:08.869179+0000","last_peered":"2024-03-08T20:39:08.869179+0000","last_clean":"2024-03-08T20:39:08.869179+0000","last_became_active":"2024-03-08T20:29:24.259828+0000","last_became_peered":"2024-03-08T20:29:24.259828+0000","last_unstale":"2024-03-08T20:39:08.869179+0000","last_undegraded":"2024-03-08T20:39:08.869179+0000","last_fullsized":"2024-03-08T20:39:08.869179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2349","last_scrub_stamp":"2024-03-08T20:39:08.869082+0000","last_deep_scrub":"27'2349","last_deep_scrub_stamp":"2024-03-08T20:39:08.869082+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.869082+0000","objects_scrubbed":1134,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:14:32.281972+0000","scrub_duration":8648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1134,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'1014","reported_seq":1058,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.440907+0000","last_change":"2024-03-08T20:38:57.441007+0000","last_active":"2024-03-08T20:38:57.440907+0000","last_peered":"2024-03-08T20:38:57.440907+0000","last_clean":"2024-03-08T20:38:57.440907+0000","last_became_active":"2024-03-08T20:29:23.237655+0000","last_became_peered":"2024-03-08T20:29:23.237655+0000","last_unstale":"2024-03-08T20:38:57.440907+0000","last_undegraded":"2024-03-08T20:38:57.440907+0000","last_fullsized":"2024-03-08T20:38:57.440907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1014","last_scrub_stamp":"2024-03-08T20:38:57.440808+0000","last_deep_scrub":"27'1014","last_deep_scrub_stamp":"2024-03-08T20:38:57.440808+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.440808+0000","objects_scrubbed":147,"log_size":1014,"log_dups_size":0,"ondisk_log_size":1014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.757906+0000","scrub_duration":223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1157,"num_write_kb":42617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1260121,"num_omap_keys":2182,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5224","reported_seq":5357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.860579+0000","last_change":"2024-03-08T20:39:15.860628+0000","last_active":"2024-03-08T20:39:15.860579+0000","last_peered":"2024-03-08T20:39:15.860579+0000","last_clean":"2024-03-08T20:39:15.860579+0000","last_became_active":"2024-03-08T20:29:28.292339+0000","last_became_peered":"2024-03-08T20:29:28.292339+0000","last_unstale":"2024-03-08T20:39:15.860579+0000","last_undegraded":"2024-03-08T20:39:15.860579+0000","last_fullsized":"2024-03-08T20:39:15.860579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5224","last_scrub_stamp":"2024-03-08T20:39:15.860470+0000","last_deep_scrub":"27'5224","last_deep_scrub_stamp":"2024-03-08T20:39:15.860470+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.860470+0000","objects_scrubbed":2525,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:25.903230+0000","scrub_duration":7536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48750533,"num_objects":2525,"num_object_clones":0,"num_object_copies":10100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7595,"num_write_kb":51210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'2422","reported_seq":2506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:07.815802+0000","last_change":"2024-03-08T20:39:07.815897+0000","last_active":"2024-03-08T20:39:07.815802+0000","last_peered":"2024-03-08T20:39:07.815802+0000","last_clean":"2024-03-08T20:39:07.815802+0000","last_became_active":"2024-03-08T20:29:24.227488+0000","last_became_peered":"2024-03-08T20:29:24.227488+0000","last_unstale":"2024-03-08T20:39:07.815802+0000","last_undegraded":"2024-03-08T20:39:07.815802+0000","last_fullsized":"2024-03-08T20:39:07.815802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2422","last_scrub_stamp":"2024-03-08T20:39:07.815730+0000","last_deep_scrub":"27'2422","last_deep_scrub_stamp":"2024-03-08T20:39:07.815730+0000","last_clean_scrub_stamp":"2024-03-08T20:39:07.815730+0000","objects_scrubbed":1174,"log_size":2422,"log_dups_size":0,"ondisk_log_size":2422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:51.418083+0000","scrub_duration":4671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1174,"num_object_clones":0,"num_object_copies":2348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1538","reported_seq":2120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.547957+0000","last_change":"2024-03-08T20:38:56.548011+0000","last_active":"2024-03-08T20:38:56.547957+0000","last_peered":"2024-03-08T20:38:56.547957+0000","last_clean":"2024-03-08T20:38:56.547957+0000","last_became_active":"2024-03-08T20:29:23.239224+0000","last_became_peered":"2024-03-08T20:29:23.239224+0000","last_unstale":"2024-03-08T20:38:56.547957+0000","last_undegraded":"2024-03-08T20:38:56.547957+0000","last_fullsized":"2024-03-08T20:38:56.547957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1538","last_scrub_stamp":"2024-03-08T20:38:56.547886+0000","last_deep_scrub":"27'1538","last_deep_scrub_stamp":"2024-03-08T20:38:56.547886+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.547886+0000","objects_scrubbed":137,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:23:30.357392+0000","scrub_duration":295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8975860,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":540,"num_read_kb":970,"num_write":1672,"num_write_kb":23293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1236571,"num_omap_keys":2143,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5239","reported_seq":5370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.656983+0000","last_change":"2024-03-08T20:39:15.657162+0000","last_active":"2024-03-08T20:39:15.656983+0000","last_peered":"2024-03-08T20:39:15.656983+0000","last_clean":"2024-03-08T20:39:15.656983+0000","last_became_active":"2024-03-08T20:29:28.286523+0000","last_became_peered":"2024-03-08T20:29:28.286523+0000","last_unstale":"2024-03-08T20:39:15.656983+0000","last_undegraded":"2024-03-08T20:39:15.656983+0000","last_fullsized":"2024-03-08T20:39:15.656983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5239","last_scrub_stamp":"2024-03-08T20:39:15.656887+0000","last_deep_scrub":"27'5239","last_deep_scrub_stamp":"2024-03-08T20:39:15.656887+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.656887+0000","objects_scrubbed":2498,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:04.545424+0000","scrub_duration":8344,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46718844,"num_objects":2498,"num_object_clones":0,"num_object_copies":9992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7601,"num_write_kb":50078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'2287","reported_seq":2369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.870083+0000","last_change":"2024-03-08T20:39:05.870145+0000","last_active":"2024-03-08T20:39:05.870083+0000","last_peered":"2024-03-08T20:39:05.870083+0000","last_clean":"2024-03-08T20:39:05.870083+0000","last_became_active":"2024-03-08T20:29:24.246535+0000","last_became_peered":"2024-03-08T20:29:24.246535+0000","last_unstale":"2024-03-08T20:39:05.870083+0000","last_undegraded":"2024-03-08T20:39:05.870083+0000","last_fullsized":"2024-03-08T20:39:05.870083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2287","last_scrub_stamp":"2024-03-08T20:39:05.869991+0000","last_deep_scrub":"27'2287","last_deep_scrub_stamp":"2024-03-08T20:39:05.869991+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.869991+0000","objects_scrubbed":1105,"log_size":2287,"log_dups_size":0,"ondisk_log_size":2287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:11:08.718947+0000","scrub_duration":5216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1105,"num_object_clones":0,"num_object_copies":2210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1105,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'744","reported_seq":789,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.315010+0000","last_change":"2024-03-08T20:39:12.315010+0000","last_active":"2024-03-08T20:39:12.315010+0000","last_peered":"2024-03-08T20:39:12.315010+0000","last_clean":"2024-03-08T20:39:12.315010+0000","last_became_active":"2024-03-08T20:29:23.252082+0000","last_became_peered":"2024-03-08T20:29:23.252082+0000","last_unstale":"2024-03-08T20:39:12.315010+0000","last_undegraded":"2024-03-08T20:39:12.315010+0000","last_fullsized":"2024-03-08T20:39:12.315010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'744","last_scrub_stamp":"2024-03-08T20:39:12.314837+0000","last_deep_scrub":"27'744","last_deep_scrub_stamp":"2024-03-08T20:39:12.314837+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.314837+0000","objects_scrubbed":141,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:12.359425+0000","scrub_duration":791,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":141,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":141,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":875,"num_write_kb":30911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":138,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1964707,"num_omap_keys":3373,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'5414","reported_seq":5549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.263587+0000","last_change":"2024-03-08T20:39:18.263657+0000","last_active":"2024-03-08T20:39:18.263587+0000","last_peered":"2024-03-08T20:39:18.263587+0000","last_clean":"2024-03-08T20:39:18.263587+0000","last_became_active":"2024-03-08T20:29:28.303728+0000","last_became_peered":"2024-03-08T20:29:28.303728+0000","last_unstale":"2024-03-08T20:39:18.263587+0000","last_undegraded":"2024-03-08T20:39:18.263587+0000","last_fullsized":"2024-03-08T20:39:18.263587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5414","last_scrub_stamp":"2024-03-08T20:39:18.263469+0000","last_deep_scrub":"27'5414","last_deep_scrub_stamp":"2024-03-08T20:39:18.263469+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.263469+0000","objects_scrubbed":2589,"log_size":5414,"log_dups_size":0,"ondisk_log_size":5414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:28.306229+0000","scrub_duration":10134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52151852,"num_objects":2589,"num_object_clones":0,"num_object_copies":10356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2589,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7856,"num_write_kb":55025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'2438","reported_seq":2508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.779075+0000","last_change":"2024-03-08T20:38:55.779145+0000","last_active":"2024-03-08T20:38:55.779075+0000","last_peered":"2024-03-08T20:38:55.779075+0000","last_clean":"2024-03-08T20:38:55.779075+0000","last_became_active":"2024-03-08T20:30:10.640274+0000","last_became_peered":"2024-03-08T20:30:10.640274+0000","last_unstale":"2024-03-08T20:38:55.779075+0000","last_undegraded":"2024-03-08T20:38:55.779075+0000","last_fullsized":"2024-03-08T20:38:55.779075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2438","last_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_deep_scrub":"27'2438","last_deep_scrub_stamp":"2024-03-08T20:38:55.778847+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.778847+0000","objects_scrubbed":1188,"log_size":2438,"log_dups_size":0,"ondisk_log_size":2438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:46:58.079791+0000","scrub_duration":1601,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1188,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1188,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1256,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'653","reported_seq":698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.610744+0000","last_change":"2024-03-08T20:38:59.610839+0000","last_active":"2024-03-08T20:38:59.610744+0000","last_peered":"2024-03-08T20:38:59.610744+0000","last_clean":"2024-03-08T20:38:59.610744+0000","last_became_active":"2024-03-08T20:29:23.243012+0000","last_became_peered":"2024-03-08T20:29:23.243012+0000","last_unstale":"2024-03-08T20:38:59.610744+0000","last_undegraded":"2024-03-08T20:38:59.610744+0000","last_fullsized":"2024-03-08T20:38:59.610744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'653","last_scrub_stamp":"2024-03-08T20:38:59.610642+0000","last_deep_scrub":"27'653","last_deep_scrub_stamp":"2024-03-08T20:38:59.610642+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.610642+0000","objects_scrubbed":165,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:27.893260+0000","scrub_duration":323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":822,"num_write_kb":17914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":163,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1298062,"num_omap_keys":2248,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.569047+0000","last_change":"2024-03-08T20:39:06.569047+0000","last_active":"2024-03-08T20:39:06.569047+0000","last_peered":"2024-03-08T20:39:06.569047+0000","last_clean":"2024-03-08T20:39:06.569047+0000","last_became_active":"2024-03-08T20:29:19.002846+0000","last_became_peered":"2024-03-08T20:29:19.002846+0000","last_unstale":"2024-03-08T20:39:06.569047+0000","last_undegraded":"2024-03-08T20:39:06.569047+0000","last_fullsized":"2024-03-08T20:39:06.569047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-08T20:39:06.568896+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-08T20:39:06.568896+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.568896+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:58:04.101215+0000","scrub_duration":108,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'5162","reported_seq":5294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.028163+0000","last_change":"2024-03-08T20:39:21.028228+0000","last_active":"2024-03-08T20:39:21.028163+0000","last_peered":"2024-03-08T20:39:21.028163+0000","last_clean":"2024-03-08T20:39:21.028163+0000","last_became_active":"2024-03-08T20:29:28.300636+0000","last_became_peered":"2024-03-08T20:29:28.300636+0000","last_unstale":"2024-03-08T20:39:21.028163+0000","last_undegraded":"2024-03-08T20:39:21.028163+0000","last_fullsized":"2024-03-08T20:39:21.028163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5162","last_scrub_stamp":"2024-03-08T20:39:21.027947+0000","last_deep_scrub":"27'5162","last_deep_scrub_stamp":"2024-03-08T20:39:21.027947+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.027947+0000","objects_scrubbed":2508,"log_size":5162,"log_dups_size":0,"ondisk_log_size":5162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:19:51.013231+0000","scrub_duration":8918,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46374381,"num_objects":2508,"num_object_clones":0,"num_object_copies":10032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7527,"num_write_kb":48809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2409","reported_seq":2492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.230902+0000","last_change":"2024-03-08T20:39:17.230997+0000","last_active":"2024-03-08T20:39:17.230902+0000","last_peered":"2024-03-08T20:39:17.230902+0000","last_clean":"2024-03-08T20:39:17.230902+0000","last_became_active":"2024-03-08T20:29:24.264942+0000","last_became_peered":"2024-03-08T20:29:24.264942+0000","last_unstale":"2024-03-08T20:39:17.230902+0000","last_undegraded":"2024-03-08T20:39:17.230902+0000","last_fullsized":"2024-03-08T20:39:17.230902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2409","last_scrub_stamp":"2024-03-08T20:39:17.230797+0000","last_deep_scrub":"27'2409","last_deep_scrub_stamp":"2024-03-08T20:39:17.230797+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.230797+0000","objects_scrubbed":1144,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:04:55.556155+0000","scrub_duration":11763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1535","reported_seq":1579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.613505+0000","last_change":"2024-03-08T20:38:57.613592+0000","last_active":"2024-03-08T20:38:57.613505+0000","last_peered":"2024-03-08T20:38:57.613505+0000","last_clean":"2024-03-08T20:38:57.613505+0000","last_became_active":"2024-03-08T20:29:23.243152+0000","last_became_peered":"2024-03-08T20:29:23.243152+0000","last_unstale":"2024-03-08T20:38:57.613505+0000","last_undegraded":"2024-03-08T20:38:57.613505+0000","last_fullsized":"2024-03-08T20:38:57.613505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1535","last_scrub_stamp":"2024-03-08T20:38:57.613417+0000","last_deep_scrub":"27'1535","last_deep_scrub_stamp":"2024-03-08T20:38:57.613417+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.613417+0000","objects_scrubbed":140,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:24:04.955836+0000","scrub_duration":334,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1667,"num_write_kb":30964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":136,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1361429,"num_omap_keys":2359,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'5325","reported_seq":5460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.686185+0000","last_change":"2024-03-08T20:39:19.686266+0000","last_active":"2024-03-08T20:39:19.686185+0000","last_peered":"2024-03-08T20:39:19.686185+0000","last_clean":"2024-03-08T20:39:19.686185+0000","last_became_active":"2024-03-08T20:29:28.297452+0000","last_became_peered":"2024-03-08T20:29:28.297452+0000","last_unstale":"2024-03-08T20:39:19.686185+0000","last_undegraded":"2024-03-08T20:39:19.686185+0000","last_fullsized":"2024-03-08T20:39:19.686185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5325","last_scrub_stamp":"2024-03-08T20:39:19.686071+0000","last_deep_scrub":"27'5325","last_deep_scrub_stamp":"2024-03-08T20:39:19.686071+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.686071+0000","objects_scrubbed":2592,"log_size":5325,"log_dups_size":0,"ondisk_log_size":5325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:19.730659+0000","scrub_duration":8931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50522693,"num_objects":2592,"num_object_clones":0,"num_object_copies":10368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2592,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7695,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'2393","reported_seq":2477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.118998+0000","last_change":"2024-03-08T20:39:08.119049+0000","last_active":"2024-03-08T20:39:08.118998+0000","last_peered":"2024-03-08T20:39:08.118998+0000","last_clean":"2024-03-08T20:39:08.118998+0000","last_became_active":"2024-03-08T20:29:24.245657+0000","last_became_peered":"2024-03-08T20:29:24.245657+0000","last_unstale":"2024-03-08T20:39:08.118998+0000","last_undegraded":"2024-03-08T20:39:08.118998+0000","last_fullsized":"2024-03-08T20:39:08.118998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2393","last_scrub_stamp":"2024-03-08T20:39:08.118910+0000","last_deep_scrub":"27'2393","last_deep_scrub_stamp":"2024-03-08T20:39:08.118910+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.118910+0000","objects_scrubbed":1152,"log_size":2393,"log_dups_size":0,"ondisk_log_size":2393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:58:23.447843+0000","scrub_duration":5841,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'1644","reported_seq":1688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:59.517726+0000","last_change":"2024-03-08T20:38:59.517842+0000","last_active":"2024-03-08T20:38:59.517726+0000","last_peered":"2024-03-08T20:38:59.517726+0000","last_clean":"2024-03-08T20:38:59.517726+0000","last_became_active":"2024-03-08T20:29:23.246767+0000","last_became_peered":"2024-03-08T20:29:23.246767+0000","last_unstale":"2024-03-08T20:38:59.517726+0000","last_undegraded":"2024-03-08T20:38:59.517726+0000","last_fullsized":"2024-03-08T20:38:59.517726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1644","last_scrub_stamp":"2024-03-08T20:38:59.517631+0000","last_deep_scrub":"27'1644","last_deep_scrub_stamp":"2024-03-08T20:38:59.517631+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.517631+0000","objects_scrubbed":144,"log_size":1644,"log_dups_size":0,"ondisk_log_size":1644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:15.588122+0000","scrub_duration":469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":1789,"num_write_kb":35548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":141,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1718618,"num_omap_keys":2960,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'5383","reported_seq":5518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.665607+0000","last_change":"2024-03-08T20:39:18.665668+0000","last_active":"2024-03-08T20:39:18.665607+0000","last_peered":"2024-03-08T20:39:18.665607+0000","last_clean":"2024-03-08T20:39:18.665607+0000","last_became_active":"2024-03-08T20:29:28.283014+0000","last_became_peered":"2024-03-08T20:29:28.283014+0000","last_unstale":"2024-03-08T20:39:18.665607+0000","last_undegraded":"2024-03-08T20:39:18.665607+0000","last_fullsized":"2024-03-08T20:39:18.665607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-08T20:39:18.665496+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-08T20:39:18.665496+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.665496+0000","objects_scrubbed":2583,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":13,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:51.364185+0000","scrub_duration":12725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44305607,"num_objects":2583,"num_object_clones":0,"num_object_copies":10332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2583,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7798,"num_write_kb":47199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'2314","reported_seq":2395,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.861668+0000","last_change":"2024-03-08T20:39:20.861736+0000","last_active":"2024-03-08T20:39:20.861668+0000","last_peered":"2024-03-08T20:39:20.861668+0000","last_clean":"2024-03-08T20:39:20.861668+0000","last_became_active":"2024-03-08T20:29:24.249998+0000","last_became_peered":"2024-03-08T20:29:24.249998+0000","last_unstale":"2024-03-08T20:39:20.861668+0000","last_undegraded":"2024-03-08T20:39:20.861668+0000","last_fullsized":"2024-03-08T20:39:20.861668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2314","last_scrub_stamp":"2024-03-08T20:39:20.861608+0000","last_deep_scrub":"27'2314","last_deep_scrub_stamp":"2024-03-08T20:39:20.861608+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.861608+0000","objects_scrubbed":1097,"log_size":2314,"log_dups_size":0,"ondisk_log_size":2314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:40:12.472478+0000","scrub_duration":6318,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1097,"num_object_clones":0,"num_object_copies":2194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1097,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'1493","reported_seq":1537,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.495664+0000","last_change":"2024-03-08T20:38:55.495728+0000","last_active":"2024-03-08T20:38:55.495664+0000","last_peered":"2024-03-08T20:38:55.495664+0000","last_clean":"2024-03-08T20:38:55.495664+0000","last_became_active":"2024-03-08T20:29:23.238368+0000","last_became_peered":"2024-03-08T20:29:23.238368+0000","last_unstale":"2024-03-08T20:38:55.495664+0000","last_undegraded":"2024-03-08T20:38:55.495664+0000","last_fullsized":"2024-03-08T20:38:55.495664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1493","last_scrub_stamp":"2024-03-08T20:38:55.495557+0000","last_deep_scrub":"27'1493","last_deep_scrub_stamp":"2024-03-08T20:38:55.495557+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.495557+0000","objects_scrubbed":130,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:35:22.234642+0000","scrub_duration":217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1623,"num_write_kb":22215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":128,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":771215,"num_omap_keys":1334,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'5319","reported_seq":5454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.233891+0000","last_change":"2024-03-08T20:39:21.233941+0000","last_active":"2024-03-08T20:39:21.233891+0000","last_peered":"2024-03-08T20:39:21.233891+0000","last_clean":"2024-03-08T20:39:21.233891+0000","last_became_active":"2024-03-08T20:29:28.300638+0000","last_became_peered":"2024-03-08T20:29:28.300638+0000","last_unstale":"2024-03-08T20:39:21.233891+0000","last_undegraded":"2024-03-08T20:39:21.233891+0000","last_fullsized":"2024-03-08T20:39:21.233891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5319","last_scrub_stamp":"2024-03-08T20:39:21.233769+0000","last_deep_scrub":"27'5319","last_deep_scrub_stamp":"2024-03-08T20:39:21.233769+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.233769+0000","objects_scrubbed":2576,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:36.082234+0000","scrub_duration":8965,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40830908,"num_objects":2576,"num_object_clones":0,"num_object_copies":10304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2576,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7718,"num_write_kb":43537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'2514","reported_seq":2599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.127289+0000","last_change":"2024-03-08T20:39:21.127390+0000","last_active":"2024-03-08T20:39:21.127289+0000","last_peered":"2024-03-08T20:39:21.127289+0000","last_clean":"2024-03-08T20:39:21.127289+0000","last_became_active":"2024-03-08T20:29:24.261222+0000","last_became_peered":"2024-03-08T20:29:24.261222+0000","last_unstale":"2024-03-08T20:39:21.127289+0000","last_undegraded":"2024-03-08T20:39:21.127289+0000","last_fullsized":"2024-03-08T20:39:21.127289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2514","last_scrub_stamp":"2024-03-08T20:39:21.127191+0000","last_deep_scrub":"27'2514","last_deep_scrub_stamp":"2024-03-08T20:39:21.127191+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.127191+0000","objects_scrubbed":1197,"log_size":2514,"log_dups_size":0,"ondisk_log_size":2514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:35.975656+0000","scrub_duration":5508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1197,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1197,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1259,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'488","reported_seq":533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.329279+0000","last_change":"2024-03-08T20:38:56.329318+0000","last_active":"2024-03-08T20:38:56.329279+0000","last_peered":"2024-03-08T20:38:56.329279+0000","last_clean":"2024-03-08T20:38:56.329279+0000","last_became_active":"2024-03-08T20:29:23.240199+0000","last_became_peered":"2024-03-08T20:29:23.240199+0000","last_unstale":"2024-03-08T20:38:56.329279+0000","last_undegraded":"2024-03-08T20:38:56.329279+0000","last_fullsized":"2024-03-08T20:38:56.329279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'488","last_scrub_stamp":"2024-03-08T20:38:56.329183+0000","last_deep_scrub":"27'488","last_deep_scrub_stamp":"2024-03-08T20:38:56.329183+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.329183+0000","objects_scrubbed":153,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:04:24.354098+0000","scrub_duration":216,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":655,"num_write_kb":13940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":151,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1479451,"num_omap_keys":2563,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'5314","reported_seq":5449,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.689423+0000","last_change":"2024-03-08T20:39:20.689477+0000","last_active":"2024-03-08T20:39:20.689423+0000","last_peered":"2024-03-08T20:39:20.689423+0000","last_clean":"2024-03-08T20:39:20.689423+0000","last_became_active":"2024-03-08T20:29:28.284895+0000","last_became_peered":"2024-03-08T20:29:28.284895+0000","last_unstale":"2024-03-08T20:39:20.689423+0000","last_undegraded":"2024-03-08T20:39:20.689423+0000","last_fullsized":"2024-03-08T20:39:20.689423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5314","last_scrub_stamp":"2024-03-08T20:39:20.689349+0000","last_deep_scrub":"27'5314","last_deep_scrub_stamp":"2024-03-08T20:39:20.689349+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.689349+0000","objects_scrubbed":2560,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:20.733937+0000","scrub_duration":11954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44220039,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":1,"num_read_kb":45,"num_write":7713,"num_write_kb":47181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'2528","reported_seq":2614,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.592837+0000","last_change":"2024-03-08T20:39:21.592866+0000","last_active":"2024-03-08T20:39:21.592837+0000","last_peered":"2024-03-08T20:39:21.592837+0000","last_clean":"2024-03-08T20:39:21.592837+0000","last_became_active":"2024-03-08T20:29:24.262503+0000","last_became_peered":"2024-03-08T20:29:24.262503+0000","last_unstale":"2024-03-08T20:39:21.592837+0000","last_undegraded":"2024-03-08T20:39:21.592837+0000","last_fullsized":"2024-03-08T20:39:21.592837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2528","last_scrub_stamp":"2024-03-08T20:39:21.592769+0000","last_deep_scrub":"27'2528","last_deep_scrub_stamp":"2024-03-08T20:39:21.592769+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.592769+0000","objects_scrubbed":1202,"log_size":2528,"log_dups_size":0,"ondisk_log_size":2528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:48.648531+0000","scrub_duration":4865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1202,"num_object_clones":0,"num_object_copies":2404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'642","reported_seq":687,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.540425+0000","last_change":"2024-03-08T20:38:54.540497+0000","last_active":"2024-03-08T20:38:54.540425+0000","last_peered":"2024-03-08T20:38:54.540425+0000","last_clean":"2024-03-08T20:38:54.540425+0000","last_became_active":"2024-03-08T20:29:23.235763+0000","last_became_peered":"2024-03-08T20:29:23.235763+0000","last_unstale":"2024-03-08T20:38:54.540425+0000","last_undegraded":"2024-03-08T20:38:54.540425+0000","last_fullsized":"2024-03-08T20:38:54.540425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'642","last_scrub_stamp":"2024-03-08T20:38:54.540334+0000","last_deep_scrub":"27'642","last_deep_scrub_stamp":"2024-03-08T20:38:54.540334+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.540334+0000","objects_scrubbed":160,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:05:03.998460+0000","scrub_duration":222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":806,"num_write_kb":14419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":159,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1925943,"num_omap_keys":3340,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'5194","reported_seq":5325,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.556794+0000","last_change":"2024-03-08T20:39:15.556852+0000","last_active":"2024-03-08T20:39:15.556794+0000","last_peered":"2024-03-08T20:39:15.556794+0000","last_clean":"2024-03-08T20:39:15.556794+0000","last_became_active":"2024-03-08T20:29:28.284260+0000","last_became_peered":"2024-03-08T20:29:28.284260+0000","last_unstale":"2024-03-08T20:39:15.556794+0000","last_undegraded":"2024-03-08T20:39:15.556794+0000","last_fullsized":"2024-03-08T20:39:15.556794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5194","last_scrub_stamp":"2024-03-08T20:39:15.556694+0000","last_deep_scrub":"27'5194","last_deep_scrub_stamp":"2024-03-08T20:39:15.556694+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.556694+0000","objects_scrubbed":2503,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:20.008164+0000","scrub_duration":8448,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35230304,"num_objects":2503,"num_object_clones":0,"num_object_copies":10012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7570,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'2326","reported_seq":2409,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:11.598864+0000","last_change":"2024-03-08T20:39:11.598914+0000","last_active":"2024-03-08T20:39:11.598864+0000","last_peered":"2024-03-08T20:39:11.598864+0000","last_clean":"2024-03-08T20:39:11.598864+0000","last_became_active":"2024-03-08T20:29:24.248604+0000","last_became_peered":"2024-03-08T20:29:24.248604+0000","last_unstale":"2024-03-08T20:39:11.598864+0000","last_undegraded":"2024-03-08T20:39:11.598864+0000","last_fullsized":"2024-03-08T20:39:11.598864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2326","last_scrub_stamp":"2024-03-08T20:39:11.598729+0000","last_deep_scrub":"27'2326","last_deep_scrub_stamp":"2024-03-08T20:39:11.598729+0000","last_clean_scrub_stamp":"2024-03-08T20:39:11.598729+0000","objects_scrubbed":1128,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.888448+0000","scrub_duration":8078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1128,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'580","reported_seq":624,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.000077+0000","last_change":"2024-03-08T20:39:00.000162+0000","last_active":"2024-03-08T20:39:00.000077+0000","last_peered":"2024-03-08T20:39:00.000077+0000","last_clean":"2024-03-08T20:39:00.000077+0000","last_became_active":"2024-03-08T20:29:23.246301+0000","last_became_peered":"2024-03-08T20:29:23.246301+0000","last_unstale":"2024-03-08T20:39:00.000077+0000","last_undegraded":"2024-03-08T20:39:00.000077+0000","last_fullsized":"2024-03-08T20:39:00.000077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'580","last_scrub_stamp":"2024-03-08T20:38:59.999962+0000","last_deep_scrub":"27'580","last_deep_scrub_stamp":"2024-03-08T20:38:59.999962+0000","last_clean_scrub_stamp":"2024-03-08T20:38:59.999962+0000","objects_scrubbed":136,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:03:16.690722+0000","scrub_duration":415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":724,"num_write_kb":9846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1363985,"num_omap_keys":2365,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'5312","reported_seq":5446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.966466+0000","last_change":"2024-03-08T20:39:01.966614+0000","last_active":"2024-03-08T20:39:01.966466+0000","last_peered":"2024-03-08T20:39:01.966466+0000","last_clean":"2024-03-08T20:39:01.966466+0000","last_became_active":"2024-03-08T20:29:28.306915+0000","last_became_peered":"2024-03-08T20:29:28.306915+0000","last_unstale":"2024-03-08T20:39:01.966466+0000","last_undegraded":"2024-03-08T20:39:01.966466+0000","last_fullsized":"2024-03-08T20:39:01.966466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5312","last_scrub_stamp":"2024-03-08T20:39:01.966346+0000","last_deep_scrub":"27'5312","last_deep_scrub_stamp":"2024-03-08T20:39:01.966346+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.966346+0000","objects_scrubbed":2598,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:01:27.714445+0000","scrub_duration":3877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46220075,"num_objects":2598,"num_object_clones":0,"num_object_copies":10392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2598,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7703,"num_write_kb":49338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'2398","reported_seq":2481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:03.666473+0000","last_change":"2024-03-08T20:39:03.666530+0000","last_active":"2024-03-08T20:39:03.666473+0000","last_peered":"2024-03-08T20:39:03.666473+0000","last_clean":"2024-03-08T20:39:03.666473+0000","last_became_active":"2024-03-08T20:29:24.248673+0000","last_became_peered":"2024-03-08T20:29:24.248673+0000","last_unstale":"2024-03-08T20:39:03.666473+0000","last_undegraded":"2024-03-08T20:39:03.666473+0000","last_fullsized":"2024-03-08T20:39:03.666473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2398","last_scrub_stamp":"2024-03-08T20:39:03.666385+0000","last_deep_scrub":"27'2398","last_deep_scrub_stamp":"2024-03-08T20:39:03.666385+0000","last_clean_scrub_stamp":"2024-03-08T20:39:03.666385+0000","objects_scrubbed":1157,"log_size":2398,"log_dups_size":0,"ondisk_log_size":2398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:31.949003+0000","scrub_duration":4527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1157,"num_object_clones":0,"num_object_copies":2314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'912","reported_seq":956,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.661818+0000","last_change":"2024-03-08T20:39:00.661923+0000","last_active":"2024-03-08T20:39:00.661818+0000","last_peered":"2024-03-08T20:39:00.661818+0000","last_clean":"2024-03-08T20:39:00.661818+0000","last_became_active":"2024-03-08T20:29:23.245231+0000","last_became_peered":"2024-03-08T20:29:23.245231+0000","last_unstale":"2024-03-08T20:39:00.661818+0000","last_undegraded":"2024-03-08T20:39:00.661818+0000","last_fullsized":"2024-03-08T20:39:00.661818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'912","last_scrub_stamp":"2024-03-08T20:39:00.661727+0000","last_deep_scrub":"27'912","last_deep_scrub_stamp":"2024-03-08T20:39:00.661727+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.661727+0000","objects_scrubbed":145,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:14:13.947259+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1058,"num_write_kb":5723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":144,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1196733,"num_omap_keys":2075,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'5117","reported_seq":5249,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.575356+0000","last_change":"2024-03-08T20:39:19.575403+0000","last_active":"2024-03-08T20:39:19.575356+0000","last_peered":"2024-03-08T20:39:19.575356+0000","last_clean":"2024-03-08T20:39:19.575356+0000","last_became_active":"2024-03-08T20:29:28.296569+0000","last_became_peered":"2024-03-08T20:29:28.296569+0000","last_unstale":"2024-03-08T20:39:19.575356+0000","last_undegraded":"2024-03-08T20:39:19.575356+0000","last_fullsized":"2024-03-08T20:39:19.575356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5117","last_scrub_stamp":"2024-03-08T20:39:19.575259+0000","last_deep_scrub":"27'5117","last_deep_scrub_stamp":"2024-03-08T20:39:19.575259+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.575259+0000","objects_scrubbed":2505,"log_size":5117,"log_dups_size":0,"ondisk_log_size":5117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:43:19.189929+0000","scrub_duration":4870,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44113028,"num_objects":2505,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7433,"num_write_kb":46631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2376","reported_seq":2459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:11.755747+0000","last_change":"2024-03-08T20:39:11.755841+0000","last_active":"2024-03-08T20:39:11.755747+0000","last_peered":"2024-03-08T20:39:11.755747+0000","last_clean":"2024-03-08T20:39:11.755747+0000","last_became_active":"2024-03-08T20:29:24.266377+0000","last_became_peered":"2024-03-08T20:29:24.266377+0000","last_unstale":"2024-03-08T20:39:11.755747+0000","last_undegraded":"2024-03-08T20:39:11.755747+0000","last_fullsized":"2024-03-08T20:39:11.755747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2376","last_scrub_stamp":"2024-03-08T20:39:11.755656+0000","last_deep_scrub":"27'2376","last_deep_scrub_stamp":"2024-03-08T20:39:11.755656+0000","last_clean_scrub_stamp":"2024-03-08T20:39:11.755656+0000","objects_scrubbed":1139,"log_size":2376,"log_dups_size":0,"ondisk_log_size":2376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:07.890029+0000","scrub_duration":8031,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'668","reported_seq":713,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.778958+0000","last_change":"2024-03-08T20:38:55.779011+0000","last_active":"2024-03-08T20:38:55.778958+0000","last_peered":"2024-03-08T20:38:55.778958+0000","last_clean":"2024-03-08T20:38:55.778958+0000","last_became_active":"2024-03-08T20:29:23.245143+0000","last_became_peered":"2024-03-08T20:29:23.245143+0000","last_unstale":"2024-03-08T20:38:55.778958+0000","last_undegraded":"2024-03-08T20:38:55.778958+0000","last_fullsized":"2024-03-08T20:38:55.778958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'668","last_scrub_stamp":"2024-03-08T20:38:55.778852+0000","last_deep_scrub":"27'668","last_deep_scrub_stamp":"2024-03-08T20:38:55.778852+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.778852+0000","objects_scrubbed":153,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:51:24.026071+0000","scrub_duration":144,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":820,"num_write_kb":17917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":152,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1288611,"num_omap_keys":2225,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5111","reported_seq":5240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:21.097598+0000","last_change":"2024-03-08T20:39:21.097654+0000","last_active":"2024-03-08T20:39:21.097598+0000","last_peered":"2024-03-08T20:39:21.097598+0000","last_clean":"2024-03-08T20:39:21.097598+0000","last_became_active":"2024-03-08T20:29:28.301941+0000","last_became_peered":"2024-03-08T20:29:28.301941+0000","last_unstale":"2024-03-08T20:39:21.097598+0000","last_undegraded":"2024-03-08T20:39:21.097598+0000","last_fullsized":"2024-03-08T20:39:21.097598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5111","last_scrub_stamp":"2024-03-08T20:39:21.097484+0000","last_deep_scrub":"27'5111","last_deep_scrub_stamp":"2024-03-08T20:39:21.097484+0000","last_clean_scrub_stamp":"2024-03-08T20:39:21.097484+0000","objects_scrubbed":2455,"log_size":5111,"log_dups_size":0,"ondisk_log_size":5111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:32.082754+0000","scrub_duration":7548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41008018,"num_objects":2455,"num_object_clones":0,"num_object_copies":9820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7426,"num_write_kb":44193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'2298","reported_seq":2378,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.206005+0000","last_change":"2024-03-08T20:39:13.206097+0000","last_active":"2024-03-08T20:39:13.206005+0000","last_peered":"2024-03-08T20:39:13.206005+0000","last_clean":"2024-03-08T20:39:13.206005+0000","last_became_active":"2024-03-08T20:29:24.248197+0000","last_became_peered":"2024-03-08T20:29:24.248197+0000","last_unstale":"2024-03-08T20:39:13.206005+0000","last_undegraded":"2024-03-08T20:39:13.206005+0000","last_fullsized":"2024-03-08T20:39:13.206005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2298","last_scrub_stamp":"2024-03-08T20:39:13.205911+0000","last_deep_scrub":"27'2298","last_deep_scrub_stamp":"2024-03-08T20:39:13.205911+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.205911+0000","objects_scrubbed":1092,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:09.340284+0000","scrub_duration":8931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1092,"num_object_clones":0,"num_object_copies":2184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1092,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'781","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:07.022893+0000","last_change":"2024-03-08T20:38:58.992398+0000","last_active":"2024-03-08T20:39:07.022893+0000","last_peered":"2024-03-08T20:39:07.022893+0000","last_clean":"2024-03-08T20:39:07.022893+0000","last_became_active":"2024-03-08T20:29:23.239318+0000","last_became_peered":"2024-03-08T20:29:23.239318+0000","last_unstale":"2024-03-08T20:39:07.022893+0000","last_undegraded":"2024-03-08T20:39:07.022893+0000","last_fullsized":"2024-03-08T20:39:07.022893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-03-08T20:38:58.992179+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-03-08T20:38:58.992179+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.992179+0000","objects_scrubbed":140,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:32:19.378066+0000","scrub_duration":424,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":140,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":140,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":924,"num_write_kb":30372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1185463,"num_omap_keys":2047,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5177","reported_seq":5309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.766077+0000","last_change":"2024-03-08T20:39:16.766152+0000","last_active":"2024-03-08T20:39:16.766077+0000","last_peered":"2024-03-08T20:39:16.766077+0000","last_clean":"2024-03-08T20:39:16.766077+0000","last_became_active":"2024-03-08T20:29:28.291731+0000","last_became_peered":"2024-03-08T20:29:28.291731+0000","last_unstale":"2024-03-08T20:39:16.766077+0000","last_undegraded":"2024-03-08T20:39:16.766077+0000","last_fullsized":"2024-03-08T20:39:16.766077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5177","last_scrub_stamp":"2024-03-08T20:39:16.765961+0000","last_deep_scrub":"27'5177","last_deep_scrub_stamp":"2024-03-08T20:39:16.765961+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.765961+0000","objects_scrubbed":2514,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:22:49.464651+0000","scrub_duration":7455,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48263172,"num_objects":2514,"num_object_clones":0,"num_object_copies":10056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7524,"num_write_kb":50726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'2395","reported_seq":2478,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.416252+0000","last_change":"2024-03-08T20:39:06.416313+0000","last_active":"2024-03-08T20:39:06.416252+0000","last_peered":"2024-03-08T20:39:06.416252+0000","last_clean":"2024-03-08T20:39:06.416252+0000","last_became_active":"2024-03-08T20:29:24.271083+0000","last_became_peered":"2024-03-08T20:29:24.271083+0000","last_unstale":"2024-03-08T20:39:06.416252+0000","last_undegraded":"2024-03-08T20:39:06.416252+0000","last_fullsized":"2024-03-08T20:39:06.416252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2395","last_scrub_stamp":"2024-03-08T20:39:06.416152+0000","last_deep_scrub":"27'2395","last_deep_scrub_stamp":"2024-03-08T20:39:06.416152+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.416152+0000","objects_scrubbed":1156,"log_size":2395,"log_dups_size":0,"ondisk_log_size":2395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:03:28.636154+0000","scrub_duration":5159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'755","reported_seq":799,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.252405+0000","last_change":"2024-03-08T20:38:57.252405+0000","last_active":"2024-03-08T20:38:57.252405+0000","last_peered":"2024-03-08T20:38:57.252405+0000","last_clean":"2024-03-08T20:38:57.252405+0000","last_became_active":"2024-03-08T20:29:23.242235+0000","last_became_peered":"2024-03-08T20:29:23.242235+0000","last_unstale":"2024-03-08T20:38:57.252405+0000","last_undegraded":"2024-03-08T20:38:57.252405+0000","last_fullsized":"2024-03-08T20:38:57.252405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'755","last_scrub_stamp":"2024-03-08T20:38:57.252261+0000","last_deep_scrub":"27'755","last_deep_scrub_stamp":"2024-03-08T20:38:57.252261+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.252261+0000","objects_scrubbed":132,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:08:25.534879+0000","scrub_duration":141,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":883,"num_write_kb":22364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":131,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1471544,"num_omap_keys":2538,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'5203","reported_seq":5344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.987642+0000","last_change":"2024-03-08T20:39:20.987673+0000","last_active":"2024-03-08T20:39:20.987642+0000","last_peered":"2024-03-08T20:39:20.987642+0000","last_clean":"2024-03-08T20:39:20.987642+0000","last_became_active":"2024-03-08T20:30:10.638969+0000","last_became_peered":"2024-03-08T20:30:10.638969+0000","last_unstale":"2024-03-08T20:39:20.987642+0000","last_undegraded":"2024-03-08T20:39:20.987642+0000","last_fullsized":"2024-03-08T20:39:20.987642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5203","last_scrub_stamp":"2024-03-08T20:39:20.987577+0000","last_deep_scrub":"27'5203","last_deep_scrub_stamp":"2024-03-08T20:39:20.987577+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.987577+0000","objects_scrubbed":2551,"log_size":5203,"log_dups_size":0,"ondisk_log_size":5203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:19:50.972860+0000","scrub_duration":9951,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67553724,"num_objects":2551,"num_object_clones":0,"num_object_copies":10204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2551,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7554,"num_write_kb":69689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'2341","reported_seq":2422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.305359+0000","last_change":"2024-03-08T20:39:09.305439+0000","last_active":"2024-03-08T20:39:09.305359+0000","last_peered":"2024-03-08T20:39:09.305359+0000","last_clean":"2024-03-08T20:39:09.305359+0000","last_became_active":"2024-03-08T20:29:24.258614+0000","last_became_peered":"2024-03-08T20:29:24.258614+0000","last_unstale":"2024-03-08T20:39:09.305359+0000","last_undegraded":"2024-03-08T20:39:09.305359+0000","last_fullsized":"2024-03-08T20:39:09.305359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:09.305271+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:09.305271+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.305271+0000","objects_scrubbed":1114,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:09.349859+0000","scrub_duration":6599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1114,"num_object_clones":0,"num_object_copies":2228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1196,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'554","reported_seq":598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.421844+0000","last_change":"2024-03-08T20:38:58.421844+0000","last_active":"2024-03-08T20:38:58.421844+0000","last_peered":"2024-03-08T20:38:58.421844+0000","last_clean":"2024-03-08T20:38:58.421844+0000","last_became_active":"2024-03-08T20:29:23.240898+0000","last_became_peered":"2024-03-08T20:29:23.240898+0000","last_unstale":"2024-03-08T20:38:58.421844+0000","last_undegraded":"2024-03-08T20:38:58.421844+0000","last_fullsized":"2024-03-08T20:38:58.421844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'554","last_scrub_stamp":"2024-03-08T20:38:58.421590+0000","last_deep_scrub":"27'554","last_deep_scrub_stamp":"2024-03-08T20:38:58.421590+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.421590+0000","objects_scrubbed":148,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:11.133214+0000","scrub_duration":170,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":148,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":709,"num_write_kb":26225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":148,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1435363,"num_omap_keys":2487,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'5124","reported_seq":5254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.021243+0000","last_change":"2024-03-08T20:39:20.021314+0000","last_active":"2024-03-08T20:39:20.021243+0000","last_peered":"2024-03-08T20:39:20.021243+0000","last_clean":"2024-03-08T20:39:20.021243+0000","last_became_active":"2024-03-08T20:29:28.278410+0000","last_became_peered":"2024-03-08T20:29:28.278410+0000","last_unstale":"2024-03-08T20:39:20.021243+0000","last_undegraded":"2024-03-08T20:39:20.021243+0000","last_fullsized":"2024-03-08T20:39:20.021243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5124","last_scrub_stamp":"2024-03-08T20:39:20.021142+0000","last_deep_scrub":"27'5124","last_deep_scrub_stamp":"2024-03-08T20:39:20.021142+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.021142+0000","objects_scrubbed":2464,"log_size":5124,"log_dups_size":0,"ondisk_log_size":5124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:41:15.834872+0000","scrub_duration":7366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42709658,"num_objects":2464,"num_object_clones":0,"num_object_copies":9856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2464,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7434,"num_write_kb":45384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'2416","reported_seq":2498,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:19.683638+0000","last_change":"2024-03-08T20:39:19.683732+0000","last_active":"2024-03-08T20:39:19.683638+0000","last_peered":"2024-03-08T20:39:19.683638+0000","last_clean":"2024-03-08T20:39:19.683638+0000","last_became_active":"2024-03-08T20:29:24.266227+0000","last_became_peered":"2024-03-08T20:29:24.266227+0000","last_unstale":"2024-03-08T20:39:19.683638+0000","last_undegraded":"2024-03-08T20:39:19.683638+0000","last_fullsized":"2024-03-08T20:39:19.683638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2416","last_scrub_stamp":"2024-03-08T20:39:19.683528+0000","last_deep_scrub":"27'2416","last_deep_scrub_stamp":"2024-03-08T20:39:19.683528+0000","last_clean_scrub_stamp":"2024-03-08T20:39:19.683528+0000","objects_scrubbed":1144,"log_size":2416,"log_dups_size":0,"ondisk_log_size":2416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:04:58.008885+0000","scrub_duration":8716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1144,"num_object_clones":0,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1144,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'1352","reported_seq":1395,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:57.774540+0000","last_change":"2024-03-08T20:38:57.774540+0000","last_active":"2024-03-08T20:38:57.774540+0000","last_peered":"2024-03-08T20:38:57.774540+0000","last_clean":"2024-03-08T20:38:57.774540+0000","last_became_active":"2024-03-08T20:29:23.240719+0000","last_became_peered":"2024-03-08T20:29:23.240719+0000","last_unstale":"2024-03-08T20:38:57.774540+0000","last_undegraded":"2024-03-08T20:38:57.774540+0000","last_fullsized":"2024-03-08T20:38:57.774540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1352","last_scrub_stamp":"2024-03-08T20:38:57.774390+0000","last_deep_scrub":"27'1352","last_deep_scrub_stamp":"2024-03-08T20:38:57.774390+0000","last_clean_scrub_stamp":"2024-03-08T20:38:57.774390+0000","objects_scrubbed":120,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:33.108781+0000","scrub_duration":191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1467,"num_write_kb":22124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":117,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":775690,"num_omap_keys":1342,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'5434","reported_seq":5571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.037935+0000","last_change":"2024-03-08T20:38:58.037984+0000","last_active":"2024-03-08T20:38:58.037935+0000","last_peered":"2024-03-08T20:38:58.037935+0000","last_clean":"2024-03-08T20:38:58.037935+0000","last_became_active":"2024-03-08T20:29:28.307816+0000","last_became_peered":"2024-03-08T20:29:28.307816+0000","last_unstale":"2024-03-08T20:38:58.037935+0000","last_undegraded":"2024-03-08T20:38:58.037935+0000","last_fullsized":"2024-03-08T20:38:58.037935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5434","last_scrub_stamp":"2024-03-08T20:38:58.037833+0000","last_deep_scrub":"27'5434","last_deep_scrub_stamp":"2024-03-08T20:38:58.037833+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.037833+0000","objects_scrubbed":2652,"log_size":5434,"log_dups_size":0,"ondisk_log_size":5434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:58:45.132851+0000","scrub_duration":2010,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58843545,"num_objects":2652,"num_object_clones":0,"num_object_copies":10608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2652,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7911,"num_write_kb":61460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'5083","reported_seq":5221,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:55.234658+0000","last_change":"2024-03-08T20:38:55.234696+0000","last_active":"2024-03-08T20:38:55.234658+0000","last_peered":"2024-03-08T20:38:55.234658+0000","last_clean":"2024-03-08T20:38:55.234658+0000","last_became_active":"2024-03-08T20:30:10.907231+0000","last_became_peered":"2024-03-08T20:30:10.907231+0000","last_unstale":"2024-03-08T20:38:55.234658+0000","last_undegraded":"2024-03-08T20:38:55.234658+0000","last_fullsized":"2024-03-08T20:38:55.234658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5083","last_scrub_stamp":"2024-03-08T20:38:55.234573+0000","last_deep_scrub":"27'5083","last_deep_scrub_stamp":"2024-03-08T20:38:55.234573+0000","last_clean_scrub_stamp":"2024-03-08T20:38:55.234573+0000","objects_scrubbed":2481,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:38:07.362857+0000","scrub_duration":1597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39423398,"num_objects":2481,"num_object_clones":0,"num_object_copies":9924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7370,"num_write_kb":42174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2384","reported_seq":2466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:54.674541+0000","last_change":"2024-03-08T20:38:54.674541+0000","last_active":"2024-03-08T20:38:54.674541+0000","last_peered":"2024-03-08T20:38:54.674541+0000","last_clean":"2024-03-08T20:38:54.674541+0000","last_became_active":"2024-03-08T20:29:24.242729+0000","last_became_peered":"2024-03-08T20:29:24.242729+0000","last_unstale":"2024-03-08T20:38:54.674541+0000","last_undegraded":"2024-03-08T20:38:54.674541+0000","last_fullsized":"2024-03-08T20:38:54.674541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2384","last_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_deep_scrub":"27'2384","last_deep_scrub_stamp":"2024-03-08T20:38:54.674332+0000","last_clean_scrub_stamp":"2024-03-08T20:38:54.674332+0000","objects_scrubbed":1145,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:49:50.764117+0000","scrub_duration":1469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1145,"num_object_clones":0,"num_object_copies":2290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1145,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'649","reported_seq":694,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.761369+0000","last_change":"2024-03-08T20:39:01.761369+0000","last_active":"2024-03-08T20:39:01.761369+0000","last_peered":"2024-03-08T20:39:01.761369+0000","last_clean":"2024-03-08T20:39:01.761369+0000","last_became_active":"2024-03-08T20:29:23.248507+0000","last_became_peered":"2024-03-08T20:29:23.248507+0000","last_unstale":"2024-03-08T20:39:01.761369+0000","last_undegraded":"2024-03-08T20:39:01.761369+0000","last_fullsized":"2024-03-08T20:39:01.761369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'649","last_scrub_stamp":"2024-03-08T20:39:01.761201+0000","last_deep_scrub":"27'649","last_deep_scrub_stamp":"2024-03-08T20:39:01.761201+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.761201+0000","objects_scrubbed":153,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:17.831692+0000","scrub_duration":458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":808,"num_write_kb":39430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":153,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2269944,"num_omap_keys":3912,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5060","reported_seq":5192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.592728+0000","last_change":"2024-03-08T20:39:18.592810+0000","last_active":"2024-03-08T20:39:18.592728+0000","last_peered":"2024-03-08T20:39:18.592728+0000","last_clean":"2024-03-08T20:39:18.592728+0000","last_became_active":"2024-03-08T20:29:28.295186+0000","last_became_peered":"2024-03-08T20:29:28.295186+0000","last_unstale":"2024-03-08T20:39:18.592728+0000","last_undegraded":"2024-03-08T20:39:18.592728+0000","last_fullsized":"2024-03-08T20:39:18.592728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5060","last_scrub_stamp":"2024-03-08T20:39:18.592612+0000","last_deep_scrub":"27'5060","last_deep_scrub_stamp":"2024-03-08T20:39:18.592612+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.592612+0000","objects_scrubbed":2482,"log_size":5060,"log_dups_size":0,"ondisk_log_size":5060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:04:41.827454+0000","scrub_duration":8855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36397223,"num_objects":2482,"num_object_clones":0,"num_object_copies":9928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2482,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7366,"num_write_kb":39077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'2441","reported_seq":2524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.633851+0000","last_change":"2024-03-08T20:39:13.633937+0000","last_active":"2024-03-08T20:39:13.633851+0000","last_peered":"2024-03-08T20:39:13.633851+0000","last_clean":"2024-03-08T20:39:13.633851+0000","last_became_active":"2024-03-08T20:29:24.245179+0000","last_became_peered":"2024-03-08T20:29:24.245179+0000","last_unstale":"2024-03-08T20:39:13.633851+0000","last_undegraded":"2024-03-08T20:39:13.633851+0000","last_fullsized":"2024-03-08T20:39:13.633851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2441","last_scrub_stamp":"2024-03-08T20:39:13.633745+0000","last_deep_scrub":"27'2441","last_deep_scrub_stamp":"2024-03-08T20:39:13.633745+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.633745+0000","objects_scrubbed":1166,"log_size":2441,"log_dups_size":0,"ondisk_log_size":2441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:40.689507+0000","scrub_duration":6270,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1166,"num_object_clones":0,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'797","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:26.744350+0000","last_change":"2024-03-08T20:39:03.616732+0000","last_active":"2024-03-08T20:39:26.744350+0000","last_peered":"2024-03-08T20:39:26.744350+0000","last_clean":"2024-03-08T20:39:26.744350+0000","last_became_active":"2024-03-08T20:29:23.241984+0000","last_became_peered":"2024-03-08T20:29:23.241984+0000","last_unstale":"2024-03-08T20:39:26.744350+0000","last_undegraded":"2024-03-08T20:39:26.744350+0000","last_fullsized":"2024-03-08T20:39:26.744350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'771","last_scrub_stamp":"2024-03-08T20:39:03.616527+0000","last_deep_scrub":"27'771","last_deep_scrub_stamp":"2024-03-08T20:39:03.616527+0000","last_clean_scrub_stamp":"2024-03-08T20:39:03.616527+0000","objects_scrubbed":136,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:23:46.970355+0000","scrub_duration":452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5429383,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":934,"num_write_kb":15162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1345872,"num_omap_keys":2324,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'676","reported_seq":720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.026490+0000","last_change":"2024-03-08T20:39:01.026490+0000","last_active":"2024-03-08T20:39:01.026490+0000","last_peered":"2024-03-08T20:39:01.026490+0000","last_clean":"2024-03-08T20:39:01.026490+0000","last_became_active":"2024-03-08T20:29:23.246726+0000","last_became_peered":"2024-03-08T20:29:23.246726+0000","last_unstale":"2024-03-08T20:39:01.026490+0000","last_undegraded":"2024-03-08T20:39:01.026490+0000","last_fullsized":"2024-03-08T20:39:01.026490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'676","last_scrub_stamp":"2024-03-08T20:39:01.024707+0000","last_deep_scrub":"27'676","last_deep_scrub_stamp":"2024-03-08T20:39:01.024707+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.024707+0000","objects_scrubbed":138,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:09:12.452565+0000","scrub_duration":487,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":816,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1479493,"num_omap_keys":2563,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2322","reported_seq":2403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.632207+0000","last_change":"2024-03-08T20:39:02.632282+0000","last_active":"2024-03-08T20:39:02.632207+0000","last_peered":"2024-03-08T20:39:02.632207+0000","last_clean":"2024-03-08T20:39:02.632207+0000","last_became_active":"2024-03-08T20:29:24.242332+0000","last_became_peered":"2024-03-08T20:29:24.242332+0000","last_unstale":"2024-03-08T20:39:02.632207+0000","last_undegraded":"2024-03-08T20:39:02.632207+0000","last_fullsized":"2024-03-08T20:39:02.632207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2322","last_scrub_stamp":"2024-03-08T20:39:02.632113+0000","last_deep_scrub":"27'2322","last_deep_scrub_stamp":"2024-03-08T20:39:02.632113+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.632113+0000","objects_scrubbed":1112,"log_size":2322,"log_dups_size":0,"ondisk_log_size":2322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:52:51.800453+0000","scrub_duration":3981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5259","reported_seq":5393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.363458+0000","last_change":"2024-03-08T20:39:06.363568+0000","last_active":"2024-03-08T20:39:06.363458+0000","last_peered":"2024-03-08T20:39:06.363458+0000","last_clean":"2024-03-08T20:39:06.363458+0000","last_became_active":"2024-03-08T20:29:28.277480+0000","last_became_peered":"2024-03-08T20:29:28.277480+0000","last_unstale":"2024-03-08T20:39:06.363458+0000","last_undegraded":"2024-03-08T20:39:06.363458+0000","last_fullsized":"2024-03-08T20:39:06.363458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5259","last_scrub_stamp":"2024-03-08T20:39:06.363366+0000","last_deep_scrub":"27'5259","last_deep_scrub_stamp":"2024-03-08T20:39:06.363366+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.363366+0000","objects_scrubbed":2588,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:03:23.054126+0000","scrub_duration":6021,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38192806,"num_objects":2588,"num_object_clones":0,"num_object_copies":10352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2588,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":40727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'529","reported_seq":573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:04.836550+0000","last_change":"2024-03-08T20:39:04.836550+0000","last_active":"2024-03-08T20:39:04.836550+0000","last_peered":"2024-03-08T20:39:04.836550+0000","last_clean":"2024-03-08T20:39:04.836550+0000","last_became_active":"2024-03-08T20:29:23.250438+0000","last_became_peered":"2024-03-08T20:29:23.250438+0000","last_unstale":"2024-03-08T20:39:04.836550+0000","last_undegraded":"2024-03-08T20:39:04.836550+0000","last_fullsized":"2024-03-08T20:39:04.836550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'529","last_scrub_stamp":"2024-03-08T20:39:04.832928+0000","last_deep_scrub":"27'529","last_deep_scrub_stamp":"2024-03-08T20:39:04.832928+0000","last_clean_scrub_stamp":"2024-03-08T20:39:04.832928+0000","objects_scrubbed":128,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:48:04.877516+0000","scrub_duration":630,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":660,"num_write_kb":18045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":126,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1453373,"num_omap_keys":2511,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'2406","reported_seq":2489,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.228406+0000","last_change":"2024-03-08T20:39:01.228519+0000","last_active":"2024-03-08T20:39:01.228406+0000","last_peered":"2024-03-08T20:39:01.228406+0000","last_clean":"2024-03-08T20:39:01.228406+0000","last_became_active":"2024-03-08T20:29:24.242207+0000","last_became_peered":"2024-03-08T20:29:24.242207+0000","last_unstale":"2024-03-08T20:39:01.228406+0000","last_undegraded":"2024-03-08T20:39:01.228406+0000","last_fullsized":"2024-03-08T20:39:01.228406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2406","last_scrub_stamp":"2024-03-08T20:39:01.228306+0000","last_deep_scrub":"27'2406","last_deep_scrub_stamp":"2024-03-08T20:39:01.228306+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.228306+0000","objects_scrubbed":1170,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:47:03.529251+0000","scrub_duration":3115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'5236","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:20.751630+0000","last_change":"2024-03-08T20:39:20.751851+0000","last_active":"2024-03-08T20:39:20.751630+0000","last_peered":"2024-03-08T20:39:20.751630+0000","last_clean":"2024-03-08T20:39:20.751630+0000","last_became_active":"2024-03-08T20:29:28.277460+0000","last_became_peered":"2024-03-08T20:29:28.277460+0000","last_unstale":"2024-03-08T20:39:20.751630+0000","last_undegraded":"2024-03-08T20:39:20.751630+0000","last_fullsized":"2024-03-08T20:39:20.751630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5236","last_scrub_stamp":"2024-03-08T20:39:20.751470+0000","last_deep_scrub":"27'5236","last_deep_scrub_stamp":"2024-03-08T20:39:20.751470+0000","last_clean_scrub_stamp":"2024-03-08T20:39:20.751470+0000","objects_scrubbed":2560,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:40:53.766097+0000","scrub_duration":7094,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942794,"num_objects":2560,"num_object_clones":0,"num_object_copies":10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7603,"num_write_kb":58989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'2377","reported_seq":2460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.130179+0000","last_change":"2024-03-08T20:39:13.130260+0000","last_active":"2024-03-08T20:39:13.130179+0000","last_peered":"2024-03-08T20:39:13.130179+0000","last_clean":"2024-03-08T20:39:13.130179+0000","last_became_active":"2024-03-08T20:29:24.251851+0000","last_became_peered":"2024-03-08T20:29:24.251851+0000","last_unstale":"2024-03-08T20:39:13.130179+0000","last_undegraded":"2024-03-08T20:39:13.130179+0000","last_fullsized":"2024-03-08T20:39:13.130179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2377","last_scrub_stamp":"2024-03-08T20:39:13.130083+0000","last_deep_scrub":"27'2377","last_deep_scrub_stamp":"2024-03-08T20:39:13.130083+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.130083+0000","objects_scrubbed":1141,"log_size":2377,"log_dups_size":0,"ondisk_log_size":2377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:01:38.878182+0000","scrub_duration":8592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1141,"num_object_clones":0,"num_object_copies":2282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1141,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'2484","reported_seq":2568,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:01.142085+0000","last_change":"2024-03-08T20:39:01.142181+0000","last_active":"2024-03-08T20:39:01.142085+0000","last_peered":"2024-03-08T20:39:01.142085+0000","last_clean":"2024-03-08T20:39:01.142085+0000","last_became_active":"2024-03-08T20:29:24.252203+0000","last_became_peered":"2024-03-08T20:29:24.252203+0000","last_unstale":"2024-03-08T20:39:01.142085+0000","last_undegraded":"2024-03-08T20:39:01.142085+0000","last_fullsized":"2024-03-08T20:39:01.142085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2484","last_scrub_stamp":"2024-03-08T20:39:01.141975+0000","last_deep_scrub":"27'2484","last_deep_scrub_stamp":"2024-03-08T20:39:01.141975+0000","last_clean_scrub_stamp":"2024-03-08T20:39:01.141975+0000","objects_scrubbed":1195,"log_size":2484,"log_dups_size":0,"ondisk_log_size":2484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T20:59:10.039200+0000","scrub_duration":2861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1195,"num_object_clones":0,"num_object_copies":2390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1195,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'2339","reported_seq":2421,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.485292+0000","last_change":"2024-03-08T20:39:16.485394+0000","last_active":"2024-03-08T20:39:16.485292+0000","last_peered":"2024-03-08T20:39:16.485292+0000","last_clean":"2024-03-08T20:39:16.485292+0000","last_became_active":"2024-03-08T20:29:24.246779+0000","last_became_peered":"2024-03-08T20:29:24.246779+0000","last_unstale":"2024-03-08T20:39:16.485292+0000","last_undegraded":"2024-03-08T20:39:16.485292+0000","last_fullsized":"2024-03-08T20:39:16.485292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2339","last_scrub_stamp":"2024-03-08T20:39:16.482809+0000","last_deep_scrub":"27'2339","last_deep_scrub_stamp":"2024-03-08T20:39:16.482809+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.482809+0000","objects_scrubbed":1119,"log_size":2339,"log_dups_size":0,"ondisk_log_size":2339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:20.934279+0000","scrub_duration":11193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1119,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1119,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'2464","reported_seq":2548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:08.872931+0000","last_change":"2024-03-08T20:39:08.873024+0000","last_active":"2024-03-08T20:39:08.872931+0000","last_peered":"2024-03-08T20:39:08.872931+0000","last_clean":"2024-03-08T20:39:08.872931+0000","last_became_active":"2024-03-08T20:29:24.248784+0000","last_became_peered":"2024-03-08T20:29:24.248784+0000","last_unstale":"2024-03-08T20:39:08.872931+0000","last_undegraded":"2024-03-08T20:39:08.872931+0000","last_fullsized":"2024-03-08T20:39:08.872931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2464","last_scrub_stamp":"2024-03-08T20:39:08.872843+0000","last_deep_scrub":"27'2464","last_deep_scrub_stamp":"2024-03-08T20:39:08.872843+0000","last_clean_scrub_stamp":"2024-03-08T20:39:08.872843+0000","objects_scrubbed":1172,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:05:52.475196+0000","scrub_duration":7126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1172,"num_object_clones":0,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2369","reported_seq":2452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.993697+0000","last_change":"2024-03-08T20:38:58.993783+0000","last_active":"2024-03-08T20:38:58.993697+0000","last_peered":"2024-03-08T20:38:58.993697+0000","last_clean":"2024-03-08T20:38:58.993697+0000","last_became_active":"2024-03-08T20:29:24.251691+0000","last_became_peered":"2024-03-08T20:29:24.251691+0000","last_unstale":"2024-03-08T20:38:58.993697+0000","last_undegraded":"2024-03-08T20:38:58.993697+0000","last_fullsized":"2024-03-08T20:38:58.993697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2369","last_scrub_stamp":"2024-03-08T20:38:58.993603+0000","last_deep_scrub":"27'2369","last_deep_scrub_stamp":"2024-03-08T20:38:58.993603+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.993603+0000","objects_scrubbed":1139,"log_size":2369,"log_dups_size":0,"ondisk_log_size":2369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:14:22.406493+0000","scrub_duration":1940,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'2341","reported_seq":2424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.827207+0000","last_change":"2024-03-08T20:39:10.827280+0000","last_active":"2024-03-08T20:39:10.827207+0000","last_peered":"2024-03-08T20:39:10.827207+0000","last_clean":"2024-03-08T20:39:10.827207+0000","last_became_active":"2024-03-08T20:29:24.247220+0000","last_became_peered":"2024-03-08T20:29:24.247220+0000","last_unstale":"2024-03-08T20:39:10.827207+0000","last_undegraded":"2024-03-08T20:39:10.827207+0000","last_fullsized":"2024-03-08T20:39:10.827207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:10.827096+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:10.827096+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.827096+0000","objects_scrubbed":1137,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:47.587369+0000","scrub_duration":6723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'2511","reported_seq":2596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.440237+0000","last_change":"2024-03-08T20:39:17.440333+0000","last_active":"2024-03-08T20:39:17.440237+0000","last_peered":"2024-03-08T20:39:17.440237+0000","last_clean":"2024-03-08T20:39:17.440237+0000","last_became_active":"2024-03-08T20:29:24.262096+0000","last_became_peered":"2024-03-08T20:29:24.262096+0000","last_unstale":"2024-03-08T20:39:17.440237+0000","last_undegraded":"2024-03-08T20:39:17.440237+0000","last_fullsized":"2024-03-08T20:39:17.440237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-03-08T20:39:17.440114+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-03-08T20:39:17.440114+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.440114+0000","objects_scrubbed":1191,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:24:00.793943+0000","scrub_duration":9754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1191,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1191,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'2430","reported_seq":2514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.511249+0000","last_change":"2024-03-08T20:39:16.511292+0000","last_active":"2024-03-08T20:39:16.511249+0000","last_peered":"2024-03-08T20:39:16.511249+0000","last_clean":"2024-03-08T20:39:16.511249+0000","last_became_active":"2024-03-08T20:29:24.251872+0000","last_became_peered":"2024-03-08T20:29:24.251872+0000","last_unstale":"2024-03-08T20:39:16.511249+0000","last_undegraded":"2024-03-08T20:39:16.511249+0000","last_fullsized":"2024-03-08T20:39:16.511249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2430","last_scrub_stamp":"2024-03-08T20:39:16.511148+0000","last_deep_scrub":"27'2430","last_deep_scrub_stamp":"2024-03-08T20:39:16.511148+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.511148+0000","objects_scrubbed":1150,"log_size":2430,"log_dups_size":0,"ondisk_log_size":2430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":7,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:47:43.506755+0000","scrub_duration":6908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1150,"num_object_clones":0,"num_object_copies":2300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'2390","reported_seq":2473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.897689+0000","last_change":"2024-03-08T20:39:16.897774+0000","last_active":"2024-03-08T20:39:16.897689+0000","last_peered":"2024-03-08T20:39:16.897689+0000","last_clean":"2024-03-08T20:39:16.897689+0000","last_became_active":"2024-03-08T20:29:24.251028+0000","last_became_peered":"2024-03-08T20:29:24.251028+0000","last_unstale":"2024-03-08T20:39:16.897689+0000","last_undegraded":"2024-03-08T20:39:16.897689+0000","last_fullsized":"2024-03-08T20:39:16.897689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2390","last_scrub_stamp":"2024-03-08T20:39:16.897579+0000","last_deep_scrub":"27'2390","last_deep_scrub_stamp":"2024-03-08T20:39:16.897579+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.897579+0000","objects_scrubbed":1142,"log_size":2390,"log_dups_size":0,"ondisk_log_size":2390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:53:05.786116+0000","scrub_duration":10494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1142,"num_object_clones":0,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'2392","reported_seq":2475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:17.699530+0000","last_change":"2024-03-08T20:39:17.699605+0000","last_active":"2024-03-08T20:39:17.699530+0000","last_peered":"2024-03-08T20:39:17.699530+0000","last_clean":"2024-03-08T20:39:17.699530+0000","last_became_active":"2024-03-08T20:29:24.251584+0000","last_became_peered":"2024-03-08T20:29:24.251584+0000","last_unstale":"2024-03-08T20:39:17.699530+0000","last_undegraded":"2024-03-08T20:39:17.699530+0000","last_fullsized":"2024-03-08T20:39:17.699530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2392","last_scrub_stamp":"2024-03-08T20:39:17.699427+0000","last_deep_scrub":"27'2392","last_deep_scrub_stamp":"2024-03-08T20:39:17.699427+0000","last_clean_scrub_stamp":"2024-03-08T20:39:17.699427+0000","objects_scrubbed":1137,"log_size":2392,"log_dups_size":0,"ondisk_log_size":2392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":10,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:58.184224+0000","scrub_duration":9244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1137,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1137,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'2419","reported_seq":2503,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.873997+0000","last_change":"2024-03-08T20:39:13.874102+0000","last_active":"2024-03-08T20:39:13.873997+0000","last_peered":"2024-03-08T20:39:13.873997+0000","last_clean":"2024-03-08T20:39:13.873997+0000","last_became_active":"2024-03-08T20:29:24.245685+0000","last_became_peered":"2024-03-08T20:29:24.245685+0000","last_unstale":"2024-03-08T20:39:13.873997+0000","last_undegraded":"2024-03-08T20:39:13.873997+0000","last_fullsized":"2024-03-08T20:39:13.873997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2419","last_scrub_stamp":"2024-03-08T20:39:13.873127+0000","last_deep_scrub":"27'2419","last_deep_scrub_stamp":"2024-03-08T20:39:13.873127+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.873127+0000","objects_scrubbed":1171,"log_size":2419,"log_dups_size":0,"ondisk_log_size":2419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:59:10.007500+0000","scrub_duration":10591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1171,"num_object_clones":0,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'2433","reported_seq":2516,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:13.850340+0000","last_change":"2024-03-08T20:39:13.850439+0000","last_active":"2024-03-08T20:39:13.850340+0000","last_peered":"2024-03-08T20:39:13.850340+0000","last_clean":"2024-03-08T20:39:13.850340+0000","last_became_active":"2024-03-08T20:29:24.266383+0000","last_became_peered":"2024-03-08T20:29:24.266383+0000","last_unstale":"2024-03-08T20:39:13.850340+0000","last_undegraded":"2024-03-08T20:39:13.850340+0000","last_fullsized":"2024-03-08T20:39:13.850340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2433","last_scrub_stamp":"2024-03-08T20:39:13.850223+0000","last_deep_scrub":"27'2433","last_deep_scrub_stamp":"2024-03-08T20:39:13.850223+0000","last_clean_scrub_stamp":"2024-03-08T20:39:13.850223+0000","objects_scrubbed":1146,"log_size":2433,"log_dups_size":0,"ondisk_log_size":2433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:53:50.610497+0000","scrub_duration":8992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1146,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1146,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2415","reported_seq":2499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:14.164723+0000","last_change":"2024-03-08T20:39:14.164777+0000","last_active":"2024-03-08T20:39:14.164723+0000","last_peered":"2024-03-08T20:39:14.164723+0000","last_clean":"2024-03-08T20:39:14.164723+0000","last_became_active":"2024-03-08T20:29:24.252410+0000","last_became_peered":"2024-03-08T20:29:24.252410+0000","last_unstale":"2024-03-08T20:39:14.164723+0000","last_undegraded":"2024-03-08T20:39:14.164723+0000","last_fullsized":"2024-03-08T20:39:14.164723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2415","last_scrub_stamp":"2024-03-08T20:39:14.164624+0000","last_deep_scrub":"27'2415","last_deep_scrub_stamp":"2024-03-08T20:39:14.164624+0000","last_clean_scrub_stamp":"2024-03-08T20:39:14.164624+0000","objects_scrubbed":1154,"log_size":2415,"log_dups_size":0,"ondisk_log_size":2415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:12.230189+0000","scrub_duration":8616,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1154,"num_object_clones":0,"num_object_copies":2308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1154,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2437","reported_seq":2521,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.698813+0000","last_change":"2024-03-08T20:39:10.698988+0000","last_active":"2024-03-08T20:39:10.698813+0000","last_peered":"2024-03-08T20:39:10.698813+0000","last_clean":"2024-03-08T20:39:10.698813+0000","last_became_active":"2024-03-08T20:29:24.264885+0000","last_became_peered":"2024-03-08T20:29:24.264885+0000","last_unstale":"2024-03-08T20:39:10.698813+0000","last_undegraded":"2024-03-08T20:39:10.698813+0000","last_fullsized":"2024-03-08T20:39:10.698813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2437","last_scrub_stamp":"2024-03-08T20:39:10.698719+0000","last_deep_scrub":"27'2437","last_deep_scrub_stamp":"2024-03-08T20:39:10.698719+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.698719+0000","objects_scrubbed":1170,"log_size":2437,"log_dups_size":0,"ondisk_log_size":2437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:36:44.098676+0000","scrub_duration":7472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1170,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1170,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'2341","reported_seq":2422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.727996+0000","last_change":"2024-03-08T20:39:02.728061+0000","last_active":"2024-03-08T20:39:02.727996+0000","last_peered":"2024-03-08T20:39:02.727996+0000","last_clean":"2024-03-08T20:39:02.727996+0000","last_became_active":"2024-03-08T20:29:24.253357+0000","last_became_peered":"2024-03-08T20:29:24.253357+0000","last_unstale":"2024-03-08T20:39:02.727996+0000","last_undegraded":"2024-03-08T20:39:02.727996+0000","last_fullsized":"2024-03-08T20:39:02.727996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2341","last_scrub_stamp":"2024-03-08T20:39:02.727924+0000","last_deep_scrub":"27'2341","last_deep_scrub_stamp":"2024-03-08T20:39:02.727924+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.727924+0000","objects_scrubbed":1122,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:02:38.062315+0000","scrub_duration":3420,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1122,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1212,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2462","reported_seq":2532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:09.537539+0000","last_change":"2024-03-08T20:39:09.537632+0000","last_active":"2024-03-08T20:39:09.537539+0000","last_peered":"2024-03-08T20:39:09.537539+0000","last_clean":"2024-03-08T20:39:09.537539+0000","last_became_active":"2024-03-08T20:30:10.906083+0000","last_became_peered":"2024-03-08T20:30:10.906083+0000","last_unstale":"2024-03-08T20:39:09.537539+0000","last_undegraded":"2024-03-08T20:39:09.537539+0000","last_fullsized":"2024-03-08T20:39:09.537539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2462","last_scrub_stamp":"2024-03-08T20:39:09.537452+0000","last_deep_scrub":"27'2462","last_deep_scrub_stamp":"2024-03-08T20:39:09.537452+0000","last_clean_scrub_stamp":"2024-03-08T20:39:09.537452+0000","objects_scrubbed":1194,"log_size":2462,"log_dups_size":0,"ondisk_log_size":2462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:54:16.287873+0000","scrub_duration":7186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1194,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"27'2335","reported_seq":2402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.972763+0000","last_change":"2024-03-08T20:39:05.972854+0000","last_active":"2024-03-08T20:39:05.972763+0000","last_peered":"2024-03-08T20:39:05.972763+0000","last_clean":"2024-03-08T20:39:05.972763+0000","last_became_active":"2024-03-08T20:30:10.631459+0000","last_became_peered":"2024-03-08T20:30:10.631459+0000","last_unstale":"2024-03-08T20:39:05.972763+0000","last_undegraded":"2024-03-08T20:39:05.972763+0000","last_fullsized":"2024-03-08T20:39:05.972763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2335","last_scrub_stamp":"2024-03-08T20:39:05.972675+0000","last_deep_scrub":"27'2335","last_deep_scrub_stamp":"2024-03-08T20:39:05.972675+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.972675+0000","objects_scrubbed":1117,"log_size":2335,"log_dups_size":0,"ondisk_log_size":2335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:08:16.175071+0000","scrub_duration":4633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"27'2464","reported_seq":2549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:12.611195+0000","last_change":"2024-03-08T20:39:12.611272+0000","last_active":"2024-03-08T20:39:12.611195+0000","last_peered":"2024-03-08T20:39:12.611195+0000","last_clean":"2024-03-08T20:39:12.611195+0000","last_became_active":"2024-03-08T20:29:24.249386+0000","last_became_peered":"2024-03-08T20:29:24.249386+0000","last_unstale":"2024-03-08T20:39:12.611195+0000","last_undegraded":"2024-03-08T20:39:12.611195+0000","last_fullsized":"2024-03-08T20:39:12.611195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2464","last_scrub_stamp":"2024-03-08T20:39:12.611095+0000","last_deep_scrub":"27'2464","last_deep_scrub_stamp":"2024-03-08T20:39:12.611095+0000","last_clean_scrub_stamp":"2024-03-08T20:39:12.611095+0000","objects_scrubbed":1186,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":8,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:44:09.942230+0000","scrub_duration":7417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1186,"num_object_clones":0,"num_object_copies":2372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2318","reported_seq":2399,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:00.246652+0000","last_change":"2024-03-08T20:39:00.246742+0000","last_active":"2024-03-08T20:39:00.246652+0000","last_peered":"2024-03-08T20:39:00.246652+0000","last_clean":"2024-03-08T20:39:00.246652+0000","last_became_active":"2024-03-08T20:29:24.238309+0000","last_became_peered":"2024-03-08T20:29:24.238309+0000","last_unstale":"2024-03-08T20:39:00.246652+0000","last_undegraded":"2024-03-08T20:39:00.246652+0000","last_fullsized":"2024-03-08T20:39:00.246652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2318","last_scrub_stamp":"2024-03-08T20:39:00.246558+0000","last_deep_scrub":"27'2318","last_deep_scrub_stamp":"2024-03-08T20:39:00.246558+0000","last_clean_scrub_stamp":"2024-03-08T20:39:00.246558+0000","objects_scrubbed":1121,"log_size":2318,"log_dups_size":0,"ondisk_log_size":2318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:58:47.341576+0000","scrub_duration":2641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1121,"num_object_clones":0,"num_object_copies":2242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'2348","reported_seq":2430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.470330+0000","last_change":"2024-03-08T20:38:56.470330+0000","last_active":"2024-03-08T20:38:56.470330+0000","last_peered":"2024-03-08T20:38:56.470330+0000","last_clean":"2024-03-08T20:38:56.470330+0000","last_became_active":"2024-03-08T20:29:24.258446+0000","last_became_peered":"2024-03-08T20:29:24.258446+0000","last_unstale":"2024-03-08T20:38:56.470330+0000","last_undegraded":"2024-03-08T20:38:56.470330+0000","last_fullsized":"2024-03-08T20:38:56.470330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2348","last_scrub_stamp":"2024-03-08T20:38:56.470121+0000","last_deep_scrub":"27'2348","last_deep_scrub_stamp":"2024-03-08T20:38:56.470121+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.470121+0000","objects_scrubbed":1138,"log_size":2348,"log_dups_size":0,"ondisk_log_size":2348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:03:18.690122+0000","scrub_duration":1493,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1138,"num_object_clones":0,"num_object_copies":2276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'2269","reported_seq":2350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:02.156009+0000","last_change":"2024-03-08T20:39:02.156056+0000","last_active":"2024-03-08T20:39:02.156009+0000","last_peered":"2024-03-08T20:39:02.156009+0000","last_clean":"2024-03-08T20:39:02.156009+0000","last_became_active":"2024-03-08T20:29:24.255978+0000","last_became_peered":"2024-03-08T20:29:24.255978+0000","last_unstale":"2024-03-08T20:39:02.156009+0000","last_undegraded":"2024-03-08T20:39:02.156009+0000","last_fullsized":"2024-03-08T20:39:02.156009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2269","last_scrub_stamp":"2024-03-08T20:39:02.155906+0000","last_deep_scrub":"27'2269","last_deep_scrub_stamp":"2024-03-08T20:39:02.155906+0000","last_clean_scrub_stamp":"2024-03-08T20:39:02.155906+0000","objects_scrubbed":1102,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":4,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:14.867530+0000","scrub_duration":3018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1102,"num_object_clones":0,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'2378","reported_seq":2459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.912968+0000","last_change":"2024-03-08T20:39:18.913060+0000","last_active":"2024-03-08T20:39:18.912968+0000","last_peered":"2024-03-08T20:39:18.912968+0000","last_clean":"2024-03-08T20:39:18.912968+0000","last_became_active":"2024-03-08T20:29:24.263649+0000","last_became_peered":"2024-03-08T20:29:24.263649+0000","last_unstale":"2024-03-08T20:39:18.912968+0000","last_undegraded":"2024-03-08T20:39:18.912968+0000","last_fullsized":"2024-03-08T20:39:18.912968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2378","last_scrub_stamp":"2024-03-08T20:39:18.912864+0000","last_deep_scrub":"27'2378","last_deep_scrub_stamp":"2024-03-08T20:39:18.912864+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.912864+0000","objects_scrubbed":1117,"log_size":2378,"log_dups_size":0,"ondisk_log_size":2378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":11,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:06:02.515217+0000","scrub_duration":10250,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1117,"num_object_clones":0,"num_object_copies":2234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'2384","reported_seq":2466,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.762093+0000","last_change":"2024-03-08T20:39:06.762177+0000","last_active":"2024-03-08T20:39:06.762093+0000","last_peered":"2024-03-08T20:39:06.762093+0000","last_clean":"2024-03-08T20:39:06.762093+0000","last_became_active":"2024-03-08T20:29:24.251348+0000","last_became_peered":"2024-03-08T20:29:24.251348+0000","last_unstale":"2024-03-08T20:39:06.762093+0000","last_undegraded":"2024-03-08T20:39:06.762093+0000","last_fullsized":"2024-03-08T20:39:06.762093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2384","last_scrub_stamp":"2024-03-08T20:39:06.761989+0000","last_deep_scrub":"27'2384","last_deep_scrub_stamp":"2024-03-08T20:39:06.761989+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.761989+0000","objects_scrubbed":1139,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":5,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:17:44.467334+0000","scrub_duration":4226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1139,"num_object_clones":0,"num_object_copies":2278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1139,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'2479","reported_seq":2563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:10.724335+0000","last_change":"2024-03-08T20:39:10.724443+0000","last_active":"2024-03-08T20:39:10.724335+0000","last_peered":"2024-03-08T20:39:10.724335+0000","last_clean":"2024-03-08T20:39:10.724335+0000","last_became_active":"2024-03-08T20:29:24.263211+0000","last_became_peered":"2024-03-08T20:29:24.263211+0000","last_unstale":"2024-03-08T20:39:10.724335+0000","last_undegraded":"2024-03-08T20:39:10.724335+0000","last_fullsized":"2024-03-08T20:39:10.724335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2479","last_scrub_stamp":"2024-03-08T20:39:10.724241+0000","last_deep_scrub":"27'2479","last_deep_scrub_stamp":"2024-03-08T20:39:10.724241+0000","last_clean_scrub_stamp":"2024-03-08T20:39:10.724241+0000","objects_scrubbed":1199,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:23:54.078069+0000","scrub_duration":8534,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1199,"num_object_clones":0,"num_object_copies":2398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'2387","reported_seq":2469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.817067+0000","last_change":"2024-03-08T20:39:18.817131+0000","last_active":"2024-03-08T20:39:18.817067+0000","last_peered":"2024-03-08T20:39:18.817067+0000","last_clean":"2024-03-08T20:39:18.817067+0000","last_became_active":"2024-03-08T20:29:24.259139+0000","last_became_peered":"2024-03-08T20:29:24.259139+0000","last_unstale":"2024-03-08T20:39:18.817067+0000","last_undegraded":"2024-03-08T20:39:18.817067+0000","last_fullsized":"2024-03-08T20:39:18.817067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2387","last_scrub_stamp":"2024-03-08T20:39:18.816963+0000","last_deep_scrub":"27'2387","last_deep_scrub_stamp":"2024-03-08T20:39:18.816963+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.816963+0000","objects_scrubbed":1133,"log_size":2387,"log_dups_size":0,"ondisk_log_size":2387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:10:11.560670+0000","scrub_duration":8177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1133,"num_object_clones":0,"num_object_copies":2266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1207,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2308","reported_seq":2389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:05.526265+0000","last_change":"2024-03-08T20:39:05.533492+0000","last_active":"2024-03-08T20:39:05.526265+0000","last_peered":"2024-03-08T20:39:05.526265+0000","last_clean":"2024-03-08T20:39:05.526265+0000","last_became_active":"2024-03-08T20:29:24.267021+0000","last_became_peered":"2024-03-08T20:29:24.267021+0000","last_unstale":"2024-03-08T20:39:05.526265+0000","last_undegraded":"2024-03-08T20:39:05.526265+0000","last_fullsized":"2024-03-08T20:39:05.526265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2308","last_scrub_stamp":"2024-03-08T20:39:05.522116+0000","last_deep_scrub":"27'2308","last_deep_scrub_stamp":"2024-03-08T20:39:05.522116+0000","last_clean_scrub_stamp":"2024-03-08T20:39:05.522116+0000","objects_scrubbed":1112,"log_size":2308,"log_dups_size":0,"ondisk_log_size":2308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:14:09.966547+0000","scrub_duration":5348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1112,"num_object_clones":0,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2317","reported_seq":2399,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:15.859596+0000","last_change":"2024-03-08T20:39:15.859645+0000","last_active":"2024-03-08T20:39:15.859596+0000","last_peered":"2024-03-08T20:39:15.859596+0000","last_clean":"2024-03-08T20:39:15.859596+0000","last_became_active":"2024-03-08T20:29:24.246486+0000","last_became_peered":"2024-03-08T20:29:24.246486+0000","last_unstale":"2024-03-08T20:39:15.859596+0000","last_undegraded":"2024-03-08T20:39:15.859596+0000","last_fullsized":"2024-03-08T20:39:15.859596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-03-08T20:39:15.859507+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-03-08T20:39:15.859507+0000","last_clean_scrub_stamp":"2024-03-08T20:39:15.859507+0000","objects_scrubbed":1129,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":12,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:44:13.190643+0000","scrub_duration":11597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1129,"num_object_clones":0,"num_object_copies":2258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'2496","reported_seq":2579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:18.872659+0000","last_change":"2024-03-08T20:39:18.872761+0000","last_active":"2024-03-08T20:39:18.872659+0000","last_peered":"2024-03-08T20:39:18.872659+0000","last_clean":"2024-03-08T20:39:18.872659+0000","last_became_active":"2024-03-08T20:29:24.242620+0000","last_became_peered":"2024-03-08T20:29:24.242620+0000","last_unstale":"2024-03-08T20:39:18.872659+0000","last_undegraded":"2024-03-08T20:39:18.872659+0000","last_fullsized":"2024-03-08T20:39:18.872659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2496","last_scrub_stamp":"2024-03-08T20:39:18.872545+0000","last_deep_scrub":"27'2496","last_deep_scrub_stamp":"2024-03-08T20:39:18.872545+0000","last_clean_scrub_stamp":"2024-03-08T20:39:18.872545+0000","objects_scrubbed":1173,"log_size":2496,"log_dups_size":0,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:03:29.857816+0000","scrub_duration":5355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1173,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1269,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2406","reported_seq":2490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:16.920889+0000","last_change":"2024-03-08T20:39:16.920939+0000","last_active":"2024-03-08T20:39:16.920889+0000","last_peered":"2024-03-08T20:39:16.920889+0000","last_clean":"2024-03-08T20:39:16.920889+0000","last_became_active":"2024-03-08T20:29:24.257314+0000","last_became_peered":"2024-03-08T20:29:24.257314+0000","last_unstale":"2024-03-08T20:39:16.920889+0000","last_undegraded":"2024-03-08T20:39:16.920889+0000","last_fullsized":"2024-03-08T20:39:16.920889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2406","last_scrub_stamp":"2024-03-08T20:39:16.920789+0000","last_deep_scrub":"27'2406","last_deep_scrub_stamp":"2024-03-08T20:39:16.920789+0000","last_clean_scrub_stamp":"2024-03-08T20:39:16.920789+0000","objects_scrubbed":1152,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":9,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:26.963549+0000","scrub_duration":8258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1152,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1152,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'2431","reported_seq":2515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:58.390690+0000","last_change":"2024-03-08T20:38:58.390763+0000","last_active":"2024-03-08T20:38:58.390690+0000","last_peered":"2024-03-08T20:38:58.390690+0000","last_clean":"2024-03-08T20:38:58.390690+0000","last_became_active":"2024-03-08T20:29:24.236392+0000","last_became_peered":"2024-03-08T20:29:24.236392+0000","last_unstale":"2024-03-08T20:38:58.390690+0000","last_undegraded":"2024-03-08T20:38:58.390690+0000","last_fullsized":"2024-03-08T20:38:58.390690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2431","last_scrub_stamp":"2024-03-08T20:38:58.390583+0000","last_deep_scrub":"27'2431","last_deep_scrub_stamp":"2024-03-08T20:38:58.390583+0000","last_clean_scrub_stamp":"2024-03-08T20:38:58.390583+0000","objects_scrubbed":1184,"log_size":2431,"log_dups_size":0,"ondisk_log_size":2431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:17:36.095928+0000","scrub_duration":1742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1184,"num_object_clones":0,"num_object_copies":2368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1184,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2261","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:38:56.636981+0000","last_change":"2024-03-08T20:38:56.637013+0000","last_active":"2024-03-08T20:38:56.636981+0000","last_peered":"2024-03-08T20:38:56.636981+0000","last_clean":"2024-03-08T20:38:56.636981+0000","last_became_active":"2024-03-08T20:29:24.238360+0000","last_became_peered":"2024-03-08T20:29:24.238360+0000","last_unstale":"2024-03-08T20:38:56.636981+0000","last_undegraded":"2024-03-08T20:38:56.636981+0000","last_fullsized":"2024-03-08T20:38:56.636981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2261","last_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_deep_scrub":"27'2261","last_deep_scrub_stamp":"2024-03-08T20:38:56.636912+0000","last_clean_scrub_stamp":"2024-03-08T20:38:56.636912+0000","objects_scrubbed":1103,"log_size":2261,"log_dups_size":0,"ondisk_log_size":2261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:30:09.348536+0000","scrub_duration":1504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1103,"num_object_clones":0,"num_object_copies":2206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'2262","reported_seq":2343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T20:39:06.389063+0000","last_change":"2024-03-08T20:39:06.389138+0000","last_active":"2024-03-08T20:39:06.389063+0000","last_peered":"2024-03-08T20:39:06.389063+0000","last_clean":"2024-03-08T20:39:06.389063+0000","last_became_active":"2024-03-08T20:29:24.265449+0000","last_became_peered":"2024-03-08T20:29:24.265449+0000","last_unstale":"2024-03-08T20:39:06.389063+0000","last_undegraded":"2024-03-08T20:39:06.389063+0000","last_fullsized":"2024-03-08T20:39:06.389063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2262","last_scrub_stamp":"2024-03-08T20:39:06.388989+0000","last_deep_scrub":"27'2262","last_deep_scrub_stamp":"2024-03-08T20:39:06.388989+0000","last_clean_scrub_stamp":"2024-03-08T20:39:06.388989+0000","objects_scrubbed":1095,"log_size":2262,"log_dups_size":0,"ondisk_log_size":2262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":6,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:29:22.459480+0000","scrub_duration":5232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1095,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1095,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1488718448,"num_objects":81232,"num_object_clones":0,"num_object_copies":324928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81232,"num_whiteouts":0,"num_read":4,"num_read_kb":632,"num_write":243462,"num_write_kb":1574700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2732314624,"data_stored":3831529472,"data_compressed":570963840,"data_compressed_allocated":700055552,"data_compressed_original":1799270400,"omap_allocated":0,"internal_metadata":0},"log_size":167509,"ondisk_log_size":167509,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":73410,"num_object_clones":0,"num_object_copies":146820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73410,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77814,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153068,"ondisk_log_size":153068,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":177984569,"num_objects":4507,"num_object_clones":0,"num_object_copies":9014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4507,"num_whiteouts":0,"num_read":672,"num_read_kb":970,"num_write":33363,"num_write_kb":743289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4456,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":45098891,"num_omap_keys":77979,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127565824,"data_stored":355969138,"data_compressed":48877398,"data_compressed_allocated":60243968,"data_compressed_original":288710656,"omap_allocated":0,"internal_metadata":0},"log_size":28125,"ondisk_log_size":28125,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65102,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":587876,"kb_used_data":308188,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93783964,"statfs":{"total":96636764160,"available":96034779136,"internally_reserved":0,"allocated":315584512,"data_stored":466503006,"data_compressed":66032232,"data_compressed_allocated":80855040,"data_compressed_original":231952384,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":746804,"kb_used_data":400620,"kb_used_omap":1,"kb_used_meta":346174,"kb_avail":93625036,"statfs":{"total":96636764160,"available":95872036864,"internally_reserved":0,"allocated":410234880,"data_stored":556755999,"data_compressed":74692817,"data_compressed_allocated":87916544,"data_compressed_original":234618880,"omap_allocated":1594,"internal_metadata":354482630},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":553852,"kb_used_data":251956,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":93817988,"statfs":{"total":96636764160,"available":96069619712,"internally_reserved":0,"allocated":258002944,"data_stored":424137042,"data_compressed":66768074,"data_compressed_allocated":84230144,"data_compressed_original":250540032,"omap_allocated":1595,"internal_metadata":309131717},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683548,"kb_used_data":331668,"kb_used_omap":1,"kb_used_meta":351870,"kb_avail":93688292,"statfs":{"total":96636764160,"available":95936811008,"internally_reserved":0,"allocated":339628032,"data_stored":514949494,"data_compressed":82613106,"data_compressed_allocated":101937152,"data_compressed_original":277442560,"omap_allocated":1595,"internal_metadata":360315333},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864324,"kb_used_data":422268,"kb_used_omap":1,"kb_used_meta":442046,"kb_avail":93507516,"statfs":{"total":96636764160,"available":95751696384,"internally_reserved":0,"allocated":432402432,"data_stored":663179795,"data_compressed":104468897,"data_compressed_allocated":131923968,"data_compressed_original":362885120,"omap_allocated":1593,"internal_metadata":452655559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583308,"kb_used_data":321732,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93788532,"statfs":{"total":96636764160,"available":96039456768,"internally_reserved":0,"allocated":329453568,"data_stored":439965420,"data_compressed":57746106,"data_compressed_allocated":67641344,"data_compressed_original":178327552,"omap_allocated":1595,"internal_metadata":267844037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":897796,"kb_used_data":451580,"kb_used_omap":1,"kb_used_meta":446206,"kb_avail":93474044,"statfs":{"total":96636764160,"available":95717421056,"internally_reserved":0,"allocated":462417920,"data_stored":692867480,"data_compressed":104011770,"data_compressed_allocated":129519616,"data_compressed_original":360148992,"omap_allocated":1595,"internal_metadata":456915397},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574973,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":635440,"kb_used_data":307240,"kb_used_omap":1,"kb_used_meta":328190,"kb_avail":93736400,"statfs":{"total":96636764160,"available":95986073600,"internally_reserved":0,"allocated":314613760,"data_stored":431273366,"data_compressed":63573338,"data_compressed_allocated":76365824,"data_compressed_original":193212416,"omap_allocated":1594,"internal_metadata":336067014},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32551,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11288576,"data_stored":20972158,"data_compressed":2184983,"data_compressed_allocated":2924544,"data_compressed_original":12619776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23916544,"data_stored":58720416,"data_compressed":8030549,"data_compressed_allocated":9908224,"data_compressed_original":44720128,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18718720,"data_stored":46724596,"data_compressed":6229579,"data_compressed_allocated":7798784,"data_compressed_original":35807232,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19238912,"data_stored":43766043,"data_compressed":5410896,"data_compressed_allocated":6983680,"data_compressed_original":31522816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6901760,"data_stored":20971646,"data_compressed":3128231,"data_compressed_allocated":3760128,"data_compressed_original":17842176,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22335488,"data_stored":67108954,"data_compressed":9551804,"data_compressed_allocated":11624448,"data_compressed_original":56401920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":43178791,"data_compressed":6305634,"data_compressed_allocated":7553024,"data_compressed_original":38158336,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":54526534,"data_compressed":8035722,"data_compressed_allocated":9691136,"data_compressed_original":51638272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":302968832,"data_stored":409591808,"data_compressed":61355804,"data_compressed_allocated":73396224,"data_compressed_original":180019200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":438210560,"data_stored":634028032,"data_compressed":95981221,"data_compressed_allocated":119611392,"data_compressed_original":315428864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":310444032,"data_stored":393121792,"data_compressed":51516527,"data_compressed_allocated":59842560,"data_compressed_original":142520320,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":412872704,"data_stored":619294720,"data_compressed":99058001,"data_compressed_allocated":124940288,"data_compressed_original":331362304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":332435456,"data_stored":493858816,"data_compressed":79484875,"data_compressed_allocated":98177024,"data_compressed_original":259600384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":235376640,"data_stored":356909056,"data_compressed":57216270,"data_compressed_allocated":72605696,"data_compressed_original":194138112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":513458176,"data_compressed":68387183,"data_compressed_allocated":80363520,"data_compressed_original":196460544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":302645248,"data_stored":411267072,"data_compressed":57963959,"data_compressed_allocated":71118848,"data_compressed_original":179740672,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T20:39:40.463 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-08T20:39:40.690 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.691+0000 7f1716800640 1 Processor -- start 2024-03-08T20:39:40.691 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.691+0000 7f1716800640 1 -- start start 2024-03-08T20:39:40.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.692+0000 7f1716800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1710150240 0x7f171006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.692+0000 7f1716800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f171006dcd0 0x7f17100c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.692+0000 7f1716800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1710152b70 con 0x7f17100c2800 2024-03-08T20:39:40.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.692+0000 7f1716800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1710152e30 con 0x7f171006dcd0 2024-03-08T20:39:40.692 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.692+0000 7f1716800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710153110 con 0x7f1710150240 2024-03-08T20:39:40.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1715e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f17100c2800 0x7f1710156160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33680/0 (socket says 172.21.15.118:33680) 2024-03-08T20:39:40.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1714a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f171006dcd0 0x7f17100c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.693 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1715e00640 1 -- 172.21.15.118:0/1168352599 learned_addr learned my addr 172.21.15.118:0/1168352599 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1715400640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1710150240 0x7f171006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1714a00640 1 -- 172.21.15.118:0/1168352599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1710150240 msgr2=0x7f171006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1714a00640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1710150240 0x7f171006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1714a00640 1 -- 172.21.15.118:0/1168352599 >> v1:172.21.15.118:6789/0 conn(0x7f17100c2800 legacy=0x7f1710156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f1714a00640 1 -- 172.21.15.118:0/1168352599 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17101533f0 con 0x7f171006dcd0 2024-03-08T20:39:40.694 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.693+0000 7f170fe00640 1 -- 172.21.15.118:0/1168352599 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15921697 0 0) 0x7f1710152b70 con 0x7f17100c2800 2024-03-08T20:39:40.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.694+0000 7f1714a00640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171006dcd0 0x7f17100c22c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17000097a0 tx=0x7f170002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fdbda9f5677855 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.695+0000 7f170fe00640 1 -- 172.21.15.118:0/1168352599 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000315a0 con 0x7f171006dcd0 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.695+0000 7f170fe00640 1 -- 172.21.15.118:0/1168352599 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700037070 con 0x7f171006dcd0 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.695+0000 7f170fe00640 1 -- 172.21.15.118:0/1168352599 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700031960 con 0x7f171006dcd0 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.695+0000 7f1716800640 1 -- 172.21.15.118:0/1168352599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171006dcd0 msgr2=0x7f17100c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.695+0000 7f1716800640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171006dcd0 0x7f17100c22c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17000097a0 tx=0x7f170002b840 comp rx=0 tx=0).stop 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 -- 172.21.15.118:0/1168352599 shutdown_connections 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f171006dcd0 0x7f17100c22c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 --2- 172.21.15.118:0/1168352599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1710150240 0x7f171006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 -- 172.21.15.118:0/1168352599 >> 172.21.15.118:0/1168352599 conn(0x7f17100c6480 msgr2=0x7f17100c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 -- 172.21.15.118:0/1168352599 shutdown_connections 2024-03-08T20:39:40.697 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.696+0000 7f1716800640 1 -- 172.21.15.118:0/1168352599 wait complete. 2024-03-08T20:39:40.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.697+0000 7f1716800640 1 Processor -- start 2024-03-08T20:39:40.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.697+0000 7f1716800640 1 -- start start 2024-03-08T20:39:40.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 0x7f17100aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100c2800 0x7f17101487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.699 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171006ecd0 con 0x7f1710150240 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171006eb50 con 0x7f171006dcd0 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.698+0000 7f1716800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710156870 con 0x7f17100c2800 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47688/0 (socket says 172.21.15.118:47688) 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 -- 172.21.15.118:0/3159308208 learned_addr learned my addr 172.21.15.118:0/3159308208 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1714a00640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100c2800 0x7f17101487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.700 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 -- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100c2800 msgr2=0x7f17101487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100c2800 0x7f17101487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715400640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 0x7f17100aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 -- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 msgr2=0x7f17100aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 0x7f17100aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 -- 172.21.15.118:0/3159308208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710149680 con 0x7f1710150240 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715400640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 0x7f17100aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.699+0000 7f1715e00640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f170800c780 tx=0x7f170800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.700+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708018070 con 0x7f1710150240 2024-03-08T20:39:40.701 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.700+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800ce30 con 0x7f1710150240 2024-03-08T20:39:40.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.700+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800a840 con 0x7f1710150240 2024-03-08T20:39:40.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.700+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17101493a0 con 0x7f1710150240 2024-03-08T20:39:40.702 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.700+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17101ead80 con 0x7f1710150240 2024-03-08T20:39:40.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.701+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1710074a40 con 0x7f1710150240 2024-03-08T20:39:40.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.702+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f170801b070 con 0x7f1710150240 2024-03-08T20:39:40.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.703+0000 7f170d600640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 0x7f16f406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:40.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.703+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f170808a350 con 0x7f1710150240 2024-03-08T20:39:40.703 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.703+0000 7f1715400640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 0x7f16f406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:40.704 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.704+0000 7f1715400640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 0x7f16f406e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:40.706 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.707+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f1708058af0 con 0x7f1710150240 2024-03-08T20:39:40.907 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.907+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f171014a000 con 0x7f1710150240 2024-03-08T20:39:40.912 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.912+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f17080583f0 con 0x7f1710150240 2024-03-08T20:39:40.913 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.914+0000 7f170d600640 1 -- 172.21.15.118:0/3159308208 <== mon.0 v2:172.21.15.118:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f170805c540 con 0x7f1710150240 2024-03-08T20:39:40.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.915+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 msgr2=0x7f16f406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.915+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 0x7f16f406e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1704006fd0 tx=0x7f1704008040 comp rx=0 tx=0).stop 2024-03-08T20:39:40.915 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.915+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 msgr2=0x7f1710148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.915+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f170800c780 tx=0x7f170800cc40 comp rx=0 tx=0).stop 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 shutdown_connections 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16f406bbd0 0x7f16f406e090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1710150240 0x7f1710148d30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17100c2800 0x7f17101487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 --2- 172.21.15.118:0/3159308208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f171006dcd0 0x7f17100aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 >> 172.21.15.118:0/3159308208 conn(0x7f17100c6480 msgr2=0x7f17100c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:40.916 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 shutdown_connections 2024-03-08T20:39:40.917 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:40.916+0000 7f1716800640 1 -- 172.21.15.118:0/3159308208 wait complete. 2024-03-08T20:39:40.935 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T20:39:40.935 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:39:41.139 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.140+0000 7fda7c200640 1 Processor -- start 2024-03-08T20:39:41.140 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.140+0000 7fda7c200640 1 -- start start 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.141+0000 7fda7c200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda74151620 0x7fda740c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.141+0000 7fda7c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda7406e3d0 0x7fda74151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.141+0000 7fda7c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda74072c20 con 0x7fda740c1090 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.141+0000 7fda7c200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda74151f40 con 0x7fda74151620 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.141+0000 7fda7c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda74072f00 con 0x7fda7406e3d0 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda74151620 0x7fda740c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.142 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fda74151620 0x7fda740c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47702/0 (socket says 172.21.15.118:47702) 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 -- 172.21.15.118:0/3453825492 learned_addr learned my addr 172.21.15.118:0/3453825492 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 -- 172.21.15.118:0/3453825492 >> v2:172.21.15.144:3300/0 conn(0x7fda7406e3d0 msgr2=0x7fda74151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda78e00640 1 --2- 172.21.15.118:0/3453825492 >> v2:172.21.15.144:3300/0 conn(0x7fda7406e3d0 0x7fda74151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 --2- 172.21.15.118:0/3453825492 >> v2:172.21.15.144:3300/0 conn(0x7fda7406e3d0 0x7fda74151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 -- 172.21.15.118:0/3453825492 >> v1:172.21.15.144:6789/0 conn(0x7fda740c1090 legacy=0x7fda741549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:41.143 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.142+0000 7fda79800640 1 -- 172.21.15.118:0/3453825492 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74152180 con 0x7fda74151620 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.143+0000 7fda79800640 1 --2- 172.21.15.118:0/3453825492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda74151620 0x7fda740c2a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda740c2fa0 tx=0x7fda6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6cf3f6cc56adbb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda73e00640 1 -- 172.21.15.118:0/3453825492 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68035020 con 0x7fda74151620 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda73e00640 1 -- 172.21.15.118:0/3453825492 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fda68031870 con 0x7fda74151620 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda73e00640 1 -- 172.21.15.118:0/3453825492 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68031c60 con 0x7fda74151620 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 -- 172.21.15.118:0/3453825492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda74151620 msgr2=0x7fda740c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.145 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 --2- 172.21.15.118:0/3453825492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda74151620 0x7fda740c2a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda740c2fa0 tx=0x7fda6802b910 comp rx=0 tx=0).stop 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 -- 172.21.15.118:0/3453825492 shutdown_connections 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 --2- 172.21.15.118:0/3453825492 >> v2:172.21.15.144:3300/0 conn(0x7fda7406e3d0 0x7fda74151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 --2- 172.21.15.118:0/3453825492 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda74151620 0x7fda740c2a60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.144+0000 7fda7c200640 1 -- 172.21.15.118:0/3453825492 >> 172.21.15.118:0/3453825492 conn(0x7fda740a84c0 msgr2=0x7fda740a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.145+0000 7fda7c200640 1 -- 172.21.15.118:0/3453825492 shutdown_connections 2024-03-08T20:39:41.146 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.145+0000 7fda7c200640 1 -- 172.21.15.118:0/3453825492 wait complete. 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.146+0000 7fda7c200640 1 Processor -- start 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.146+0000 7fda7c200640 1 -- start start 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 0x7fda740bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda74151620 0x7fda740bde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740c1500 con 0x7fda740c1090 2024-03-08T20:39:41.149 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda741550e0 con 0x7fda7406e3d0 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda7c200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda740c6690 con 0x7fda74151620 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda78e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda78e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47714/0 (socket says 172.21.15.118:47714) 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.147+0000 7fda78e00640 1 -- 172.21.15.118:0/904655812 learned_addr learned my addr 172.21.15.118:0/904655812 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda79800640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 0x7fda740bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda7a200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda74151620 0x7fda740bde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 -- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda74151620 msgr2=0x7fda740bde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.150 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda74151620 0x7fda740bde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 -- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 msgr2=0x7fda740bc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 0x7fda740bc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 -- 172.21.15.118:0/904655812 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740bc6a0 con 0x7fda740c1090 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda79800640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 0x7fda740bc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda78e00640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda6000c7f0 tx=0x7fda6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.151 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.148+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60015070 con 0x7fda740c1090 2024-03-08T20:39:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.149+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fda60004240 con 0x7fda740c1090 2024-03-08T20:39:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.149+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60007620 con 0x7fda740c1090 2024-03-08T20:39:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.149+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda740bcca0 con 0x7fda740c1090 2024-03-08T20:39:41.152 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.149+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda74154160 con 0x7fda740c1090 2024-03-08T20:39:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.150+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda74074a40 con 0x7fda740c1090 2024-03-08T20:39:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.151+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fda600079f0 con 0x7fda740c1090 2024-03-08T20:39:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.152+0000 7fda71600640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 0x7fda5406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.153 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.152+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fda6008afa0 con 0x7fda740c1090 2024-03-08T20:39:41.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.152+0000 7fda79800640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 0x7fda5406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.153+0000 7fda79800640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 0x7fda5406e090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda68036000 tx=0x7fda68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.156 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.157+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fda60059680 con 0x7fda740c1090 2024-03-08T20:39:41.393 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.393+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda7414f6e0 con 0x7fda740c1090 2024-03-08T20:39:41.394 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.394+0000 7fda71600640 1 -- 172.21.15.118:0/904655812 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fda60058f80 con 0x7fda740c1090 2024-03-08T20:39:41.394 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:39:41.394 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:39:41.395 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:39:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 msgr2=0x7fda5406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 0x7fda5406e090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda68036000 tx=0x7fda68008030 comp rx=0 tx=0).stop 2024-03-08T20:39:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 msgr2=0x7fda74153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda6000c7f0 tx=0x7fda6000ccb0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.397 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 shutdown_connections 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fda5406bbd0 0x7fda5406e090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda74151620 0x7fda740bde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda740c1090 0x7fda74153c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 --2- 172.21.15.118:0/904655812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda7406e3d0 0x7fda740bc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 >> 172.21.15.118:0/904655812 conn(0x7fda740a84c0 msgr2=0x7fda74150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 shutdown_connections 2024-03-08T20:39:41.398 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.397+0000 7fda7c200640 1 -- 172.21.15.118:0/904655812 wait complete. 2024-03-08T20:39:41.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T20:39:41.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.614+0000 7fa94f200640 1 Processor -- start 2024-03-08T20:39:41.614 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.614+0000 7fa94f200640 1 -- start start 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa94f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9480ac940 0x7fa948158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa94f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480c1910 con 0x7fa94813ada0 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa94f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94806d540 con 0x7fa9480c2d70 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa94f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9480c21d0 con 0x7fa9480ac940 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa947e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa94813ada0 0x7fa9480c2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33686/0 (socket says 172.21.15.118:33686) 2024-03-08T20:39:41.616 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.616+0000 7fa947e00640 1 -- 172.21.15.118:0/1304080586 learned_addr learned my addr 172.21.15.118:0/1304080586 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:39:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889047980 0 0) 0x7fa9480c1910 con 0x7fa94813ada0 2024-03-08T20:39:41.619 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa94d200640 1 --2- 172.21.15.118:0/1304080586 >> v2:172.21.15.144:3300/0 conn(0x7fa9480ac940 0x7fa948158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa92c003520 con 0x7fa94813ada0 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4216403425 0 0) 0x7fa92c003520 con 0x7fa94813ada0 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 >> v2:172.21.15.144:3300/0 conn(0x7fa9480ac940 msgr2=0x7fa948158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 --2- 172.21.15.118:0/1304080586 >> v2:172.21.15.144:3300/0 conn(0x7fa9480ac940 0x7fa948158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 >> v1:172.21.15.144:6789/0 conn(0x7fa9480c2d70 legacy=0x7fa9481583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9480c1b80 con 0x7fa94813ada0 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7fa9380019f0 con 0x7fa94813ada0 2024-03-08T20:39:41.620 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 >> v1:172.21.15.118:6789/0 conn(0x7fa94813ada0 legacy=0x7fa9480c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 0x7fa92c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c004800 0x7fa92c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.617+0000 7fa946a00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c0053c0 0x7fa92c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480c21d0 con 0x7fa92c0039b0 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c00c250 con 0x7fa92c004800 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c00c450 con 0x7fa92c0053c0 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 0x7fa92c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947400640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c004800 0x7fa92c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.621 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 -- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c0053c0 msgr2=0x7fa92c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c0053c0 0x7fa92c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 -- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c004800 msgr2=0x7fa92c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c004800 0x7fa92c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947e00640 1 -- 172.21.15.118:0/1304080586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c003520 con 0x7fa92c0039b0 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa947400640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c004800 0x7fa92c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.618+0000 7fa94d200640 1 -- 172.21.15.118:0/1304080586 reap_dead start 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.619+0000 7fa947e00640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 0x7fa92c003dd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa93800a860 tx=0x7fa92c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275b70bfab214186 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.622 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.619+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93800a480 con 0x7fa92c0039b0 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.619+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa938034630 con 0x7fa92c0039b0 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.619+0000 7fa946a00640 1 -- 172.21.15.118:0/1304080586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938034aa0 con 0x7fa92c0039b0 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 -- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 msgr2=0x7fa92c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 0x7fa92c003dd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa93800a860 tx=0x7fa92c005830 comp rx=0 tx=0).stop 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 -- 172.21.15.118:0/1304080586 shutdown_connections 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 --2- 172.21.15.118:0/1304080586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa92c0039b0 0x7fa92c003dd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 -- 172.21.15.118:0/1304080586 >> 172.21.15.118:0/1304080586 conn(0x7fa948072700 msgr2=0x7fa94806ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 -- 172.21.15.118:0/1304080586 shutdown_connections 2024-03-08T20:39:41.623 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.620+0000 7fa94f200640 1 -- 172.21.15.118:0/1304080586 wait complete. 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.622+0000 7fa94f200640 1 Processor -- start 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.622+0000 7fa94f200640 1 -- start start 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0039b0 0x7fa9481554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa948134430 0x7fa9481e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.626 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948067320 con 0x7fa948133810 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948159250 con 0x7fa92c0039b0 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94f200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480674a0 con 0x7fa948134430 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47732/0 (socket says 172.21.15.118:47732) 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.623+0000 7fa94d200640 1 -- 172.21.15.118:0/374852298 learned_addr learned my addr 172.21.15.118:0/374852298 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:41.627 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa947e00640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0039b0 0x7fa9481554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 -- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa948134430 msgr2=0x7fa9481e1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa948134430 0x7fa9481e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 -- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0039b0 msgr2=0x7fa9481554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0039b0 0x7fa9481554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 -- 172.21.15.118:0/374852298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9481546e0 con 0x7fa948133810 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94d200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa948070ef0 tx=0x7fa94000d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940004020 con 0x7fa948133810 2024-03-08T20:39:41.628 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa9400041c0 con 0x7fa948133810 2024-03-08T20:39:41.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400043d0 con 0x7fa948133810 2024-03-08T20:39:41.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948134200 con 0x7fa948133810 2024-03-08T20:39:41.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.624+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948153920 con 0x7fa948133810 2024-03-08T20:39:41.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.625+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948074a40 con 0x7fa948133810 2024-03-08T20:39:41.629 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.626+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa94001a020 con 0x7fa948133810 2024-03-08T20:39:41.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.628+0000 7fa93fe00640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 0x7fa92806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:41.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.628+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa94008a7b0 con 0x7fa948133810 2024-03-08T20:39:41.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.628+0000 7fa947e00640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 0x7fa92806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:41.630 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.629+0000 7fa947e00640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 0x7fa92806e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa938034000 tx=0x7fa93802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:41.632 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.632+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fa940058d70 con 0x7fa948133810 2024-03-08T20:39:41.867 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.868+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa948066f40 con 0x7fa948133810 2024-03-08T20:39:41.869 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.869+0000 7fa93fe00640 1 -- 172.21.15.118:0/374852298 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fa940058670 con 0x7fa948133810 2024-03-08T20:39:41.869 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:39:41.869 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/940377862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6833","nonce":940377862},{"type":"v1","addr":"172.21.15.144:6835","nonce":940377862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1627481871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6834","nonce":1627481871},{"type":"v1","addr":"172.21.15.118:6835","nonce":1627481871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6837/227474950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6836","nonce":227474950},{"type":"v1","addr":"172.21.15.118:6837","nonce":227474950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T20:29:23.681785+0000","modified":"2024-03-08T20:29:45.888293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6834/3218952395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":3218952395},{"type":"v1","addr":"172.21.15.144:6834","nonce":3218952395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T20:39:41.870 INFO:teuthology.orchestra.run.smithi118.stderr:dumped fsmap epoch 9 2024-03-08T20:39:41.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 msgr2=0x7fa92806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 0x7fa92806e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa938034000 tx=0x7fa93802f000 comp rx=0 tx=0).stop 2024-03-08T20:39:41.871 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 msgr2=0x7fa948133cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:41.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa948070ef0 tx=0x7fa94000d8a0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 shutdown_connections 2024-03-08T20:39:41.872 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fa92806bbd0 0x7fa92806e090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa948133810 0x7fa948133cc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa948134430 0x7fa9481e1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 --2- 172.21.15.118:0/374852298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0039b0 0x7fa9481554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 >> 172.21.15.118:0/374852298 conn(0x7fa948072700 msgr2=0x7fa9481379b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 shutdown_connections 2024-03-08T20:39:41.873 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:41.872+0000 7fa94f200640 1 -- 172.21.15.118:0/374852298 wait complete. 2024-03-08T20:39:41.890 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T20:39:42.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.105+0000 7f16ed400640 1 Processor -- start 2024-03-08T20:39:42.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.105+0000 7f16ed400640 1 -- start start 2024-03-08T20:39:42.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16ed400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 0x7f16e806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16ed400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16e81505e0 0x7f16e8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16ed400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80aa980 con 0x7f16e806ebd0 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16ed400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80aac60 con 0x7f16e81505e0 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16ed400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80aaf40 con 0x7f16e806af80 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16e5e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f16e806ebd0 0x7f16e814fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33696/0 (socket says 172.21.15.118:33696) 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16e5e00640 1 -- 172.21.15.118:0/402786726 learned_addr learned my addr 172.21.15.118:0/402786726 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16e7200640 1 --2- 172.21.15.118:0/402786726 >> v2:172.21.15.118:3300/0 conn(0x7f16e81505e0 0x7f16e8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16e6800640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 0x7f16e806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.107+0000 7f16e5400640 1 -- 172.21.15.118:0/402786726 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632339642 0 0) 0x7f16e80aa980 con 0x7f16e806ebd0 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e5400640 1 -- 172.21.15.118:0/402786726 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16cc003520 con 0x7f16e806ebd0 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e7200640 1 -- 172.21.15.118:0/402786726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 msgr2=0x7f16e806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e7200640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 0x7f16e806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e7200640 1 -- 172.21.15.118:0/402786726 >> v1:172.21.15.118:6789/0 conn(0x7f16e806ebd0 legacy=0x7f16e814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e7200640 1 -- 172.21.15.118:0/402786726 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80ab220 con 0x7f16e81505e0 2024-03-08T20:39:42.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.108+0000 7f16e6800640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 0x7f16e806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.109+0000 7f16e7200640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e81505e0 0x7f16e8152e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16e00097a0 tx=0x7f16e002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24c071fd1a1e145 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.109+0000 7f16e5400640 1 -- 172.21.15.118:0/402786726 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0031780 con 0x7f16e81505e0 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.109+0000 7f16e5400640 1 -- 172.21.15.118:0/402786726 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16e0037070 con 0x7f16e81505e0 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.109+0000 7f16e5400640 1 -- 172.21.15.118:0/402786726 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0031b60 con 0x7f16e81505e0 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 -- 172.21.15.118:0/402786726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e81505e0 msgr2=0x7f16e8152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e81505e0 0x7f16e8152e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16e00097a0 tx=0x7f16e002b820 comp rx=0 tx=0).stop 2024-03-08T20:39:42.111 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 -- 172.21.15.118:0/402786726 shutdown_connections 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e81505e0 0x7f16e8152e10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 --2- 172.21.15.118:0/402786726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806af80 0x7f16e806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 -- 172.21.15.118:0/402786726 >> 172.21.15.118:0/402786726 conn(0x7f16e80a84c0 msgr2=0x7f16e80a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 -- 172.21.15.118:0/402786726 shutdown_connections 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.110+0000 7f16ed400640 1 -- 172.21.15.118:0/402786726 wait complete. 2024-03-08T20:39:42.112 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.112+0000 7f16ed400640 1 Processor -- start 2024-03-08T20:39:42.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.112+0000 7f16ed400640 1 -- start start 2024-03-08T20:39:42.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806ebd0 0x7f16e80c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e81505e0 0x7f16e813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e806b4e0 con 0x7f16e806af80 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e806b360 con 0x7f16e81505e0 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16ed400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8153350 con 0x7f16e806ebd0 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47758/0 (socket says 172.21.15.118:47758) 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 -- 172.21.15.118:0/2832658379 learned_addr learned my addr 172.21.15.118:0/2832658379 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:42.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e5e00640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806ebd0 0x7f16e80c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 -- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806ebd0 msgr2=0x7f16e80c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806ebd0 0x7f16e80c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e7200640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e81505e0 0x7f16e813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 -- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e81505e0 msgr2=0x7f16e813dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.113+0000 7f16e6800640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e81505e0 0x7f16e813dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16e6800640 1 -- 172.21.15.118:0/2832658379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8145730 con 0x7f16e806af80 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16e6800640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009fc0 tx=0x7f16d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d801a070 con 0x7f16e806af80 2024-03-08T20:39:42.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16d8003bb0 con 0x7f16e806af80 2024-03-08T20:39:42.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e8145490 con 0x7f16e806af80 2024-03-08T20:39:42.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8004030 con 0x7f16e806af80 2024-03-08T20:39:42.117 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.114+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e81e9360 con 0x7f16e806af80 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.116+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e8074a40 con 0x7f16e806af80 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.116+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f16d801d070 con 0x7f16e806af80 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.117+0000 7f16dea00640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 0x7f16c406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.117+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f16d808b0e0 con 0x7f16e806af80 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.117+0000 7f16e5e00640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 0x7f16c406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.118 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.118+0000 7f16e5e00640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 0x7f16c406e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16e814f610 tx=0x7f16d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.121 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.122+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f16d8010070 con 0x7f16e806af80 2024-03-08T20:39:42.320 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.321+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16e81468d0 con 0x7f16e806af80 2024-03-08T20:39:42.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.324+0000 7f16dea00640 1 -- 172.21.15.118:0/2832658379 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18950 (secure 0 0 0) 0x7f16d8059160 con 0x7f16e806af80 2024-03-08T20:39:42.324 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-08T20:39:42.325 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":27,"fsid":"ac17b673-6e59-4db3-9519-ba644ea1ee5b","created":"2024-03-08T20:29:04.278578+0000","modified":"2024-03-08T20:30:10.610951+0000","last_up_change":"2024-03-08T20:29:15.946677+0000","last_in_change":"2024-03-08T20:29:07.795491+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T20:29:17.585224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T20:29:21.753369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T20:29:22.731464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-08T20:29:26.295918+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"01b1df51-561c-4bdc-9173-1adf1ca8360f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6801","nonce":822956166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6803","nonce":822956166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6807","nonce":822956166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":822956166},{"type":"v1","addr":"172.21.15.118:6805","nonce":822956166}]},"public_addr":"172.21.15.118:6801/822956166","cluster_addr":"172.21.15.118:6803/822956166","heartbeat_back_addr":"172.21.15.118:6807/822956166","heartbeat_front_addr":"172.21.15.118:6805/822956166","state":["exists","up"]},{"osd":1,"uuid":"e1bfca47-c959-416d-b763-27bcdaef4719","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6810","nonce":1158609225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6813","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6815","nonce":1158609225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6823","nonce":1158609225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6817","nonce":1158609225},{"type":"v1","addr":"172.21.15.118:6819","nonce":1158609225}]},"public_addr":"172.21.15.118:6810/1158609225","cluster_addr":"172.21.15.118:6815/1158609225","heartbeat_back_addr":"172.21.15.118:6823/1158609225","heartbeat_front_addr":"172.21.15.118:6819/1158609225","state":["exists","up"]},{"osd":2,"uuid":"299b53d1-d7cb-41e9-85e2-c85a2cd18c63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6809","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6811","nonce":1361206557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6814","nonce":1361206557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6822","nonce":1361206557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":1361206557},{"type":"v1","addr":"172.21.15.118:6818","nonce":1361206557}]},"public_addr":"172.21.15.118:6811/1361206557","cluster_addr":"172.21.15.118:6814/1361206557","heartbeat_back_addr":"172.21.15.118:6822/1361206557","heartbeat_front_addr":"172.21.15.118:6818/1361206557","state":["exists","up"]},{"osd":3,"uuid":"8d196f08-c34b-4987-9f34-44a3298e6687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6825","nonce":2572185717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6826","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6827","nonce":2572185717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6831","nonce":2572185717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":2572185717},{"type":"v1","addr":"172.21.15.118:6829","nonce":2572185717}]},"public_addr":"172.21.15.118:6825/2572185717","cluster_addr":"172.21.15.118:6827/2572185717","heartbeat_back_addr":"172.21.15.118:6831/2572185717","heartbeat_front_addr":"172.21.15.118:6829/2572185717","state":["exists","up"]},{"osd":4,"uuid":"1d3c67b7-91bc-4851-b463-62aa11430758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6809","nonce":2013996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6812","nonce":2013996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6817","nonce":2013996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":2013996799},{"type":"v1","addr":"172.21.15.144:6814","nonce":2013996799}]},"public_addr":"172.21.15.144:6809/2013996799","cluster_addr":"172.21.15.144:6812/2013996799","heartbeat_back_addr":"172.21.15.144:6817/2013996799","heartbeat_front_addr":"172.21.15.144:6814/2013996799","state":["exists","up"]},{"osd":5,"uuid":"50af7f9b-0a4e-480e-afef-a451e3408cc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6801","nonce":4103646837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6803","nonce":4103646837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6807","nonce":4103646837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":4103646837},{"type":"v1","addr":"172.21.15.144:6805","nonce":4103646837}]},"public_addr":"172.21.15.144:6801/4103646837","cluster_addr":"172.21.15.144:6803/4103646837","heartbeat_back_addr":"172.21.15.144:6807/4103646837","heartbeat_front_addr":"172.21.15.144:6805/4103646837","state":["exists","up"]},{"osd":6,"uuid":"c7ec4211-d24b-4c39-be77-e838e7b0e61d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6816","nonce":1443686898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6819","nonce":1443686898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6823","nonce":1443686898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1443686898},{"type":"v1","addr":"172.21.15.144:6821","nonce":1443686898}]},"public_addr":"172.21.15.144:6816/1443686898","cluster_addr":"172.21.15.144:6819/1443686898","heartbeat_back_addr":"172.21.15.144:6823/1443686898","heartbeat_front_addr":"172.21.15.144:6821/1443686898","state":["exists","up"]},{"osd":7,"uuid":"d0314da8-813e-45ab-9b4d-54eb9b07008c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6825","nonce":1313104786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6827","nonce":1313104786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6831","nonce":1313104786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1313104786},{"type":"v1","addr":"172.21.15.144:6829","nonce":1313104786}]},"public_addr":"172.21.15.144:6825/1313104786","cluster_addr":"172.21.15.144:6827/1313104786","heartbeat_back_addr":"172.21.15.144:6831/1313104786","heartbeat_front_addr":"172.21.15.144:6829/1313104786","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.875107+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.139336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.109376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.136885+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:12.783351+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.063341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.086442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T20:29:13.167822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T20:39:42.326 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 msgr2=0x7f16c406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 0x7f16c406e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16e814f610 tx=0x7f16d0009040 comp rx=0 tx=0).stop 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 msgr2=0x7f16e80bbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009fc0 tx=0x7f16d800d560 comp rx=0 tx=0).stop 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 shutdown_connections 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f16c406bbd0 0x7f16c406e090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e81505e0 0x7f16e813dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16e806ebd0 0x7f16e80c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.327 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 --2- 172.21.15.118:0/2832658379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f16e806af80 0x7f16e80bbfe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 >> 172.21.15.118:0/2832658379 conn(0x7f16e80a84c0 msgr2=0x7f16e80c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:42.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 shutdown_connections 2024-03-08T20:39:42.328 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.327+0000 7f16ed400640 1 -- 172.21.15.118:0/2832658379 wait complete. 2024-03-08T20:39:42.346 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-08T20:39:42.555 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.556+0000 7fe152400640 1 Processor -- start 2024-03-08T20:39:42.556 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.556+0000 7fe152400640 1 -- start start 2024-03-08T20:39:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe14c14c9d0 0x7fe14c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c06ee40 0x7fe14c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 0x7fe14c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c1539f0 con 0x7fe14c14c9d0 2024-03-08T20:39:42.557 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0ab600 con 0x7fe14c0a9990 2024-03-08T20:39:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.557+0000 7fe152400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0ab8e0 con 0x7fe14c06ee40 2024-03-08T20:39:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe14c14c9d0 0x7fe14c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe14c14c9d0 0x7fe14c1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47770/0 (socket says 172.21.15.118:47770) 2024-03-08T20:39:42.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 -- 172.21.15.118:0/2056286797 learned_addr learned my addr 172.21.15.118:0/2056286797 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151a00640 1 --2- 172.21.15.118:0/2056286797 >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 0x7fe14c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe14be00640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c06ee40 0x7fe14c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 -- 172.21.15.118:0/2056286797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c06ee40 msgr2=0x7fe14c0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:42.559 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c06ee40 0x7fe14c0a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 -- 172.21.15.118:0/2056286797 >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 msgr2=0x7fe14c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 --2- 172.21.15.118:0/2056286797 >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 0x7fe14c06dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151000640 1 -- 172.21.15.118:0/2056286797 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0abbc0 con 0x7fe14c14c9d0 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.558+0000 7fe151a00640 1 --2- 172.21.15.118:0/2056286797 >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 0x7fe14c06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.559+0000 7fe151000640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c14c9d0 0x7fe14c1534b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe14c070b70 tx=0x7fe14002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c0907ff39cf59e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe14b400640 1 -- 172.21.15.118:0/2056286797 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140038070 con 0x7fe14c14c9d0 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe14b400640 1 -- 172.21.15.118:0/2056286797 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe14002f050 con 0x7fe14c14c9d0 2024-03-08T20:39:42.560 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe14b400640 1 -- 172.21.15.118:0/2056286797 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140031990 con 0x7fe14c14c9d0 2024-03-08T20:39:42.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 -- 172.21.15.118:0/2056286797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c14c9d0 msgr2=0x7fe14c1534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.561 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c14c9d0 0x7fe14c1534b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe14c070b70 tx=0x7fe14002b7f0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 -- 172.21.15.118:0/2056286797 shutdown_connections 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 --2- 172.21.15.118:0/2056286797 >> v2:172.21.15.144:3300/0 conn(0x7fe14c0a9990 0x7fe14c06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c06ee40 0x7fe14c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 --2- 172.21.15.118:0/2056286797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c14c9d0 0x7fe14c1534b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 -- 172.21.15.118:0/2056286797 >> 172.21.15.118:0/2056286797 conn(0x7fe14c06ad10 msgr2=0x7fe14c06b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.560+0000 7fe152400640 1 -- 172.21.15.118:0/2056286797 shutdown_connections 2024-03-08T20:39:42.562 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.561+0000 7fe152400640 1 -- 172.21.15.118:0/2056286797 wait complete. 2024-03-08T20:39:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.563+0000 7fe152400640 1 Processor -- start 2024-03-08T20:39:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.563+0000 7fe152400640 1 -- start start 2024-03-08T20:39:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14c0a9990 0x7fe14c0c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.564 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c14c9d0 0x7fe14c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c14cdb0 con 0x7fe14c06ee40 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0ac180 con 0x7fe14c0a9990 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe152400640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c14cf30 con 0x7fe14c14c9d0 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47772/0 (socket says 172.21.15.118:47772) 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 -- 172.21.15.118:0/2519641397 learned_addr learned my addr 172.21.15.118:0/2519641397 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 -- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c14c9d0 msgr2=0x7fe14c1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c14c9d0 0x7fe14c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.565 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 -- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14c0a9990 msgr2=0x7fe14c0c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14c0a9990 0x7fe14c0c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.564+0000 7fe151000640 1 -- 172.21.15.118:0/2519641397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c1eb900 con 0x7fe14c06ee40 2024-03-08T20:39:42.566 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe151000640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe14002b830 tx=0x7fe1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140042020 con 0x7fe14c06ee40 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe140033910 con 0x7fe14c06ee40 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140038040 con 0x7fe14c06ee40 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c1eb620 con 0x7fe14c06ee40 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.565+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c1555c0 con 0x7fe14c06ee40 2024-03-08T20:39:42.567 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.566+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0c03f0 con 0x7fe14c06ee40 2024-03-08T20:39:42.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.567+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe140045020 con 0x7fe14c06ee40 2024-03-08T20:39:42.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.568+0000 7fe148c00640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 0x7fe12c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:42.568 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.568+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe1400accf0 con 0x7fe14c06ee40 2024-03-08T20:39:42.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.569+0000 7fe14be00640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 0x7fe12c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:42.569 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.569+0000 7fe14be00640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 0x7fe12c06e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe14c13fa10 tx=0x7fe138008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:42.572 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.573+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fe14c0c03f0 con 0x7fe14c06ee40 2024-03-08T20:39:42.808 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.808+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe14c14a010 con 0x7fe14c06ee40 2024-03-08T20:39:42.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.812+0000 7fe148c00640 1 -- 172.21.15.118:0/2519641397 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe14c14a010 con 0x7fe14c06ee40 2024-03-08T20:39:42.812 INFO:teuthology.orchestra.run.smithi118.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-08T20:39:42.815 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 msgr2=0x7fe12c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 0x7fe12c06e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe14c13fa10 tx=0x7fe138008040 comp rx=0 tx=0).stop 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 msgr2=0x7fe14c13b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe14002b830 tx=0x7fe1400046c0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 shutdown_connections 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fe12c06bbd0 0x7fe12c06e090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe14c14c9d0 0x7fe14c1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14c0a9990 0x7fe14c0c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 --2- 172.21.15.118:0/2519641397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe14c06ee40 0x7fe14c13b950 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:42.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 >> 172.21.15.118:0/2519641397 conn(0x7fe14c06ad10 msgr2=0x7fe14c0bf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:42.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 shutdown_connections 2024-03-08T20:39:42.817 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:42.816+0000 7fe152400640 1 -- 172.21.15.118:0/2519641397 wait complete. 2024-03-08T20:39:42.838 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-08T20:39:43.046 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.047+0000 7f4541200640 1 Processor -- start 2024-03-08T20:39:43.047 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.047+0000 7f4541200640 1 -- start start 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.048+0000 7f4541200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f453c156760 0x7f453c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.048+0000 7f4541200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c06d230 con 0x7f453c0c0890 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.048+0000 7f4541200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c159360 con 0x7f453c0c5540 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.048+0000 7f4541200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c15d060 con 0x7f453c156760 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.048+0000 7f4539400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f453c0c0890 0x7f453c15c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:33698/0 (socket says 172.21.15.118:33698) 2024-03-08T20:39:43.048 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4539400640 1 -- 172.21.15.118:0/147006187 learned_addr learned my addr 172.21.15.118:0/147006187 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-08T20:39:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4539e00640 1 --2- 172.21.15.118:0/147006187 >> v2:172.21.15.144:3300/0 conn(0x7f453c156760 0x7f453c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382015084 0 0) 0x7f453c06d230 con 0x7f453c0c0890 2024-03-08T20:39:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003520 con 0x7f453c0c0890 2024-03-08T20:39:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773546801 0 0) 0x7f4520003520 con 0x7f453c0c0890 2024-03-08T20:39:43.051 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 >> v2:172.21.15.144:3300/0 conn(0x7f453c156760 msgr2=0x7f453c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 --2- 172.21.15.118:0/147006187 >> v2:172.21.15.144:3300/0 conn(0x7f453c156760 0x7f453c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 >> v1:172.21.15.144:6789/0 conn(0x7f453c0c5540 legacy=0x7f453c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0c5cb0 con 0x7f453c0c0890 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2627280419 0 0) 0x7f4524001670 con 0x7f453c0c0890 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.049+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 >> v1:172.21.15.118:6789/0 conn(0x7f453c0c0890 legacy=0x7f453c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 0x7f4520003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4520004800 0x7f4520004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45200051c0 0x7f452000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.052 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c15d060 con 0x7f45200039b0 2024-03-08T20:39:43.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452000c060 con 0x7f45200051c0 2024-03-08T20:39:43.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452000c260 con 0x7f4520004800 2024-03-08T20:39:43.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 0x7f4520003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 -- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4520004800 msgr2=0x7f4520004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:43.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f453a800640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45200051c0 0x7f452000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539400640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4520004800 0x7f4520004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4520004800 0x7f4520004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 -- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45200051c0 msgr2=0x7f452000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45200051c0 0x7f452000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f4539e00640 1 -- 172.21.15.118:0/147006187 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520003520 con 0x7f45200039b0 2024-03-08T20:39:43.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f453a800640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45200051c0 0x7f452000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:43.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.050+0000 7f453a800640 1 -- 172.21.15.118:0/147006187 reap_dead start 2024-03-08T20:39:43.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.051+0000 7f4539e00640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 0x7f4520003dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f452c009ac0 tx=0x7f4520005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae4b4d90ea91807 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:43.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c039070 con 0x7f45200039b0 2024-03-08T20:39:43.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f452c02c6b0 con 0x7f45200039b0 2024-03-08T20:39:43.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4538a00640 1 -- 172.21.15.118:0/147006187 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c009690 con 0x7f45200039b0 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 -- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 msgr2=0x7f4520003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 0x7f4520003dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f452c009ac0 tx=0x7f4520005830 comp rx=0 tx=0).stop 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 -- 172.21.15.118:0/147006187 shutdown_connections 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 --2- 172.21.15.118:0/147006187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45200039b0 0x7f4520003dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 -- 172.21.15.118:0/147006187 >> 172.21.15.118:0/147006187 conn(0x7f453c06b720 msgr2=0x7f453c0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.052+0000 7f4541200640 1 -- 172.21.15.118:0/147006187 shutdown_connections 2024-03-08T20:39:43.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.053+0000 7f4541200640 1 -- 172.21.15.118:0/147006187 wait complete. 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.054+0000 7f4541200640 1 Processor -- start 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.054+0000 7f4541200640 1 -- start start 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 0x7f453c1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 0x7f453c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c159900 con 0x7f453c14fe40 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c159620 con 0x7f453c1f2d10 2024-03-08T20:39:43.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.055+0000 7f4541200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0c5990 con 0x7f45200039b0 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47778/0 (socket says 172.21.15.118:47778) 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 -- 172.21.15.118:0/1057314454 learned_addr learned my addr 172.21.15.118:0/1057314454 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f4539400640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 0x7f453c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f4539e00640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 0x7f453c1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 -- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 msgr2=0x7f453c1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 0x7f453c1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 -- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 msgr2=0x7f453c14f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 0x7f453c14f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 -- 172.21.15.118:0/1057314454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c1f3250 con 0x7f453c14fe40 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f4539400640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 0x7f453c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f4539e00640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 0x7f453c1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.056+0000 7f453a800640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f453c0c6270 tx=0x7f453400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.057+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534018070 con 0x7f453c14fe40 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.057+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4534003d80 con 0x7f453c14fe40 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.057+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c0a63f0 con 0x7f453c14fe40 2024-03-08T20:39:43.061 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.057+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534005290 con 0x7f453c14fe40 2024-03-08T20:39:43.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.057+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c0a5180 con 0x7f453c14fe40 2024-03-08T20:39:43.062 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.058+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c1f3420 con 0x7f453c14fe40 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.059+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f453401b070 con 0x7f453c14fe40 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.060+0000 7f4532000640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 0x7f451806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.060+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f453408a520 con 0x7f453c14fe40 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.060+0000 7f4539e00640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 0x7f451806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.061+0000 7f4539e00640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 0x7f451806e0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f452c036000 tx=0x7f452c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:43.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.064+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f4534058bb0 con 0x7f453c14fe40 2024-03-08T20:39:43.162 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2024-03-08T20:39:43.294 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.294+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f453c074a40 con 0x7f453c14fe40 2024-03-08T20:39:43.816 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.816+0000 7f4532000640 1 -- 172.21.15.118:0/1057314454 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45340584b0 con 0x7f453c14fe40 2024-03-08T20:39:43.819 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.819+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 msgr2=0x7f451806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.819+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 0x7f451806e0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f452c036000 tx=0x7f452c030000 comp rx=0 tx=0).stop 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.819+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 msgr2=0x7f453c0a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.819+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f453c0c6270 tx=0x7f453400d9f0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 shutdown_connections 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f451806bc00 0x7f451806e0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f453c14fe40 0x7f453c0a4c40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f453c1f2d10 0x7f453c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.820 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 --2- 172.21.15.118:0/1057314454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f45200039b0 0x7f453c1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:43.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 >> 172.21.15.118:0/1057314454 conn(0x7f453c06b720 msgr2=0x7f453c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:43.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 shutdown_connections 2024-03-08T20:39:43.821 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:43.820+0000 7f4541200640 1 -- 172.21.15.118:0/1057314454 wait complete. 2024-03-08T20:39:43.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-08T20:39:44.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.054+0000 7fc751600640 1 Processor -- start 2024-03-08T20:39:44.054 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.054+0000 7fc751600640 1 -- start start 2024-03-08T20:39:44.055 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c152490 0x7fc74c0c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc74c0c0890 0x7fc74c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 0x7fc74c158600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0c1bc0 con 0x7fc74c0c0890 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0bfbf0 con 0x7fc74c06ed30 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc751600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c152870 con 0x7fc74c152490 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc743e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc74c0c0890 0x7fc74c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:44.056 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc743e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc74c0c0890 0x7fc74c06e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47790/0 (socket says 172.21.15.118:47790) 2024-03-08T20:39:44.057 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.056+0000 7fc743e00640 1 -- 172.21.15.118:0/87473828 learned_addr learned my addr 172.21.15.118:0/87473828 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:44.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc74aa00640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c152490 0x7fc74c0c0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:44.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc743e00640 1 -- 172.21.15.118:0/87473828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c152490 msgr2=0x7fc74c0c0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:44.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc743e00640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c152490 0x7fc74c0c0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.058 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc743e00640 1 -- 172.21.15.118:0/87473828 >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 msgr2=0x7fc74c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc74b400640 1 --2- 172.21.15.118:0/87473828 >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 0x7fc74c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc743e00640 1 --2- 172.21.15.118:0/87473828 >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 0x7fc74c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc743e00640 1 -- 172.21.15.118:0/87473828 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0c0fb0 con 0x7fc74c0c0890 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.057+0000 7fc74b400640 1 --2- 172.21.15.118:0/87473828 >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 0x7fc74c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.058+0000 7fc743e00640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c06e7f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc74c06de70 tx=0x7fc73402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfeffb13491405f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:44.059 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.058+0000 7fc74a000640 1 -- 172.21.15.118:0/87473828 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7340317d0 con 0x7fc74c0c0890 2024-03-08T20:39:44.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.058+0000 7fc74a000640 1 -- 172.21.15.118:0/87473828 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc734037070 con 0x7fc74c0c0890 2024-03-08T20:39:44.060 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.058+0000 7fc74a000640 1 -- 172.21.15.118:0/87473828 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734031bb0 con 0x7fc74c0c0890 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 -- 172.21.15.118:0/87473828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 msgr2=0x7fc74c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c06e7f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc74c06de70 tx=0x7fc73402b870 comp rx=0 tx=0).stop 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 -- 172.21.15.118:0/87473828 shutdown_connections 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 --2- 172.21.15.118:0/87473828 >> v2:172.21.15.144:3300/0 conn(0x7fc74c06ed30 0x7fc74c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c06e7f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.063 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 --2- 172.21.15.118:0/87473828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c152490 0x7fc74c0c0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 -- 172.21.15.118:0/87473828 >> 172.21.15.118:0/87473828 conn(0x7fc74c0a84c0 msgr2=0x7fc74c0a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:44.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 -- 172.21.15.118:0/87473828 shutdown_connections 2024-03-08T20:39:44.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.059+0000 7fc751600640 1 -- 172.21.15.118:0/87473828 wait complete. 2024-03-08T20:39:44.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.061+0000 7fc751600640 1 Processor -- start 2024-03-08T20:39:44.064 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.061+0000 7fc751600640 1 -- start start 2024-03-08T20:39:44.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c06ed30 0x7fc74c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74c152490 0x7fc74c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0c1850 con 0x7fc74c0c0890 2024-03-08T20:39:44.065 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0c1570 con 0x7fc74c152490 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc751600640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c158b40 con 0x7fc74c06ed30 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47802/0 (socket says 172.21.15.118:47802) 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 -- 172.21.15.118:0/4068455273 learned_addr learned my addr 172.21.15.118:0/4068455273 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 -- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c06ed30 msgr2=0x7fc74c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:44.066 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c06ed30 0x7fc74c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 -- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74c152490 msgr2=0x7fc74c0aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74c152490 0x7fc74c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.062+0000 7fc743e00640 1 -- 172.21.15.118:0/4068455273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0c4b40 con 0x7fc74c0c0890 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc743e00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc734000c00 tx=0x7fc7340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734032870 con 0x7fc74c0c0890 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc734032a10 con 0x7fc74c0c0890 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c156e20 con 0x7fc74c0c0890 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734032e20 con 0x7fc74c0c0890 2024-03-08T20:39:44.067 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.063+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c0c53e0 con 0x7fc74c0c0890 2024-03-08T20:39:44.068 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.064+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c074a40 con 0x7fc74c0c0890 2024-03-08T20:39:44.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.065+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc7340453f0 con 0x7fc74c0c0890 2024-03-08T20:39:44.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.066+0000 7fc742a00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 0x7fc72806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:44.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.066+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fc7340ace90 con 0x7fc74c0c0890 2024-03-08T20:39:44.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.066+0000 7fc74aa00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 0x7fc72806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:44.069 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.067+0000 7fc74aa00640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 0x7fc72806e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00a810 tx=0x7fc73c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:44.070 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.070+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7fc74c0c4b40 con 0x7fc74c0c0890 2024-03-08T20:39:44.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:44.273+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc74c06e5d0 con 0x7fc74c0c0890 2024-03-08T20:39:45.269 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.270+0000 7fc742a00640 1 -- 172.21.15.118:0/4068455273 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc734040070 con 0x7fc74c0c0890 2024-03-08T20:39:45.270 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_metadata' removed 2024-03-08T20:39:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 msgr2=0x7fc72806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 0x7fc72806e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00a810 tx=0x7fc73c008040 comp rx=0 tx=0).stop 2024-03-08T20:39:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 msgr2=0x7fc74c149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:45.274 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc734000c00 tx=0x7fc7340046c0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 shutdown_connections 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7fc72806bbd0 0x7fc72806e090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc74c152490 0x7fc74c0aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.274+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc74c0c0890 0x7fc74c149460 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.275+0000 7fc751600640 1 --2- 172.21.15.118:0/4068455273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc74c06ed30 0x7fc74c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.275 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.275+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 >> 172.21.15.118:0/4068455273 conn(0x7fc74c0a84c0 msgr2=0x7fc74c153330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:45.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.275+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 shutdown_connections 2024-03-08T20:39:45.276 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.275+0000 7fc751600640 1 -- 172.21.15.118:0/4068455273 wait complete. 2024-03-08T20:39:45.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-08T20:39:45.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.511+0000 7f66e7200640 1 Processor -- start 2024-03-08T20:39:45.511 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.511+0000 7f66e7200640 1 -- start start 2024-03-08T20:39:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66e013ac10 0x7f66e0066d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.512 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e00c26d0 0x7f66e00c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66e0158430 0x7f66e0158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e013aff0 con 0x7f66e013ac10 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0159350 con 0x7f66e0158430 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66e7200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c3080 con 0x7f66e00c26d0 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66e013ac10 0x7f66e0066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f66e013ac10 0x7f66e0066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47816/0 (socket says 172.21.15.118:47816) 2024-03-08T20:39:45.513 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 -- 172.21.15.118:0/3251619522 learned_addr learned my addr 172.21.15.118:0/3251619522 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:45.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 -- 172.21.15.118:0/3251619522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e00c26d0 msgr2=0x7f66e00c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:45.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 --2- 172.21.15.118:0/3251619522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e00c26d0 0x7f66e00c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 -- 172.21.15.118:0/3251619522 >> v2:172.21.15.144:3300/0 conn(0x7f66e0158430 msgr2=0x7f66e0158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:45.515 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 --2- 172.21.15.118:0/3251619522 >> v2:172.21.15.144:3300/0 conn(0x7f66e0158430 0x7f66e0158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.513+0000 7f66dfe00640 1 -- 172.21.15.118:0/3251619522 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00c1910 con 0x7f66e013ac10 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.515+0000 7f66dfe00640 1 --2- 172.21.15.118:0/3251619522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0066d10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66e0071170 tx=0x7f66d002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e3aaf4b2a10e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.515+0000 7f66df400640 1 -- 172.21.15.118:0/3251619522 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d002c9f0 con 0x7f66e013ac10 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.515+0000 7f66df400640 1 -- 172.21.15.118:0/3251619522 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f66d002cb90 con 0x7f66e013ac10 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.515+0000 7f66df400640 1 -- 172.21.15.118:0/3251619522 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00343f0 con 0x7f66e013ac10 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 -- 172.21.15.118:0/3251619522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 msgr2=0x7f66e0066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 --2- 172.21.15.118:0/3251619522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0066d10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f66e0071170 tx=0x7f66d002be50 comp rx=0 tx=0).stop 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 -- 172.21.15.118:0/3251619522 shutdown_connections 2024-03-08T20:39:45.516 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 --2- 172.21.15.118:0/3251619522 >> v2:172.21.15.144:3300/0 conn(0x7f66e0158430 0x7f66e0158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 --2- 172.21.15.118:0/3251619522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e00c26d0 0x7f66e00c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 --2- 172.21.15.118:0/3251619522 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0066d10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 -- 172.21.15.118:0/3251619522 >> 172.21.15.118:0/3251619522 conn(0x7f66e0072720 msgr2=0x7f66e006ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:45.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 -- 172.21.15.118:0/3251619522 shutdown_connections 2024-03-08T20:39:45.517 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.516+0000 7f66e7200640 1 -- 172.21.15.118:0/3251619522 wait complete. 2024-03-08T20:39:45.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.517+0000 7f66e7200640 1 Processor -- start 2024-03-08T20:39:45.519 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.518+0000 7f66e7200640 1 -- start start 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.518+0000 7f66e7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 0x7f66e0138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.518+0000 7f66e7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66e7200640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e0158430 0x7f66e01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66e7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c21b0 con 0x7f66e013ac10 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66e7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c1ed0 con 0x7f66e00c26d0 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66e7200640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00acc60 con 0x7f66e0158430 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:45.520 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47828/0 (socket says 172.21.15.118:47828) 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 -- 172.21.15.118:0/2668012434 learned_addr learned my addr 172.21.15.118:0/2668012434 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66dfe00640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 0x7f66e0138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 -- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e0158430 msgr2=0x7f66e01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e0158430 0x7f66e01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 -- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 msgr2=0x7f66e0138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 0x7f66e0138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66d7400640 1 -- 172.21.15.118:0/2668012434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e01ee350 con 0x7f66e013ac10 2024-03-08T20:39:45.521 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.519+0000 7f66dfe00640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 0x7f66e0138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66d7400640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f66c800b440 tx=0x7f66c800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8015020 con 0x7f66e013ac10 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f66c8011890 con 0x7f66e013ac10 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8011ca0 con 0x7f66e013ac10 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e01ee5c0 con 0x7f66e013ac10 2024-03-08T20:39:45.522 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.520+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e01393f0 con 0x7f66e013ac10 2024-03-08T20:39:45.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.521+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0074a40 con 0x7f66e013ac10 2024-03-08T20:39:45.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.522+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f66c8018020 con 0x7f66e013ac10 2024-03-08T20:39:45.523 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.523+0000 7f66dcc00640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 0x7f66bc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:45.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.523+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f66c808af80 con 0x7f66e013ac10 2024-03-08T20:39:45.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.523+0000 7f66dfe00640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 0x7f66bc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:45.524 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.524+0000 7f66dfe00640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 0x7f66bc06e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66d0035000 tx=0x7f66d0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:45.529 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.528+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7f66c801f020 con 0x7f66e013ac10 2024-03-08T20:39:45.757 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:45.758+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66e013d820 con 0x7f66e013ac10 2024-03-08T20:39:46.288 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.288+0000 7f66dcc00640 1 -- 172.21.15.118:0/2668012434 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f66c800d040 con 0x7f66e013ac10 2024-03-08T20:39:46.289 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data' removed 2024-03-08T20:39:46.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 msgr2=0x7f66bc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 0x7f66bc06e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66d0035000 tx=0x7f66d0030000 comp rx=0 tx=0).stop 2024-03-08T20:39:46.291 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 msgr2=0x7f66e0151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f66c800b440 tx=0x7f66c800b900 comp rx=0 tx=0).stop 2024-03-08T20:39:46.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 shutdown_connections 2024-03-08T20:39:46.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7f66bc06bc00 0x7f66bc06e0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f66e0158430 0x7f66e01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.292 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f66e013ac10 0x7f66e0151eb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 --2- 172.21.15.118:0/2668012434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66e00c26d0 0x7f66e0138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 >> 172.21.15.118:0/2668012434 conn(0x7f66e0072720 msgr2=0x7f66e0139920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 shutdown_connections 2024-03-08T20:39:46.293 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.292+0000 7f66e7200640 1 -- 172.21.15.118:0/2668012434 wait complete. 2024-03-08T20:39:46.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-08T20:39:46.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.536+0000 7faa24800640 1 Processor -- start 2024-03-08T20:39:46.536 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.537+0000 7faa24800640 1 -- start start 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa24800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa1c0c7190 0x7faa1c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa24800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c06cff0 0x7faa1c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa24800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0c7a50 con 0x7faa1c152480 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa24800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c155f60 con 0x7faa1c0c7190 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa24800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c7770 con 0x7faa1c06cff0 2024-03-08T20:39:46.538 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa21400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa1c0c7190 0x7faa1c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa21400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa1c0c7190 0x7faa1c155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47834/0 (socket says 172.21.15.118:47834) 2024-03-08T20:39:46.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa21400640 1 -- 172.21.15.118:0/3002924090 learned_addr learned my addr 172.21.15.118:0/3002924090 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:46.539 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.538+0000 7faa22800640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c06cff0 0x7faa1c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.539+0000 7faa21400640 1 -- 172.21.15.118:0/3002924090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c06cff0 msgr2=0x7faa1c0c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T20:39:46.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.539+0000 7faa21400640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c06cff0 0x7faa1c0c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.540 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.539+0000 7faa21400640 1 -- 172.21.15.118:0/3002924090 >> v1:172.21.15.144:6789/0 conn(0x7faa1c152480 legacy=0x7faa1c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.539+0000 7faa21400640 1 -- 172.21.15.118:0/3002924090 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c06c510 con 0x7faa1c0c7190 2024-03-08T20:39:46.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.540+0000 7faa21400640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c0c7190 0x7faa1c155a20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5583ebdd39d5e4d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:46.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.540+0000 7faa20a00640 1 -- 172.21.15.118:0/3002924090 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c035020 con 0x7faa1c0c7190 2024-03-08T20:39:46.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.540+0000 7faa20a00640 1 -- 172.21.15.118:0/3002924090 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa0c031640 con 0x7faa1c0c7190 2024-03-08T20:39:46.541 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.540+0000 7faa20a00640 1 -- 172.21.15.118:0/3002924090 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c02d040 con 0x7faa1c0c7190 2024-03-08T20:39:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 -- 172.21.15.118:0/3002924090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c0c7190 msgr2=0x7faa1c155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c0c7190 0x7faa1c155a20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c02b8f0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.542 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 -- 172.21.15.118:0/3002924090 shutdown_connections 2024-03-08T20:39:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c06cff0 0x7faa1c0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 --2- 172.21.15.118:0/3002924090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c0c7190 0x7faa1c155a20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.541+0000 7faa24800640 1 -- 172.21.15.118:0/3002924090 >> 172.21.15.118:0/3002924090 conn(0x7faa1c072cf0 msgr2=0x7faa1c0ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.542+0000 7faa24800640 1 -- 172.21.15.118:0/3002924090 shutdown_connections 2024-03-08T20:39:46.543 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.542+0000 7faa24800640 1 -- 172.21.15.118:0/3002924090 wait complete. 2024-03-08T20:39:46.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.543+0000 7faa24800640 1 Processor -- start 2024-03-08T20:39:46.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.544+0000 7faa24800640 1 -- start start 2024-03-08T20:39:46.544 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 0x7faa1c1ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 0x7faa1c0ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c06d430 con 0x7faa1c06cff0 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c06cad0 con 0x7faa1c0c7190 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa24800640 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c152860 con 0x7faa1c152480 2024-03-08T20:39:46.545 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa21e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa21e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:47838/0 (socket says 172.21.15.118:47838) 2024-03-08T20:39:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa21e00640 1 -- 172.21.15.118:0/839985638 learned_addr learned my addr 172.21.15.118:0/839985638 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-08T20:39:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.545+0000 7faa21400640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 0x7faa1c1ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.547 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa22800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 0x7faa1c0ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 -- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 msgr2=0x7faa1c0ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 0x7faa1c0ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 -- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 msgr2=0x7faa1c156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 -- 172.21.15.118:0/839985638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c1510d0 con 0x7faa1c0c7190 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa22800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 0x7faa1c0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T20:39:46.548 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21e00640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.546+0000 7faa21400640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 0x7faa1c1ef9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa0c033000 tx=0x7faa0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.547+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c035040 con 0x7faa1c0c7190 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.547+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa0c0399f0 con 0x7faa1c0c7190 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.547+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c039e20 con 0x7faa1c0c7190 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.547+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c1513b0 con 0x7faa1c0c7190 2024-03-08T20:39:46.549 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.547+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c1f25a0 con 0x7faa1c0c7190 2024-03-08T20:39:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.548+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c074a40 con 0x7faa1c0c7190 2024-03-08T20:39:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.550+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7faa0c038020 con 0x7faa1c0c7190 2024-03-08T20:39:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.551+0000 7faa16000640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 0x7faa0006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T20:39:46.550 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.551+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5853+0+0 (secure 0 0 0) 0x7faa0c0ac820 con 0x7faa1c0c7190 2024-03-08T20:39:46.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.551+0000 7faa21e00640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 0x7faa0006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T20:39:46.551 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.552+0000 7faa21e00640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 0x7faa0006e160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa10001720 tx=0x7faa10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T20:39:46.558 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.559+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183781 (secure 0 0 0) 0x7faa0c042330 con 0x7faa1c0c7190 2024-03-08T20:39:46.762 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:46.762+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa1c1593c0 con 0x7faa1c0c7190 2024-03-08T20:39:47.303 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.302+0000 7faa16000640 1 -- 172.21.15.118:0/839985638 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7faa0c07b2f0 con 0x7faa1c0c7190 2024-03-08T20:39:47.306 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'cephfs_data_ec' removed 2024-03-08T20:39:47.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.308+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 msgr2=0x7faa0006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:47.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.308+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 0x7faa0006e160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa10001720 tx=0x7faa10009040 comp rx=0 tx=0).stop 2024-03-08T20:39:47.307 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.308+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 msgr2=0x7faa1c1ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T20:39:47.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.308+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 0x7faa1c1ef9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa0c033000 tx=0x7faa0c0046c0 comp rx=0 tx=0).stop 2024-03-08T20:39:47.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 shutdown_connections 2024-03-08T20:39:47.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:6832/3268310629,v1:172.21.15.118:6833/3268310629] conn(0x7faa0006bca0 0x7faa0006e160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:47.308 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1c152480 0x7faa1c0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:47.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa1c0c7190 0x7faa1c1ef9a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:47.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 --2- 172.21.15.118:0/839985638 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa1c06cff0 0x7faa1c156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T20:39:47.309 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.309+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 >> 172.21.15.118:0/839985638 conn(0x7faa1c072cf0 msgr2=0x7faa1c154450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T20:39:47.310 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.311+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 shutdown_connections 2024-03-08T20:39:47.312 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-08T20:39:47.311+0000 7faa24800640 1 -- 172.21.15.118:0/839985638 wait complete. 2024-03-08T20:39:47.348 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-08T20:39:47.348 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-08T20:39:47.348 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:39:47.373 INFO:tasks.ceph.mds.a:Stopped 2024-03-08T20:39:47.374 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-08T20:39:47.374 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:39:53.441 INFO:tasks.ceph.mds.c:Stopped 2024-03-08T20:39:53.441 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-08T20:39:53.442 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:39:53.466 INFO:tasks.ceph.mds.b:Stopped 2024-03-08T20:39:53.466 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-08T20:39:53.466 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:39:53.537 INFO:tasks.ceph.mds.d:Stopped 2024-03-08T20:39:53.538 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-08T20:39:53.538 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-08T20:39:53.538 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:39:59.641 INFO:tasks.ceph.osd.0:Stopped 2024-03-08T20:39:59.642 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-08T20:39:59.642 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:00.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-08T20:40:05.744 INFO:tasks.ceph.osd.1:Stopped 2024-03-08T20:40:05.745 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-08T20:40:05.745 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:06.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-08T20:40:06.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-08T20:40:10.566 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:10.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:11.848 INFO:tasks.ceph.osd.2:Stopped 2024-03-08T20:40:11.848 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-08T20:40:11.848 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:12.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-08T20:40:12.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-08T20:40:17.951 INFO:tasks.ceph.osd.3:Stopped 2024-03-08T20:40:17.951 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-08T20:40:17.951 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:18.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-08T20:40:18.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-08T20:40:23.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-08T20:40:23.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-08T20:40:24.053 INFO:tasks.ceph.osd.4:Stopped 2024-03-08T20:40:24.054 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-08T20:40:24.054 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:29.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-08T20:40:29.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-08T20:40:30.155 INFO:tasks.ceph.osd.5:Stopped 2024-03-08T20:40:30.156 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-08T20:40:30.156 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:35.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-08T20:40:35.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-08T20:40:36.257 INFO:tasks.ceph.osd.6:Stopped 2024-03-08T20:40:36.258 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-08T20:40:36.258 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:40.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-08T20:40:40.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-08T20:40:42.116 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:42.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:42.359 INFO:tasks.ceph.osd.7:Stopped 2024-03-08T20:40:42.360 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-08T20:40:42.360 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-08T20:40:42.360 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:42.437 INFO:tasks.ceph.mgr.y:Stopped 2024-03-08T20:40:42.437 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-08T20:40:42.437 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:42.521 INFO:tasks.ceph.mgr.x:Stopped 2024-03-08T20:40:42.521 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-08T20:40:42.522 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-08T20:40:42.522 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:42.574 INFO:tasks.ceph.mon.a:Stopped 2024-03-08T20:40:42.574 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-08T20:40:42.574 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:42.614 INFO:tasks.ceph.mon.b:Stopped 2024-03-08T20:40:42.615 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-08T20:40:42.615 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T20:40:42.689 INFO:tasks.ceph.mon.c:Stopped 2024-03-08T20:40:42.690 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-08T20:40:42.690 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-08T20:40:42.790 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:40:42.791 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-08T20:40:43.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:40:43.092 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-08T20:40:43.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:40:43.295 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-08T20:40:43.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:40:43.485 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-08T20:40:43.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:40:43.708 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-08T20:40:43.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:40:43.982 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-08T20:40:44.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:40:44.153 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-08T20:40:44.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:40:44.349 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-08T20:40:44.521 INFO:tasks.ceph:Archiving mon data... 2024-03-08T20:40:44.523 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/data/mon.a.tgz 2024-03-08T20:40:44.523 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-03-08T20:40:44.579 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.izhvhV1FRn 2024-03-08T20:40:44.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.izhvhV1FRn 2024-03-08T20:40:44.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.izhvhV1FRn 2024-03-08T20:40:44.882 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.izhvhV1FRn is 331KB 2024-03-08T20:40:44.986 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.izhvhV1FRn 2024-03-08T20:40:45.041 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/data/mon.b.tgz 2024-03-08T20:40:45.041 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-03-08T20:40:45.098 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.4ncRskRsP7 2024-03-08T20:40:45.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4ncRskRsP7 2024-03-08T20:40:45.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.4ncRskRsP7 2024-03-08T20:40:45.432 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.4ncRskRsP7 is 336KB 2024-03-08T20:40:45.541 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.4ncRskRsP7 2024-03-08T20:40:45.595 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/data/mon.c.tgz 2024-03-08T20:40:45.595 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-03-08T20:40:45.645 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.5mv0G0pPjj 2024-03-08T20:40:45.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5mv0G0pPjj 2024-03-08T20:40:45.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-08T20:40:45.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.5mv0G0pPjj 2024-03-08T20:40:45.964 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.5mv0G0pPjj is 336KB 2024-03-08T20:40:46.064 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.5mv0G0pPjj 2024-03-08T20:40:46.118 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-08T20:40:46.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T20:40:46.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T20:40:46.274 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T20:40:46.331 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T20:40:46.331 INFO:tasks.ceph:Archiving crash dumps... 2024-03-08T20:40:46.333 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi118/crash 2024-03-08T20:40:46.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T20:40:46.430 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi144/crash 2024-03-08T20:40:46.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T20:40:46.530 INFO:tasks.ceph:Shutting down logrotate 2024-03-08T20:40:46.531 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:46.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:46.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:46.767 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T20:40:46.871 INFO:tasks.ceph:Compressing logs... 2024-03-08T20:40:46.871 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T20:40:46.878 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T20:40:46.962 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132033.log 2024-03-08T20:40:46.964 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-08T20:40:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130758.log 2024-03-08T20:40:46.965 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.132033.log.gz 2024-03-08T20:40:46.965 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-03-08T20:40:46.966 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-08T20:40:46.967 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-03-08T20:40:46.967 INFO:teuthology.orchestra.run.smithi118.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130758.log.gz 2024-03-08T20:40:46.968 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-03-08T20:40:46.968 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41397.log 2024-03-08T20:40:46.968 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-03-08T20:40:46.970 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132427.log 2024-03-08T20:40:46.970 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-03-08T20:40:46.970 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T20:40:46.971 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36906.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-08T20:40:46.971 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-08T20:40:46.972 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36866.log 2024-03-08T20:40:46.972 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131487.log 2024-03-08T20:40:46.973 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41397.log.gz 2024-03-08T20:40:46.973 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2024-03-08T20:40:46.973 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132427.log.gz 2024-03-08T20:40:46.973 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131739.log 2024-03-08T20:40:46.974 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131487.log.gz 2024-03-08T20:40:46.975 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45252.log 2024-03-08T20:40:46.975 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2024-03-08T20:40:46.975 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-03-08T20:40:46.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36866.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-08T20:40:46.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36946.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-08T20:40:46.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41234.log 2024-03-08T20:40:46.977 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37106.log 2024-03-08T20:40:46.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.41234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41234.log.gz 2024-03-08T20:40:46.978 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37066.log 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131739.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131739.log.gz 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41225.log 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131235.log 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45252.log.gz 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130322.log 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41225.log.gz 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-03-08T20:40:46.979 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131235.log.gz 2024-03-08T20:40:46.981 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130322.log.gz 2024-03-08T20:40:46.981 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41649.log 2024-03-08T20:40:46.981 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132301.log 2024-03-08T20:40:46.981 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37106.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37066.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37026.log 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36986.log 2024-03-08T20:40:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36826.log 2024-03-08T20:40:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36986.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-08T20:40:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36826.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41649.log.gz 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130987.log 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132301.log.gz 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44783.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131865.log 2024-03-08T20:40:46.986 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130987.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130987.log.gz 2024-03-08T20:40:46.987 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132175.log 2024-03-08T20:40:46.987 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131319.log 2024-03-08T20:40:46.988 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131865.log.gz 2024-03-08T20:40:46.988 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132175.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.132175.log.gz 2024-03-08T20:40:46.988 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-03-08T20:40:46.989 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2024-03-08T20:40:46.989 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45268.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131319.log.gz 2024-03-08T20:40:46.989 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-03-08T20:40:46.990 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2024-03-08T20:40:46.990 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2024-03-08T20:40:46.991 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2024-03-08T20:40:46.991 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43515.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-03-08T20:40:46.992 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.132259.log 2024-03-08T20:40:46.993 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132469.log 2024-03-08T20:40:46.993 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2024-03-08T20:40:46.994 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2024-03-08T20:40:46.994 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132259.log.gz 2024-03-08T20:40:46.995 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44405.log 2024-03-08T20:40:46.995 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.132469.log.gz 2024-03-08T20:40:46.996 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36826.log.gz 2024-03-08T20:40:46.996 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41155.log 2024-03-08T20:40:46.996 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2024-03-08T20:40:46.997 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-03-08T20:40:46.998 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44405.log.gz 2024-03-08T20:40:46.998 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36866.log.gz 2024-03-08T20:40:46.998 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41155.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41155.log.gz 2024-03-08T20:40:46.999 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131907.log 2024-03-08T20:40:46.999 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-03-08T20:40:47.000 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40722.log 2024-03-08T20:40:47.000 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-03-08T20:40:47.000 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-03-08T20:40:47.001 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36986.log.gz 2024-03-08T20:40:47.001 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2024-03-08T20:40:47.001 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131907.log.gz 2024-03-08T20:40:47.002 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40722.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T20:40:47.002 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40722.log.gz 2024-03-08T20:40:47.003 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37026.log.gz 2024-03-08T20:40:47.003 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-03-08T20:40:47.003 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2024-03-08T20:40:47.004 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37066.log.gz 2024-03-08T20:40:47.004 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37106.log.gz 2024-03-08T20:40:47.005 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130632.log 2024-03-08T20:40:47.005 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T20:40:47.005 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41691.log 2024-03-08T20:40:47.005 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-03-08T20:40:47.006 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132117.log 2024-03-08T20:40:47.007 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130632.log.gz 2024-03-08T20:40:47.007 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130674.log 2024-03-08T20:40:47.007 INFO:teuthology.orchestra.run.smithi118.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41691.log.gz 2024-03-08T20:40:47.008 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-03-08T20:40:47.009 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132117.log.gz 2024-03-08T20:40:47.010 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41607.log 2024-03-08T20:40:47.010 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130674.log.gz 2024-03-08T20:40:47.010 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44186.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2024-03-08T20:40:47.011 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2024-03-08T20:40:47.012 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2024-03-08T20:40:47.012 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41607.log.gz 2024-03-08T20:40:47.013 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41523.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30978.log 2024-03-08T20:40:47.013 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2024-03-08T20:40:47.014 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41269.log 2024-03-08T20:40:47.014 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2024-03-08T20:40:47.015 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.tmp-client.admin.30978.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30978.log.gz 2024-03-08T20:40:47.015 INFO:teuthology.orchestra.run.smithi144.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T20:40:47.016 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2024-03-08T20:40:47.016 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2024-03-08T20:40:47.017 INFO:teuthology.orchestra.run.smithi118.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41269.log.gz 2024-03-08T20:40:47.017 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41070.log 2024-03-08T20:40:47.017 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2024-03-08T20:40:47.018 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131949.log 2024-03-08T20:40:47.019 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2024-03-08T20:40:47.020 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41481.log 2024-03-08T20:40:47.020 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41070.log.gz 2024-03-08T20:40:47.021 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131949.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-08T20:40:47.021 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131949.log.gz 2024-03-08T20:40:47.022 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2024-03-08T20:40:47.022 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41481.log.gz 2024-03-08T20:40:47.023 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-03-08T20:40:47.024 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2024-03-08T20:40:47.025 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2024-03-08T20:40:47.025 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-03-08T20:40:47.026 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-03-08T20:40:47.026 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2024-03-08T20:40:47.027 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131781.log 2024-03-08T20:40:47.028 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-03-08T20:40:47.028 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-03-08T20:40:47.029 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131781.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131781.log.gz 2024-03-08T20:40:47.030 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131403.log 2024-03-08T20:40:47.031 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131029.log 2024-03-08T20:40:47.031 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-03-08T20:40:47.032 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131655.log 2024-03-08T20:40:47.032 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131403.log.gz 2024-03-08T20:40:47.033 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131029.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131029.log.gz 2024-03-08T20:40:47.033 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-03-08T20:40:47.034 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-03-08T20:40:47.035 INFO:teuthology.orchestra.run.smithi118.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131655.log.gz 2024-03-08T20:40:47.036 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43845.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-03-08T20:40:47.036 INFO:teuthology.orchestra.run.smithi118.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43253.log 2024-03-08T20:40:47.037 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42529.log 2024-03-08T20:40:47.037 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-03-08T20:40:47.038 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42797.log 2024-03-08T20:40:47.038 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43253.log.gz 2024-03-08T20:40:47.039 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-03-08T20:40:47.040 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-03-08T20:40:47.040 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42797.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.42797.log.gz -- 2024-03-08T20:40:47.041 INFO:teuthology.orchestra.run.smithi118.stderr: /var/log/ceph/ceph-client.admin.41565.log 2024-03-08T20:40:47.042 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42755.log 2024-03-08T20:40:47.042 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-03-08T20:40:47.043 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41565.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-03-08T20:40:47.043 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-03-08T20:40:47.044 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41353.log 2024-03-08T20:40:47.044 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42755.log.gz 2024-03-08T20:40:47.045 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131445.log 2024-03-08T20:40:47.046 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-03-08T20:40:47.047 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131991.log 2024-03-08T20:40:47.047 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41353.log.gz 2024-03-08T20:40:47.048 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130800.log 2024-03-08T20:40:47.048 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131445.log.gz 2024-03-08T20:40:47.049 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-03-08T20:40:47.049 INFO:teuthology.orchestra.run.smithi118.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131991.log.gz 2024-03-08T20:40:47.050 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131613.log 2024-03-08T20:40:47.050 INFO:teuthology.orchestra.run.smithi118.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130800.log.gz 2024-03-08T20:40:47.051 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43169.log 2024-03-08T20:40:47.051 INFO:teuthology.orchestra.run.smithi118.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-03-08T20:40:47.052 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131613.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-08T20:40:47.053 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131613.log.gz 2024-03-08T20:40:47.053 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43511.log 2024-03-08T20:40:47.054 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43169.log.gz 2024-03-08T20:40:47.054 INFO:teuthology.orchestra.run.smithi144.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-08T20:40:47.055 INFO:teuthology.orchestra.run.smithi144.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-08T20:40:47.055 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2024-03-08T20:40:47.056 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42839.log 2024-03-08T20:40:47.057 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2024-03-08T20:40:47.057 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-03-08T20:40:47.058 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2024-03-08T20:40:47.059 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44112.log 2024-03-08T20:40:47.059 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42839.log.gz 2024-03-08T20:40:47.060 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42445.log 2024-03-08T20:40:47.061 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-03-08T20:40:47.062 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2024-03-08T20:40:47.062 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44112.log.gz 2024-03-08T20:40:47.063 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-03-08T20:40:47.063 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42445.log.gz 2024-03-08T20:40:47.064 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131529.log 2024-03-08T20:40:47.065 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2024-03-08T20:40:47.066 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-03-08T20:40:47.066 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-03-08T20:40:47.067 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131071.log 2024-03-08T20:40:47.067 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131529.log.gz 2024-03-08T20:40:47.068 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40818.log 2024-03-08T20:40:47.068 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-03-08T20:40:47.070 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43085.log 2024-03-08T20:40:47.070 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131071.log.gz 2024-03-08T20:40:47.071 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2024-03-08T20:40:47.071 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40818.log.gz 2024-03-08T20:40:47.072 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130406.log 2024-03-08T20:40:47.072 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43085.log.gz 2024-03-08T20:40:47.073 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42403.log 2024-03-08T20:40:47.074 INFO:teuthology.orchestra.run.smithi118.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2024-03-08T20:40:47.075 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2024-03-08T20:40:47.075 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130406.log.gz 2024-03-08T20:40:47.076 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44909.log 2024-03-08T20:40:47.076 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42403.log.gz 2024-03-08T20:40:47.077 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-03-08T20:40:47.077 INFO:teuthology.orchestra.run.smithi118.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2024-03-08T20:40:47.078 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41311.log 2024-03-08T20:40:47.079 INFO:teuthology.orchestra.run.smithi118.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44909.log.gz 2024-03-08T20:40:47.080 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130490.log 2024-03-08T20:40:47.080 INFO:teuthology.orchestra.run.smithi118.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-03-08T20:40:47.081 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43295.log 2024-03-08T20:40:47.081 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41311.log.gz 2024-03-08T20:40:47.082 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-03-08T20:40:47.083 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130490.log.gz 2024-03-08T20:40:47.083 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41439.log 2024-03-08T20:40:47.084 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-03-08T20:40:47.085 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132511.log 2024-03-08T20:40:47.085 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-03-08T20:40:47.086 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131361.log 2024-03-08T20:40:47.086 INFO:teuthology.orchestra.run.smithi118.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41439.log.gz 2024-03-08T20:40:47.087 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132511.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-08T20:40:47.088 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132511.log.gz 2024-03-08T20:40:47.089 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-03-08T20:40:47.089 INFO:teuthology.orchestra.run.smithi118.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.131361.log.gz 2024-03-08T20:40:47.090 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131697.log 2024-03-08T20:40:47.091 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2024-03-08T20:40:47.092 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-03-08T20:40:47.092 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-03-08T20:40:47.093 INFO:teuthology.orchestra.run.smithi118.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131697.log.gz 2024-03-08T20:40:47.094 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-03-08T20:40:47.094 INFO:teuthology.orchestra.run.smithi118.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2024-03-08T20:40:47.095 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.40899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-03-08T20:40:47.095 INFO:teuthology.orchestra.run.smithi118.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-03-08T20:40:47.096 INFO:teuthology.orchestra.run.smithi144.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-08T20:40:47.097 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44147.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-08T20:40:47.097 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-03-08T20:40:47.097 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2024-03-08T20:40:47.098 INFO:teuthology.orchestra.run.smithi118.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-03-08T20:40:47.098 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-03-08T20:40:47.100 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37278.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2024-03-08T20:40:47.100 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2024-03-08T20:40:47.102 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42713.log 2024-03-08T20:40:47.102 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43519.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-03-08T20:40:47.103 INFO:teuthology.orchestra.run.smithi118.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2024-03-08T20:40:47.103 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43500.log 2024-03-08T20:40:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42713.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42713.log.gz 2024-03-08T20:40:47.104 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130364.log 2024-03-08T20:40:47.105 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132075.log 2024-03-08T20:40:47.106 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43500.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43500.log.gz 2024-03-08T20:40:47.106 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130364.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T20:40:47.107 INFO:teuthology.orchestra.run.smithi118.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.130364.log.gz 2024-03-08T20:40:47.108 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132075.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132075.log.gz 2024-03-08T20:40:47.108 INFO:teuthology.orchestra.run.smithi118.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2024-03-08T20:40:47.111 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42189.log 2024-03-08T20:40:47.111 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43503.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gz 2024-03-08T20:40:47.112 INFO:teuthology.orchestra.run.smithi118.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.42189.log: 2024-03-08T20:40:47.113 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-08T20:40:47.114 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43337.log 2024-03-08T20:40:47.114 INFO:teuthology.orchestra.run.smithi118.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42189.log.gz 2024-03-08T20:40:47.116 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130945.log 2024-03-08T20:40:47.117 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43337.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43337.log.gz 2024-03-08T20:40:47.118 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130945.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.130945.log.gz 2024-03-08T20:40:47.119 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44489.log 2024-03-08T20:40:47.120 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130903.log 2024-03-08T20:40:47.122 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44489.log.gz 2024-03-08T20:40:47.123 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130903.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130903.log.gz 2024-03-08T20:40:47.124 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-08T20:40:47.125 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-03-08T20:40:47.127 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2024-03-08T20:40:47.128 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43841.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-03-08T20:40:47.130 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-08T20:40:47.131 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.41014.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2024-03-08T20:40:47.132 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130847.log 2024-03-08T20:40:47.133 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2024-03-08T20:40:47.134 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130847.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130847.log.gz 2024-03-08T20:40:47.135 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2024-03-08T20:40:47.136 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44825.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2024-03-08T20:40:47.137 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.43836.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2024-03-08T20:40:47.138 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36910.log 2024-03-08T20:40:47.140 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132385.log 2024-03-08T20:40:47.141 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.36910.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-03-08T20:40:47.142 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132385.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132385.log.gz 2024-03-08T20:40:47.143 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130716.log 2024-03-08T20:40:47.144 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45695.log 2024-03-08T20:40:47.146 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130716.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130716.log.gz 2024-03-08T20:40:47.149 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.0.45695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130448.log 2024-03-08T20:40:47.152 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-03-08T20:40:47.152 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131823.log 2024-03-08T20:40:47.152 INFO:teuthology.orchestra.run.smithi118.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130448.log.gz 2024-03-08T20:40:47.154 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.42959.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-03-08T20:40:47.154 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130590.log 2024-03-08T20:40:47.156 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.130590.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130590.log.gz 2024-03-08T20:40:47.157 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44178.log 2024-03-08T20:40:47.159 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131823.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.131823.log.gz 2024-03-08T20:40:47.161 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44178.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44178.log.gz 2024-03-08T20:40:47.162 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131571.log 2024-03-08T20:40:47.165 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2024-03-08T20:40:47.166 INFO:teuthology.orchestra.run.smithi118.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131571.log.gz 2024-03-08T20:40:47.168 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131193.log 2024-03-08T20:40:47.172 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44993.log: /var/log/ceph/ceph-client.admin.131193.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-08T20:40:47.172 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2024-03-08T20:40:47.173 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131193.log.gz 2024-03-08T20:40:47.175 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130532.log 2024-03-08T20:40:47.181 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.130532.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2024-03-08T20:40:47.181 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130532.log.gz 2024-03-08T20:40:47.183 INFO:teuthology.orchestra.run.smithi118.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-08T20:40:47.185 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132343.log 2024-03-08T20:40:47.187 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42361.log: /var/log/ceph/ceph-client.admin.131277.log 2024-03-08T20:40:47.190 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132343.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45035.log 2024-03-08T20:40:47.191 INFO:teuthology.orchestra.run.smithi118.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132343.log.gz 2024-03-08T20:40:47.191 INFO:teuthology.orchestra.run.smithi118.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-03-08T20:40:47.192 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.131277.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2024-03-08T20:40:47.193 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.45035.log: -- replaced with /var/log/ceph/ceph-client.admin.131277.log.gz 2024-03-08T20:40:47.194 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45035.log.gz 2024-03-08T20:40:47.197 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.44573.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2024-03-08T20:40:47.197 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132217.log 2024-03-08T20:40:47.200 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.132217.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.132217.log.gz 2024-03-08T20:40:47.218 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-08T20:40:47.440 INFO:teuthology.orchestra.run.smithi118.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-08T20:40:47.660 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-08T20:40:47.907 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-08T20:41:14.035 INFO:teuthology.orchestra.run.smithi118.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-08T20:41:34.464 INFO:teuthology.orchestra.run.smithi118.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-08T20:41:37.028 INFO:teuthology.orchestra.run.smithi118.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-08T20:41:42.007 INFO:teuthology.orchestra.run.smithi144.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-08T20:41:42.115 INFO:teuthology.orchestra.run.smithi118.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.45695.log.gz 2024-03-08T20:41:42.566 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-08T20:41:48.323 INFO:teuthology.orchestra.run.smithi144.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-08T20:41:48.842 INFO:teuthology.orchestra.run.smithi118.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-08T20:41:48.846 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-03-08T20:41:48.847 INFO:teuthology.orchestra.run.smithi118.stderr:real 1m1.923s 2024-03-08T20:41:48.847 INFO:teuthology.orchestra.run.smithi118.stderr:user 3m45.176s 2024-03-08T20:41:48.847 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m16.651s 2024-03-08T20:41:49.064 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-08T20:42:09.429 INFO:teuthology.orchestra.run.smithi144.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-08T20:42:09.434 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-03-08T20:42:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:real 1m22.505s 2024-03-08T20:42:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:user 3m51.290s 2024-03-08T20:42:09.434 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m19.667s 2024-03-08T20:42:09.435 INFO:tasks.ceph:Archiving logs... 2024-03-08T20:42:09.436 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi118/log 2024-03-08T20:42:09.437 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T20:42:44.801 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi144/log 2024-03-08T20:42:44.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T20:43:32.130 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-08T20:43:32.150 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-08T20:43:32.150 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T20:43:32.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T20:43:32.313 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-08T20:43:32.325 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-08T20:43:32.325 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T20:43:32.333 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T20:43:32.378 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-03-08T20:43:32.387 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-03-08T20:43:32.388 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T20:43:32.388 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-03-08T20:43:32.389 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 -427us[ -427us] +/- 84ms 2024-03-08T20:43:32.389 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1554us[-1548us] +/- 71ms 2024-03-08T20:43:32.389 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1797us[+1802us] +/- 67ms 2024-03-08T20:43:32.389 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:43:32.417 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T20:43:32.418 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-03-08T20:43:32.418 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 -408us[ -407us] +/- 84ms 2024-03-08T20:43:32.418 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -1526us[-1526us] +/- 71ms 2024-03-08T20:43:32.418 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +1815us[+1816us] +/- 67ms 2024-03-08T20:43:32.418 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T20:43:32.419 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-08T20:43:32.428 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-08T20:43:32.429 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-08T20:43:32.442 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-08T20:43:32.654 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-08T20:43:32.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-08T20:43:32.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:43:32.974 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-08T20:43:33.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:43:33.073 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-08T20:43:33.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-08T20:43:33.096 INFO:teuthology.task.internal:Duration was 1438.321333 seconds 2024-03-08T20:43:33.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-08T20:43:33.110 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-08T20:43:33.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T20:43:33.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T20:43:33.272 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T20:43:33.321 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T20:43:33.754 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-08T20:43:33.754 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-03-08T20:43:33.754 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T20:43:33.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-03-08T20:43:33.817 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T20:43:33.886 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-08T20:43:33.886 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T20:43:33.893 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T20:43:33.985 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-08T20:43:33.985 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T20:43:33.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T20:43:34.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-08T20:43:34.195 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-08T20:43:34.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T20:43:34.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T20:43:34.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-08T20:43:34.404 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T20:43:34.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T20:43:34.517 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-03-08T20:43:34.536 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-03-08T20:43:34.591 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T20:43:34.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:43:34.641 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T20:43:34.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T20:43:34.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-08T20:43:34.705 INFO:teuthology.task.internal:Transferring archived files... 2024-03-08T20:43:34.706 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi118 2024-03-08T20:43:34.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T20:43:34.814 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112/remote/smithi144 2024-03-08T20:43:34.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T20:43:34.919 INFO:teuthology.task.internal:Removing archive directory... 2024-03-08T20:43:34.920 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T20:43:34.927 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T20:43:34.980 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-08T20:43:34.991 INFO:teuthology.task.internal:Not uploading archives. 2024-03-08T20:43:34.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-08T20:43:35.002 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-08T20:43:35.002 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T20:43:35.009 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T20:43:35.058 INFO:teuthology.orchestra.run.smithi118.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 20:43 /home/ubuntu/cephtest 2024-03-08T20:43:35.063 INFO:teuthology.orchestra.run.smithi144.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 20:43 /home/ubuntu/cephtest 2024-03-08T20:43:35.066 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-08T20:43:35.077 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-08T20:43:35.101 INFO:teuthology.nuke:Checking targets against current locks 2024-03-08T20:43:35.128 DEBUG:teuthology.nuke:shortname: smithi118 2024-03-08T20:43:35.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T20:43:35.154 DEBUG:teuthology.nuke:shortname: smithi144 2024-03-08T20:43:35.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T20:43:35.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 20:08:51.460644', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM9BkScvZt4QDYtBk4Pxn2Qt5ZzYrp+9+woEegzZUhrKrFz2RwuwpgNpdol3vAP/wlmLbN61128BVAsxldMv+aM='} 2024-03-08T20:43:35.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 20:08:51.462083', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNCdkh3ky50nCQmJAhjVxMzf3hsTQ68dRqYNoZojzitxCVzkVQiVu5zaAzqRJF/iZsitXWtI6nNv7HDZMgChsY='} 2024-03-08T20:43:35.206 INFO:teuthology.orchestra.console.smithi118:Power off 2024-03-08T20:43:35.206 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T20:43:35.231 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-03-08T20:43:35.232 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:35.247 INFO:teuthology.orchestra.console.smithi144:Power off 2024-03-08T20:43:35.248 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T20:43:35.256 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-03-08T20:43:35.269 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2024-03-08T20:43:35.269 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:35.290 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-08T20:43:39.257 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:39.291 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:39.368 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-03-08T20:43:39.403 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-08T20:43:43.371 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:43.404 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:43.486 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-03-08T20:43:43.513 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2024-03-08T20:43:43.588 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-03-08T20:43:47.516 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T20:43:47.625 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2024-03-08T20:43:47.726 INFO:teuthology.orchestra.console.smithi144:Power off completed 2024-03-08T20:43:47.832 INFO:teuthology.run:Summary data: client.0-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 client.1-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} duration: 1438.3213331699371 failure_reason: 'Command failed (workunit test kernel_untar_build.sh) on smithi144 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d63482aa89628d733e298984a762389b625c761 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a5480e7648134d839c4038f4ee4c3290 status: fail success: false 2024-03-08T20:43:47.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T20:43:47.913 INFO:teuthology.run:FAIL